The (un)Official VMWare ESXi thread.

Associate
Joined
10 Nov 2004
Posts
2,237
Location
Expat in Singapore
Come one, come all and welcome the (un)Official ESXi OCUK thread.

This thread is dedicated to VMWares ESXi Hypervisor virtulisation software.

So what is it ?.
ESXi is an operating system designed for sitting on hardware and providing multiple virtual environments or containers in which you can install other operating systems and make them think they are on standalone machines.

VMWare, of course, have a full overview here if you wish to take a look.

Documentation.
ESXi 5, the current version, documentation can be found here.

What will it run on ?.
Checkout the VMWare ESXi Hardware Compatibility List (HCL). ESXi can be pretty fussy over hardware with network chipsets being a common issue. There are also community efforts to expand on the drivers available so have a google if you don't find your chipset on the HCL. Note also that if it is not on the HCL, it does not mean it wont work, just that it has not been tested. Quite a few people run Supermicro motherboards in their ESXi servers without an issue or any patching and none are on the HCL.

Where is the free version ?.
Down load the free version of ESXi from here. You will need to register and you will get a license code required to turn the free trial version in to the free licensed version. You loose some features in the free version which are added in paid versions but currently you can run a machine with one CPU & 32GB ram on it. The free license currently has no expiry date.

I will add more as more information builds up in the thread.

vSphere 5.1 downloads;
vSphere 5.1 is available for download here (60 day trial or paid versions).

vSphere 5.1 Hypervisor (the free one) available herehttps://my.vmware.com/group/vmware/evalcenter?p=free-esxi5&lp=default (click the bottom left download link, sign in then download).
 
Last edited:
So what does it look like ?.
These shots are taken from my home ESXi 5 server.

The vSphere management application server summery panel.
ESXifreelicense.png

This is the main vSphere Windows client management application which is used to control the server and the virtual machines (vCenter is the enterprise version which can control multiple ESXi servers rather than just one at a time).

From the summery screen we can see the server makeup including CPU, Ram, network ports, datastores (hard drives) and network adaptors.

Direct Path I/O (VT-d or passthrough)
ESXifreepassthrough.png


If you have the right hardware then you can use direct path I/O which enables you to pass a device directly to a virtual machine and have it control it as if it were part of the virtual machines own hardware. Devices passed to a virtual machine in this way are exclusive to that machine and as such are not accessible tot he other virtual machines or the servers virtual resources.

Current Direct Path I/O compatibility
Intel
Processors in the i5/i7 and Xeon ranges support VT-d which is Intels version but you also need a motherboard with a Q67/Z68 or server/workstation chipset in order to use it. I will update on Ivy bridge at some time later.

AMD
If someone can confirm then I will also add details for AMD processors as I am not so familiar.

I will add some more screens as I get round to doing them.
 
How to make a bootable ESXi 5 USB -
http://www.youtube.com/watch?v=C1EvNBJ3Zb8

How to license ESXi -
http://www.youtube.com/watch?v=AN_-ybGOtzc

How to configure vt-d -
http://www.youtube.com/watch?v=CzcWd9veVuQ

How to add a datastore -
http://www.youtube.com/watch?v=mmzkHCtuWaA

How to upload ISO's -
http://www.youtube.com/watch?v=c6v8GsWJ9dc

How to install OpenIndiana (ZFS File system/Raidz) -
http://www.youtube.com/watch?v=9DeFUVfv_aQ

How to set a static IP on OpenIndiana -
http://www.youtube.com/watch?v=yOz4-ORawl0

How to install napp-it on Open Indiana -
http://www.youtube.com/watch?v=Li1Y9nI9v2g

Configuring ZFS -
http://www.youtube.com/watch?v=u70MlGpQTRM

Configuring Windows Share on ZFS -
http://www.youtube.com/watch?v=KPrgdFsE104

Auto start virtual machines in ESXi 5 -
http://www.youtube.com/watch?v=Kj3Zt_FaYdk

Installing Windows Home Server 2011 in ESXi 5 -
http://www.youtube.com/watch?v=MLvhIv0mi0w

^

Some videos I made. ZFS raidz plus WHS makes for a GREAT media sharer.

RimBlock said:
Current Direct Path I/O compatibility
Intel
Processors in the i5/i7 and Xeon ranges support VT-d which is Intels version but you also need a motherboard with a Q67/Z68 or server/workstation chipset in order to use it. I will update on Ivy bridge at some time later.

Unfortunately only non 'k' series processors work for VT-d (i.e. no 2500k! most of OCUK excluded :P). Double check on Intel's processor specification list.
 
Last edited by a moderator:
Some kit lists would be useful that show the hardware you use that allows VT-d passthrough etc, and mobos with NICs that work with the ESX4i/ESX5i without having to buy an extra NIC.
 
As requested, some kit I have used with ESXi;

I have separated out the 'supported for ESXi management network' and 'for ESXi networking' as some nics can be used from within ESXi even though they are not supported for the management network. At least one nic with ESXi management network support is required for ESXi to install. I am not including info about nics that can have their drives patched using various techniques as I have not done this.

If I list anything as 'believed' then it is strongly suspected fro evidence on other comparable hardware and information available on the internet from fairly reputable sources (Intel forums for example) but I have not personally confirmed by testing myself.

Processors
Intel
Celerons (LGA1155)
Supported on most (possibly all) LGA1155 boards.
ECC ram support unconfirmed.
Supports VT-x for virtulization

Pentiums (LGA1155)
Supported on most (possibly all) LGA1155 boards.
ECC ram support unconfirmed.
Supports VT-x for virtulization

i3 Gen2
Supported on most (possibly all) LGA1155 boards.
ECC ram support verified by myself.
Supports VT-x for virtulization

i5 Gen2
Supported on most (possibly all) LGA1155 boards.
ECC ram support unknown as no ECC boards available that take an i5 TMK.
Supports VT-x for virtulization
Supports VT-d for Direct path I/O

i7 Gen2
Supported on most (possibly all) LGA1155 boards.
ECC ram support unknown as no ECC boards available that take an i7 TMK.
Supports VT-x for virtulization
Supports VT-d for Direct path I/O

E3 Xeon 1200
Supported on Intel C202/C204/C206 motherboards.
Suspected supported on most (possibly all) LGA1155 boards but not tested.
ECC ram supported.
E3-12X0 have no onchip video (see chipset notes)
E3-12X5 have onchip video (see chipset notes)
Supports VT-x for virtulization
Supports VT-d for Direct path I/O
Motherboards
Intel
Intel DQ67EP mITX board
VT-d supported.
Onboard nic not natively supported for management network.
Onboard nic supported for ESXi networking.

Intel S1200KP mITX board
Intel C206 workstation chipset
Board believed to have VT-d disabled in Bios by Intel
Board ECC (unbuffered) memory or non-ECC memory
One nic supported by ESXi for management network.
One nic supported within ESXi for networking.

Intel S1200BTL ATX board
Can take up to 32GB ram with Kingston KVR1333D3E9S/8G sticks.
Intel C204 chipset
ESXi Certified
VT-d supported
One nic supported by ESXi for management network.
One nic supported within ESXi for networking.
Supermicro
Supermicro X9SCi-LN4F
Can take up to 32GB ram with Kingston KVR1333D3E9S/8G sticks.
Intel C204 chipset
VT-d supported
Four nics supported by ESXi for management network.

Supermicro X9SCM-F
Can take up to 32GB ram with Kingston KVR1333D3E9S/8G sticks.
Intel C204 chipset
VT-d supported
One nic supported by ESXi for management network.
One nic supported within ESXi for networking.

Chipsets
Intel
C202 - Entry server, motherboards usually have separate video built-in, processors without onchip video recommended.
C204 - Entry server, motherboards usually have separate video built-in, processors without onchip video recommended.
C206 - Entry workstation, recommend processors with onchip video or add-on video card.

Q67/Z68 - VT-d support possible but check manufacturers specs to confirm it is enabled in Bios.
Note: I am in no way against AMD processors or boards but have no experience with them and ESXi. If someone has the infor on good boards, processors or combos then please post away.
 
I am in the process of building my own ESX server at home and I have spec'ed the following

Intel DQ67SW
Intel i5 2500
Intel ET Dual Port NIC
16GB Crucial RAM
 
Running ESXi5 here, 4 hosts each with 64GB ram and 2 CPUs. Took us from 2 full racks of servers to just 6 physical servers in use on our whole network, even one of those is only used as a nexenta server to enable an old SCSI based SAN to be seen via iSCSI.

I love vmware, fantastic product, hopefully going to try and get a VCP cert in the future too.
 
[RXP]Andy;21981233 said:
I am in the process of building my own ESX server at home and I have spec'ed the following

Intel DQ67SW
Intel i5 2500
Intel ET Dual Port NIC
16GB Crucial RAM

I have a similar setup but went for the Intel Xeon 1230 - less over head, no inbuilt graphics though so you will require a PCI-E graphics card spare.

Less power usage though.
 
[RXP]Andy;21981766 said:
I thought the DQ67SW has inbuilt graphics, but it requires a CPU with built in Intel HD graphics which the i5 2500 does.

DQ67SW - Tech Specs

i5 2500 - Tech Specs

The DQ67SW has no graphics, hence why you require a chip with graphics to use it - you are correct, the i5 2500 does - but that wasn't the point of my post.

Also makes the AMT tool not work so you can't use IP KVM.
 
I have a similar setup but went for the Intel Xeon 1230 - less over head, no inbuilt graphics though so you will require a PCI-E graphics card spare.

Less power usage though.

Nice to know the E3s work on the Q67 boards. Any particular reason you didn't go for a E3-1235 Xeon though with inbuilt graphics (P3000) and keep the PCI-e free ?.

RB
 
[RXP]Andy;21981766 said:
I thought the DQ67SW has inbuilt graphics, but it requires a CPU with built in Intel HD graphics which the i5 2500 does.

DQ67SW - Tech Specs

i5 2500 - Tech Specs

Should work fine as I have been running a DQ67Ep with a i5-2400 until recently. Needed to add an Intel CT nic though as the 82579LMchipset is not supported out of the box with ESXi for the management network although you can use it from inside ESXi for passthrough or standard networking. Alternatively you could patch the drivers but when I followed the on-line instructions it either didn't work or was pretty unstable. The Intel ET dual port is great. I had one running and it was very good and passthrough worked like a charm.

RB
 
The DQ67SW has no graphics, hence why you require a chip with graphics to use it - you are correct, the i5 2500 does - but that wasn't the point of my post.

Also makes the AMT tool not work so you can't use IP KVM.

Don't talk to me about AMT :D. I still cant get it installed on my Win 7 home premium machine as it keeps telling me I am not an administrator (my account has administration rights). The server sits behind me so I haven't bothered to give the Intel support contact a call to sort it out.

RB
 
Nice to know the E3s work on the Q67 boards. Any particular reason you didn't go for a E3-1235 Xeon though with inbuilt graphics (P3000) and keep the PCI-e free ?.

RB

I only used the PCI-E graphics card for installation, then removed it.

I was already way over budget by buying the 1230 E3 in the first instance, as I was initially spec'ing an i5 2300 - lol.


Don't talk to me about AMT :D. I still cant get it installed on my Win 7 home premium machine as it keeps telling me I am not an administrator (my account has administration rights). The server sits behind me so I haven't bothered to give the Intel support contact a call to sort it out.

RB
It's pretty simple. I used VNC Viewer Plus+ - just ensure TLS encryption is turned off and you have set an IP in the AMT settings in the BIOS.
 
I only used the PCI-E graphics card for installation, then removed it.

I was already way over budget by buying the 1230 E3 in the first instance, as I was initially spec'ing an i5 2300 - lol.

Fair enough :D. My home build is a tad over budget as well. Probably getting 2x8GB ECC mem sticks was a bit cheeky ;).

It's pretty simple. I used VNC Viewer Plus+ - just ensure TLS encryption is turned off and you have set an IP in the AMT settings in the BIOS.

I will give that a go. Trying to install Intels software that came with the BTL board and it fails at the precheck and there is no way around it as far as I have found. Thanks

RB
 
Fair enough :D. My home build is a tad over budget as well. Probably getting 2x8GB ECC mem sticks was a bit cheeky ;).



I will give that a go. Trying to install Intels software that came with the BTL board and it fails at the precheck and there is no way around it as far as I have found. Thanks

RB

Only downside is the DQ67SW doesn't support ECC - which is a shame because that would add another 10% or so resiliency to my ZFS file share which does all its checking in memory.
 
Finally an ESXi thread! Anyone got any recommendations for a mini ITX server running ESXi?

Eyeing up the Fractal Design R3 or R2 line case to fit a mini-ITX board. I need one for an office to host a DC/Exchange/File Server/print server & whatever else I can squeeze on to it! Need something that has low consumption, maybe an E3/i3 with about 12+ GB RAM, won't serve more than 20 users max but may need room for expansion. Probably will use an LSI/Dell Perc RAID card and use the 6 3.5" drive bays in it for RAID 10 storage!

The Intel S1200KP board really appealed to me until I found out VT-d was disabled! Would like to passthrough a RAID card so I can manage it from one of the VM's in case it goes **** up!

I'm planning a similar set up for home so if this is too overkill for a home server I'd like another recommendation if anyone can help me out. I currently have an Adaptec 5405 RAID card + storage that I'd like to move to a more powerful home server which is currently in a HP MicroServer (which I'd like to keep as a home lab) which runs ESXi. So if the server for the office isn't too overkill (keeping in mind power consumption and house bills, etc!) I'd be happy for the same spec.
Oh and I would need the spec to be supported by ESXi's HCL!
Appreciate any help!
 
Last edited:
I built an AMD X2 mini itx ESXi server, main issue you will have is NIC compatability, I just threw an Intel card in there in the end to save the hassle.
 
Eyeing up the Fractal Design R3 or R2 line case to fit a mini-ITX board. I need one for an office to host a DC/Exchange/File Server/print server & whatever else I can squeeze on to it!
You're going to put a businesses essential servers onto a single, non-enterprise grade PC with a single internal storage solution? Sounds like you're just asking for trouble! One point of failure will potentially take out the lot.

Two ESXi hosts with two low cost iSCSI storage solutions and vSphere Essentials Plus licencing and vCenter Server would be a far better solution. Essentials plus allows up to 3 hosts, but more importantly includes all the 'good bits' of vSphere which will at least afford you some failover/high availability and backup: vMotion (not storage vMotion though unfortunately), HA, DRS and Data Recover which when combined with a tape drive is a decent enough backup solution for a small environment.
 
Last edited:
Back
Top Bottom