Using my server as a desktop also when running ESXi 5.x?

These days I’m looking to get rid of my desktop pc tower and just go and build a custom server. Problem with that is the “experts” I’ve spoken too don’t really know how to answer my question. So, I was thinking that hopefully, maybe by chance, posting my question in this forum would help me get an answer!

My server configuration would be something like this:
- Supports 2x Intel Xeon V3 CPU’s.
- Supports least 30TB of SATA/SAS hot-swap 3.5” hard drive space that holds at least 4 HD’s.
- Supports at least 1TB of RAM (4GB/8GB/16GB/32GB/64GB).
- Have at least 1 PCIx x16 slot.
- Have at least 2 PCIx x8 or x4 slots.
- Be a 1U or 2U server case.
- PSU around 700-1000w.
- Have room for a slim (laptop style) Blu-ray burner drive.

Now here comes the question that has stumped many:

Since I am doing away with my desktop, I will need the server to act as a desktop replacement. However, I am needing the server to run the following:
- At least 4 x 2012 R2 OS VM servers.
- Each VM running 2-4GB RAM.
- Each VM using on-board graphics.
- Each VM sharing the (if 4 HD slot’s) 3 HD’s or sharing 7 HD’s if housing 8 HD slot’s. (The last HD in both scenarios would be for the desktop).
- All VM’s running ESXi 5.x.

Now since i'm wanting it to also act as a desktop I need to be able to use it as if I was a desktop. The question that’s stumping everyone is how can I do this when the server will be running ESXi for its base OS? How can I use the PCIx 16x graphics card for just my “desktop” version? If this is possible, will there be any lag from the server to my monitor via HDMI? I know I will need to run an HDMI and USB cable from the server room to the room where my desktop used to be – that’s no problem.

My “desktop” would be running Windows 8.1 x64 Pro with some type of 1/2GB GeForce Graphics card that supports HDMI 2.0 and somewhere around 16GB of RAM. I’m not a big gamer – I mainly just do web design and desktop programming. I’ve been looking at the Dell PowerEdge R730 Rack Server and it seems like a good fit for what I am wanting to do. However, not knowing if I can do what I am asking in this email to you is the only reason stopping me from getting it.

Thank you for taking the time to read this,

David G.