I got my current job because I could lead the hyper-v to VMware migration project. Just this year I led the VMware to hyper-v migration project. VMware was such a great product (although a bit cumbersome in the VCF environment I managed). It’s really unfortunate it went the way of Broadcom. In comparison Hyper-v feels like a typical Microsoft product. A bunch of different tools created by different teams to do tasks that feel bolted on and afterthoughts. I have to run FCM to manage the nodes? But I run HVM to manage the roles? But there’s no overall resource management like VMware vsphere or proxmox does natively?

I’ve quietly built a proxmox cluster in our environment for semi-prod workloads for when the inevitable windows host has issues.

Corporate IT is kind of a parallel universe to me, so it is interesting to see how widely used these products are and how impactful these types of events are.

There are a few broad categories to building one of these platforms.. core virtualization ("relatively easy"), device model ("medium hard"), storage management ("hard"), management plane ("medium hard").

VMWare popularized x86 core virtualization and defined their own device model because they were the early market leader. But the device model is pretty bizarre and I haven't been particularly impressed by the guest driver quality over the years. VMFS and vSAN seem good for storage, the latter being better than anything open source. Management plane was mediocre, I remember it took a while to move off Flash and fat clients while cloud vendors were showing none of that was necessary from inception, and everything is kind of in a walled garden by design (embedded DB etc).

I had a lot of positive experiences with VMware (ESXi + vCenter). Every time I had a new project, I tried to keep it as simple as possible and it worked wonderfully. SAN, Distributed Switches, Automatic VM migrations to balance CPU usage etc.

VSAN was a weird one until I understood the logic behind it, but the licensing costs kind of brought on-par to buying a SAN and be happy.

I haven't touched Microsoft Hyper-V.

I actually had so many troubles with vmware on windows over the years that once I tried out hyper-v for the first time last year, I somehow have never touched vmware again. Sure vmware has better configs, cleaner interface and some very subtle design advantages. But damn, hyper-v just fucking works and it keeps working across updates. I have a VM that has been running for a year and it is still perfectly doing exactly what it should. I never experienced that with vmware.

> I actually had so many troubles with vmware on windows...

I assume this means that you were using Vmware Workstation? The VDDK is for Vmware vSphere, which -IIRC- runs on Linux and coordinates computers running ESXi, which are where vSphere VMs actually run.

Not that many people are going to be using Vmware Workstation to run a large number of VMs.

I remember reading some obscure customer doco that "The old fax server is running on the virtual host"

And I was like... what virtual host?

What I found was Server 2003 running on VMWare Workstation, running on a Windows 7 Dell PC sitting at the bottom of a rack.

A lot of people think VMWare Workstation is the pinnacle product of the company and I have NFI how this came to be.

I think you're conflating different requirements/usecases.

Sure, a type-1 hypervisor like vSphere is technically better since there's no host OS creating unmanageable contention and if you have guests with higher performance requirements then yeah it's settling for something half-assed.

But in reality, we have some similar shit to a "fax server" that has manually set up weird manufacturer printer settings (local admins tried to be automated/distributed) and old third-party software libraries that "infects" a system globally (2 versions of that library cannot co-exist on a computer).

If that piece of crap can be contained on a VM, as long as it's contained and keeps trucking after a restart/powercycle everyone is happy. What kind of VM container hosts it is really secondary.

(What the software in question is can probably be inferred from the comment, the software is liked by users at the client so it's not going away)

Does your company have a ton of thick-client apps? I feel like so many workloads are on the web right now and thick clients are slowly becoming a thing of the past - but maybe in Enterprise there are still stubborn thick client Win32 apps that are mission critical.

If I were starting a company today I would make sure that the majority of my apps were web based. (CRM[netsuite or sf.com], O365/GoogleDocs, workday|gusto, etc.)

Most high-security environments (banks, govt agencies etc) have a large on-prem footprint. Then there's specialised industries like manufacturing, science and engineering who typically have a bunch of embedded systems, often running ancient versions of Windows or something that needs to talk to a local ancient server. And many old companies have tons of legacy apps which are a PITA to migrate to newer infrastructure. So yeah, plenty of folks out there using omprem gear, it's kinda the reason why Broadcom is able to what it's doing - lots of suckers out there who're married yo vmware and can't get a divorce.

Reminds me of setting up VMware Workstation with USB ISA cards to keep a line running. Ugh

I've lead roughly $20M in cloud migration projects in the last two years away from vmware to cloud services as replacements. Just insane what MBAs are willing to do to a product to squeeze short term profits. Even more insane that this country largely sees these people as a benefit to society and not the vultures they are.

Engineer with an MBA here.

I don't think anyone finds this flavor of activity beneficial. What's beneficial is the underlying system that is sufficiently free and flexible that great things (like VMware to begin with) are possible. As much as we don't like "this" we don't want to put any bureaucrats in power to squash creativity and enterprise.

Much like freedom of speech means someone can speak abhorrently, freedom of enterprise means someone can do bad or dumb business things. But we enjoy the thing in totality.

> As much as we don't like "this" we don't want to put any bureaucrats in power to squash creativity and enterprise.

That was literally Broadcom’s reason for existing before Avago even acquired them. It’s the other half of the Qualcomm/Broadcom telecom duopoly.

The cloud see them as a benefit, that’s for sure. They are frothing at the mouth for the customers to migrate their workloads.

The magic that is opex compared to capex. I'm sure it makes sense to some bean counter somewhere in the company, but for us who manage the resources it's always a loss.

I think that it boils down to that opex is considered speedy, flexible and agile. Whereas capex reflects slow/glacial but also stable. This is also why lease exists, why we have freelance contracts vs employee contracts for indeterminate amounts of time.

> Just insane what MBAs are willing to do to a product to squeeze short term profits. Even more insane that this country largely sees these people as a benefit to society and not the vultures they are.

I do understand the argument that it can be considered as a benefit for society if companies that have a very incompetent management that falls for this kind of trap of getting locked in by some vendor without having an emergency escape plan available get milked or even get bust. :-)

Well, it's not actually a trap, since it's not the management who pays the price - it is investors, employees and the society at large that do, while the MBAs have already moved on to their next victim.

Problem with incentives, I would say.

When the country is run by vultures, they celebrate the discovery of new successful ways to vult.

> quietly built a proxmox cluster

Why is your place of work not moving wholesale to Proxmox? It's mad that HyperV is chosen as a solution in this day and age.

Because it is made of a lot of open source components glued together in different weird ways. Sure, I would trust KVM over Hyper-V any day, but the management sucks for Proxmox.

If they build their new Datacenter Manager offering into what vCenter offered and abstract away all the ugliness (imagine creating a "distributed" switch on Proxmox with two clicks) I think they will make a killing.

Proxmox is amateur hour. No enterprise support

> Proxmox is amateur hour. No enterprise support

24/7 support will be available starting in October:

* https://www.proxmox.com/en/about/company-details/press-relea...

The other thing perhaps worth noting that the entire stack is open source, even Proxmox's 'special sauce' for management. Depending on your organization, if you can solve a problem with Debian (and Qemu) you can solve a problem with Proxmox.

If you can solve a problem with Debian and Qemu Proxmox gives you nothing.

Better to just use same automation you use for VMs to just keep fleet of bare Debian + KVM machines.

Proxmox is for when you don't have a bunch of Linux experts on board. And that's also kinda what enterprises want to pay for, removing "liability" of having to keep very competent team.

...the fact that ends up costing them more everywhere is of no concern to middle management

Legal/Compliance/Risk department along the lines of “ nobody ever got fired for buying ibm”