NFS based storage is gaining a strong following in VMware environments. NFS has a lot of big pluses for storage of VMDKs especially in environments that lack the money or expertise for a full fiber channel SAN but still want to leverage some great ESX features like vMotion and High Availability.
In the NAS arena, there are two broad categories of vendors
1. The Giants – This is EMC, NetApp, and IBM. Prices are high but level of features, functionality, availability and support are also great.
2. Everyone Else – These could be your traditional servers running an operating system that you probably already know, e.g. Windows or Linux. Price is fairly low and feature set is pretty broad. Or these could be dedicated NAS boxes. Very cheap with questionable performance. Drobo and Overland are good examples.
Many SMBs simply can’t afford the complexity and cost that are associated with “The Giants”
One fairly cheap and easy to understand NAS solution for SMBs is to simply buy a standard server, e.g. Dell, HP, Super Micro, install your OS of choice, and then finally export your NFS mount points.
Analyzing the features of the different OS 's is fairly straightforward and can be done simply by reviewing the online documentation and datasheets.
I wanted to understand if any of the operating systems performed better with NFS workloads. As a side note I was also curious if Windows 2008 would outperform a typical Linux distribution.
I've been spending my spare time over the last few days setting up the lab for testing. I've run into my first roadblock which was actually suprising. The first interation of my NAS server is Windows 2008 R2 running on a HP ML570 G4. I've exported an NFS mount and created a datastore on my ESX host. From there I could easily create VMDKs for my VMs on the NFS Storage. Here is a good article on setting up a Windows 2008 server for NFS and ESX http://ross-family.org/blog/2009/07/08/how-to-use-windows-2008-to-host-storage-for-esx/
What surprised me was how well Windows 2008 performed in the first round of tests. By doing simple file copies in and out of the VMDK I was able to saturate the GigE link on the NAS box. See screenshot below. Given the number of people online complaining about slow NFS performance in Windows, I was happily surprised by the results. I think if given the choice most SMBs would choose Windows over Linux for their server OS simple because it's an OS most SMBs are familar with. Let's see if future tests confirm these initial good performance numbers.

I am going to upgrade the link to 10Gig-E. Bonding the two NICs together into a single channel would not improve performance. Traffic is being generated for my test from a single ESX Host and hence all that traffic would go over a single 1Gig-E link. I could setup another ESX Host and test both simultaneously, but going to 10Gig-E, since it is available to me, is much easier.