Supplemental Data – for vSphere Install Configure Manage Class
This page is intended to be a single source for data to supplement the material covered in the VMware vSphere Install Configure Manage class. It is based mostly on Frequently Asked Questions from students, who attend this class. It provides details and URLs on items that are not covered in detail in the class, but are necessary for an IT professional to be successful in implementing and supporting vSphere.
vSphere Editions and Licenses
- Comparison of Edititions: http://www.vmware.com/products/vsphere/buy/editions_comparison.html
- Licenses for vSphere: http://www.vmware.com/vmwarestore/vsphere_purchaseoptions.html
- Whitepaper on vSphere pricing and packaging, including an explation of the new vRAM entitlement http://www.vmware.com/files/pdf/vsphere_pricing.pdf
Paravirtualization vs Full Virtualization vs Hardware Assist
http://www.vmware.com/files/pdf/VMware_paravirtualization.pdf
Differences in ESX and ESXi
- In vSphere 5, the traditional ESX host no longer exists. The only host option is ESXi.
- Here is a good starting point to prepare your move from ESX to ESXi: http://www.vmware.com/products/vsphere/esxi-and-esx/upgrade.html?source=web&cd=1&sqi=2&ved=0CBwQFjAA&url=http://www.vmware.com/go/UpgradeToESXi&rct=j&q=migrating%20esx%20to%20esxi&ei=9lNzToPcNKHb0QHvrZTgDQ&usg=AFQjCNF_LqK0PvE2_1I_x7s0qqc8lQB8iA
- Detailed Comparison; http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1006543
Upgrading from vSphere 4 to vSphere 5
- vSphere 5 Release Notes: http://www.vmware.com/support/vsphere5/doc/vsphere-esx-vcenter-server-50-release-notes.html
- Upgrade Center: http://www.vmware.com/products/vsphere/upgrade-center/upgrade.html
- Best Practices: http://www.vmware.com/files/pdf/techpaper/vSphere-5-Upgrade-Best-Practices-Guide.pdf?utm_source=Notes+from+VMware&utm_campaign=36f5b4d85e-Notes_from_VMware_January_28_2012&utm_medium=email
- Upgrade to vSphere 5.5 Sequence
Distributed Virtual Switches (dvSwitches)
These are only briefly discussed in the vSphere ICM class. Here is a video on dvSwitches (drill to the Videos section in the middle of the page and choose the video on Networking Distributed Switch ). And here is a webpage providing an overview and details on dvSwithces.
Choices for virtual Ethernet Adpapters:
new choice in vSphere 5 = e1000e:
Time Synchronization Strategies
Virtual machines tend to lose track of time, unless they are configured to synchronize to a good time source. VMware Tools may be use to synchronize a VM’s guest O/S to the time on the ESXi host, or a more traditional method, such as the Windows time service may be used to synchronize with an Active Directory domain controller. VMware has published Time Keeping Best Practices for virtual machines and details for Time Keeping in Virtual Machines
Beacon Probing
NetApp: Comparison of FC, iSCSI, and NFS at various bandwidths
This document provides the results of tests performed by NetApp on NetApp storage using FC, iSCSI, and NFS access. The goals of the test was not to measure maximum performance, but instead to measure performance under low, medium, and high workloads. The results indicate:
- vSphere 4 natively provides great improvement over VMware Infrastructure 3 for iSCSI and NFS performance
- iSCSI and NFS performance is now within 5% of FC performance
- all three options are viable for productions workloads
Test results – http://media.netapp.com/documents/tr-3808.pdf
Storage Protocol Comparisons (VMware Blog)
iSCSI Considerations – a multi-vendor collaboration
Here is a link to good whitepaper on configuring iSCSI written as a collaboration from multiple vendors: http://virtualgeek.typepad.com/virtual_geek/2009/09/a-multivendor-post-on-using-iscsi-with-vmware-vsphere.html
iSCSI – port binding
Here is a simple illustration of utilizing multiple vkernel ports on the same virtual switch, but separate virtual port groups, and port binding to distribute I/O manually across multiple paths: http://goingvirtual.wordpress.com/2009/07/17/vsphere-4-0-with-software-iscsi-and-2-paths/
NFS Considerations – a multi-vendor collaboration
vSphere Storage Concepts and Troubleshooting
Here is some really good information on understanding how to analyze and troubleshoot Storage performance issues in vSphere.:
- http://blogs.vmware.com/vsphere/2012/05/troubleshooting-storage-performance-in-vsphere-part-1-the-basics-.html?utm_source=Notes+from+VMware&utm_campaign=86c74b94f4-Notes_from_VMware_June_17_2012&utm_medium=email
- http://blogs.vmware.com/vsphere/2012/06/troubleshooting-storage-performance-in-vsphere-part-2.html
- http://blogs.vmware.com/vsphere/2012/06/troubleshooting-storage-performance-in-vsphere-part-3-ssd-performance.html
Changed Block Tracking
Some vSphere features rely on Changed Block Tracking, which is a vmkernel feature introduced with vSphere 4.0
VMFS Track Alignment
Improper alignment of a VMFS partition can certainly result in poor performance of applications. Typically, using the vSphere Client to create VMFS datastores result in proper alignment, but this may not always be the case. Here is a document that discusses the impact and the steps to ensure proper alignment; http://www.vmware.com/resources/techresources/608 and http://www.vmware.com/pdf/esx3_partition_align.pdf.
Guest O/S Track Alignment: Likewise, the guest operating system’s file system should also be properly aligned to ensure the best performance. Typically, this rule should only be applied to the non-system disks. For example, when adding a second disk to a Windows server that is intended to be used to install application software, the following Diskpart commands could be used:
Diskpart
list disk
select disk 1
create partition primary align=1024
assign letter=E
format fs=ntfs unit=64K label=”Applications” nowait
In this example, the disk to be partitioned is Disk 1 (the first disk is Disk 0), its beginning partition is offset at 1024 KB, its drive letter is E:, and unit of allocation is 64K.
Here is a good reference: http://msdn.microsoft.com/en-us/library/dd758814(v=sql.100).aspx
VMFS and SCSI Reservations
Certain activities within a VMFS datastore may result in using SCSI Reservations to temporarily lock the underlying LUN and impacting other hosts sharing the datastore. Here is a reference: http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1005009
Expart
Here is information about a free tool from Dell that easily extend the size of partitions within Windows 2003 servers, including VMs:
http://www.vmwareinfo.com/2009/12/dell-extpartexe-extend-volumes-easily.html
This is the same tool that is currently used in VMware certification course labs.
Virtual Disk options for VMs in vSphere:
ESX servers use monolithic v-disk files (vmdk files) that are pre-allocated to the configured size. These files do Not grow. Having said that, templates can be stored in various formats and other Vmware products allow additional formats. Here are the options:
- Thick – Single file, preallocated to max size.
- Zeroredthick – single file, prealloacted to max size, but not zeroed out at creation. Instead the VM will zero out any existing data in the virtual disk later.
- Eagezeroredthick – single file, prealloacted to max size, and zeroed out at creation, which takes longer than zeroedthick. – NOTE: this is required for VMs protected by VMware Fault Tolerence
- Thin – not preallocated, instead the file is expanded and zeroed out on demand later.
- 2gbsparse – split into multiple files of 2G or less, compatible with other VMware platforms. This is required and provided by default for NFS storage.
Reclaiming (Shrinking) Thin-Provisioned Virtual Disks
Thin provision virtual disks do not automatically shrink the virtual disk files whenever files in the virtual disk are deleted. Here is a link that provides a manual method for shrinking the disk: http://www.virtualizationteam.com/virtualization-vmware/vsphere-virtualization-vmware/vmware-esx-4-reclaiming-thin-provisioned-disk-unused-space.html
Storage VMotion – Raw Device Mappings (RDM)
Storage VMotion can now be used to migrate data from a raw device mapping in virtual compatibility mode to a VMDK file. To do this, choose the Advanced option in the Migration Wizard, choose a VMFS datastore to migrate the raw device, and choose one of the Thick or Thin options for the type. Additionally, the selected target VMFS must not be the same VMFS as where the rdm.vmdk file (the raw device metadata file) currently resides. For details, see this knowledge base article.
vCenter Converter Standalone
the standalone version has more features than the Server component used in class. For example, it provides options to automatically shutdown the source server, re-synchronize final data changes, and boot up the new VM.
User Guide: http://www.vmware.com/pdf/convsa_50_guide.pdf
Hardware Health Monitoring / CIM
http://www.vmware.com/files/pdf/techpaper/hwhm41_technote.pdf
NUMA Considerations
Many newer CPUs use NUMA architecture. Here is good document concerning NUMA and large VM configurations:
http://frankdenneman.nl/2010/02/sizing-vms-and-numa-nodes/
Memory Management in vSphere
ESX Server provides a Ballooning Mechanism to borrow RAM from a rich VM and give to a poor VM. Here is a link to a good, detailed article that includes an explanation of ballooning and other memory related information.
http://www.vmware.com/files/pdf/mem_mgmt_perf_vsphere5.pdf
Memory compression – New Feature in vSphere 4.1
The vmkernel now looks to compress memory in a memory compression cache within the VM. This step exists just prior to vm swapping step:
- Memory compression summary: http://www.gabesvirtualworld.com/memory-management-and-compression-in-vsphere-4-1/
- Memory compression whitepaper: http://www.vmware.com/files/pdf/techpaper/vsp_41_perf_memory_mgmt.pdf
vCenter Linked Mode:
- Explanation of ADAM: http://www.microsoft.com/windowsserver2003/adam/default.mspx
- vCenter Linked Mode best practices: : http://viops.vmware.com/home/docs/DOC-1521
Using P2V (VMware Converter) on Domain Controllers
Typically, I prefer Not to P2V domain controllers, but instead use dcpromo in a Windows VM, then decommission old physical domain controllers. Here are links with details on the challenges and options for performing P2V Migrations of domain controllers
http://vknowledge.wordpress.com/2010/11/03/how-to-p2v-a-domain-controller/
http://michael.requeny.com/2011/03/07/p2v-domain-controllers-in-depth/
VMware High Availability and Fault Tolerance
VMware vSphere HA has been rebuilt from the ground up by VMware in version 5. Originally, it was simply a modified version of Legato AAM and it have several annoying elements. But, now that it has been re-architected it should be much more resilient and flexible than in previous version. For example, restarting HA for the entire cluster should only take a minute or so. And, since it uses a single master approach, it is no longer limited to supporting a maximum of 4 concurrent host failures. The vSphere Availability Guide contains details.
Here is a good Fault Tolerance White Paper.
Tags
They vSphere Web Client can be used to define and assign tags to objects in vCenter. It allows the user to filter and search based on tag values. The first step to create a new tag is to create a Category and set the Cardinality (number of tags in the category that can be assigned to a specific object). See this video on object tagging.
VMWare Data Recovery
Document with information for configuring and supporting VDR: http://www.google.com/url?sa=t&source=web&ct=res&cd=10&ved=0CCcQFjAJ&url=http%3A%2F%2Fmyvirtualcloud.net%2F%3Fp%3D88&rct=j&q=vmware+data+recovery+troubleshooting&ei=K7nFS6XjGJXy9ASLlJipDg&usg=AFQjCNEviFJpnJMgAZz5bUo2ai754ksGpQ
VMotion – Under the Covers
What really happens during a VMotion migration? You will likely see that the following links provide more detail than the descriptions provided in the course materials:
- http://blogs.vmware.com/uptime/2011/02/vmotion-whats-going-on-under-the-covers.html
- http://www.vmware.com/files/pdf/vmotion-perf-vsphere5.pdf
- http://www.vmware.com/pdf/usenix_vmotion.pdf
VMotion CPU Compatibility
Here is a good link for CPU Compatibility for VMotion:
Commands and scripting
VMware created a set of commands for the ESXi command shell. The legacy commands begin with the string “esxcfg-“, such as esxcfg-nics and esxcfg-vswitch. Today, VMware provides a single command for almost all purposes. The command is esxcli, which involves a complex set of arguments. VMware prefers that such commands are run remotely using the vSphere Command Line Interface (vCLI), which can be installed on an administrator’s desktop (Windows or Linux), or can be run within a deployed VMware vSphere Management Assistant (vMA) virtual appliance. Here is some information to get started:
- Getting Started Guide: http://tinyurl.com/8tedsoh
- Concepts and Examples: http://tinyurl.com/9q7olb3
PowerCLI
Several automation tools are available to function with vSphere. The most powerful tool is probably the PowerCLI. Generally, if any vCenter task requires automation beyond what the vSphere client provides or if the client does not adequately provide a desired function, the first place to turn to may be PowerCLI. It provides a command set that allows the creation of scripts to call operations to be run in vCenter and the ESX servers.
- PowerShell Installation Guide: http://tinyurl.com/9suwbvo
- Blog and download for PowerCLI: http://blogs.vmware.com/vipowershell/
- Sample PowerCLI scripts: http://waynes-world-it.blogspot.com/2009/08/vmware-vsphere-powercli-commands.html
- Running PowerCLI scripts automatically from Actions on triggered alarms: http://blogs.vmware.com/vipowershell/2009/09/how-to-run-powercli-scripts-from-vcenter-alarms.html
Image Builder
In order implement custom device drivers, plug-ins, and other extensions, the VMware Image Builder can be utilized to merge these items with the standard VMware ESXi installation files into a single ISO file. Here is a decent article to explain the process.
Visio Stencils
Here is a decent resource for downloading vSphere Stencils for vSphere: http://communities.vmware.com/docs/DOC-11498
vSphere Orchestrator
This product is mentioned in the vSphere ICM class, but no real details are provided. It is intended to provide a means to interface vSphere with other VMware and 3rd party products, allowing automation. To gain familiarity, begin by reviewing the Overview and documentation found at this link: http://www.vmware.com/products/vcenter-orchestrator/overview.html
good blogs, websites, etc. focused on virtualization
- http://vloreblog.com
- VMware Launch Pad: http://vlp.vmware-land.com/
- Xtravirt: http://xtravirt.com/
- Vm4all: http://www.vm4all.com/
- Yellowbricks: http://www.yellow-bricks.com/
- RTFM: http://www.rtfm-ed.co.uk/
- Virtualization Information: http://virtualizationinformation.com/
Recommended books:
- Mastering VMware vSphere 5 – by Scott Lowe: http://tinyurl.com/99gmorq
- Official VCP5 Certification Guide: by Bill Ferguson
Recommended Reading from VMware:
These are good guides from VMware to read to reinforce the material covered in class. These PDF files can be found at the VMware vSphere 5 Documentation Center: http://pubs.vmware.com/vsphere-50/index.jsp
- vSphere Installation and Setup guide
- vSphere vCenter Server and Host Management
- vSphere Networking
- vSphere Storage
- vSphere Resource Management
Preparing a vSphere Lab to Gain Hands-on Experience and Prepare for VCP Exam
For students, who need a lab to gain more hands-on experience with vSphere, here is some information that may be useful for implementing vSphere within VMs on a desktop. One key is to implement a Virtual Storage appliance and another is to install ESXi in VMs
Virtual storage products
This link provides a list of vm-based storage products that may be useful for proof of concept labs, where shared storage is required, but a real SAN does not exist:
http://vmsupergenius.com/free-storage-for-your-lab/
How to install ESXi in a VM on vSphere 5
http://www.vcritical.com/2011/07/vmware-vsphere-can-virtualize-itself/
AutoLab
Here is a tool that may simplify deploying a nested vSphere infrastructure (running ESXi in VMs) in a lab environment for those wanting to practice for VCP or gain familiaraity.
Great info and interestingly written. Keep up the excellent stuff!
thanks for such a great post and the review, i am totally impressed! lista de email lista de email lista de email lista de email lista de email
Hello! This is my 1st comment here so I just wanted to give a quick shout out
and tell you I really enjoy reading through your posts.
Can you suggest any other blogs/websites/forums that deal with the same topics?
Appreciate it!
yeah, here are some good links
VMware Launch Pad: http://vlp.vmware-land.com/
Xtravirt: http://xtravirt.com/
Vm4all: http://www.vm4all.com/
Yellowbricks: http://www.yellow-bricks.com/
RTFM: http://www.rtfm-ed.co.uk/
Virtualization Information: http://virtualizationinformation.com/