Page History

...

This document provides instuctions for configuring a standalone VCL environment running on a single computer which is able to provision VCL reservations using VMware.   It is only provided to help you understand how the various components of VCL operate.   This document DOES NOT describe how to configure a production VCL environment.   The environment described in this document can however be used to learn, test, and help develop VCL.

Install VCL Components

Begin by completing the installation instructions for the VCL components:

...

Gather Required Files & Information

You will need the following:

• VMware Server 12.x RPM installation file
• VMWare VMware Server 12.x serial number

...

...

...

...

...

...

...

...

...

...

Configure the VCL Database for the VM Guest and Host 

• Create the following computer groups:
  Go to Manage Groups -> Resource Groups -> Add
  • all vm host computers
  • all vm guest computers

• Map all computer groups to management node group
  • Management Nodes -> Edit Management Node Mapping

• Configure the management node to check in with the database
  • Management Nodes -> Edit Management Node Information -> Add
    • Hostname: localhost
    • IP Address: 127.0.0.1
    • Owner: admin
    • State: available
    • Predictive Loading Module: Predictive Loading Level 0 Module
    • Check-in Interval: 5
    • Install Path: /install
    • End Node SSH Identitiy Key Files: /etc/vcl/vcl.key
    • SSH Port for this node: 22
    • Enable Image Library: no
• Add VM host computer:
  • Manage Computers -> Edit Computer Information -> Submit -> Add
    • Hosthame: localvmhost
    • IP Address: 192.168.0.1 (NOTE: there is currently a bug restricting the size of the field, so hopefully one octet has less than 3 digits.)
    • State: available
      Note: do not attempt to add the computer in the maintenance state because of the following issue:
      https://issues.apache.org/jira/browse/VCL-189
    • Owner: admin
    • Platform: i386
    • Schedule: VCL 24x7 
    • RAM: 1024
    • No Processors: 1
    • Processor Speed: 2000
    • Network Speed: 100 
    • Type: blade
    • Provisioning engine: xCAT 1.x
      Note: the Type and Provisioning engine values don't matter for the localvmhost computer in this test environment because vcld isn't provisioning it
    • Computer Groups: all vm host computers
• Add VM guest computer:
  • Manage Computers -> Edit Computer Information -> Submit -> Add
    • Hosthame: vmguest-1
    • IP Address: current public ip address used by Windows XP VM
    • State: available 
    • Owner: admin
    • Platform: i386
    • Schedule: VCL 24x7 
    • RAM: 1024
    • No Processors: 1
    • Processor Speed: 2000
    • Network Speed: 100 
    • Type: virtualmachine
    • Provisioning engine: VMWare Server Provisioning
    • Computer Groups: all vm guest computers
• Note the fix for the IP address bug is recorded here: https://issues.apache.org/jira/browse/VCL-193
• Configure the VM guest's MAC address in the computer table in the database (as there currently does not seem to be a way to do this through the UI):
  • eth0: 00:50:56:1a:01:01
  • eth1: 00:50:56:1a:01:02
• Configure the VM host profile:
  • Virtual Hosts -> VM Host Profiles tab -> VMware GSX standard -> configure Profile
    • Virtual Switch 0: VMnet1
    • Virtual Switch 1: VMnet0
• Change state of localvmhost to vmhostinuse (edit the database directly, do not use the Virtual Hosts utility on the website)
• Assign vm guests to localvmhost
• Create node in priviledge tree
  • Name: VM image access
  • Add resource groups:
    • all vm guest computers
    • all vm guest images

Remove Existing Virtualization Components

Make Sure The Host Computer Is Not Running A Xen Kernel

VMWare Server cannot be installed on a computer running a Xen kernel.  To determine if a Xen kernel is being used:

Install VMware Server

Download the latest VMware Server 1.x RPM from http://www.vmware.com
(Note: these instructions assume you saved the RPM into /install)

Install the VMware Server RPM:

• vmnet0 is bridged to eth1
• vmnet1 is a host-only network on private subnet 192.168.0.0

The following lists the sequence of answers to be entered after issuing the vmware-config.pl command:

1. Press ENTER to view the license agreement, scroll to the bottom, type yes and press ENTER

2. Wiki Markup
   In which directory do you want to install the mime type icons? \[/usr/share/icons\] *ENTER*

3. Wiki Markup
   What directory contains your desktop menu entry files? These files have a .desktop file extension. \[/usr/share/applications\] *ENTER*

4. Wiki Markup
   In which directory do you want to install the application's icon? \[/usr/share/pixmaps\] *ENTER*

5. Wiki Markup
   None of the pre-built vmmon modules for VMware Server is suitable for your running kernel.  Do you want this program to try to build the vmmon module for your system (you need to have a C compiler installed on your system)? \[yes\] *ENTER*

6. Wiki Markup
   What is the location of the directory of C header files that match your running kernel? \[/lib/modules/2.6.18-128.1.14.el5/build/include\] *ENTER*

7. Wiki Markup
   Do you want networking for your virtual machines? (yes/no/help) \[yes\] *ENTER*

8. Wiki Markup
   Your computer has multiple ethernet network interfaces available: eth0, eth1, virbr0. Which one do you want to bridge to vmnet0? \[eth0\] *eth1*

9. Wiki Markup
   Do you wish to configure another bridged network? (yes/no) \[no\] *ENTER*

10. Wiki Markup
    Do you want to be able to use NAT networking in your virtual machines? (yes/no) \[yes\] *no*

11. Wiki Markup
    Do you want to be able to use host-only networking in your virtual machines? \[no\] *yes*

12. Wiki Markup
    Do you want this program to probe for an unused private subnet? (yes/no/help) \[yes\] *no*

13. What will be the IP address of your host on the private
    network? 192.168.0.1
14. What will be the netmask of your private network? 255.255.0.0
15. DHCP information is displayed, press ENTER

16. Wiki Markup
    Do you wish to configure another host-only network? (yes/no) \[no\] *ENTER*

17. Wiki Markup
    The default port : 902 is not free. We have selected a suitable alternative port for VMware Server use. You may override this value now. Remember to use this port when connecting to this server. Please specify a port for remote console connections to use \[904\] *ENTER*

18. Wiki Markup
    In which directory do you want to keep your virtual machine files? \[/var/lib/vmware/Virtual Machines\] *ENTER*

19. Wiki Markup
    The path "/var/lib/vmware/Virtual Machines" does not exist currently. This program is going to create it, including needed parent directories. Is this what you want? \[yes\] *ENTER*

20. Please enter your 20-character serial number
    Type XXXXX-XXXXX-XXXXX-XXXXX or 'Enter' to cancel: enter the serial number

Verify the host-only network was configured correctly:

Starting VMware services:
   Virtual machine monitor                                  \[ OK \]
   Virtual ethernet                                         \[ OK \]
   Bridged networking on /dev/vmnet0                        \[ OK \]
   Host-only networking on /dev/vmnet1 (background) \[ OK \]
   Starting VMware virtual machines...                     \[ OK \]

Configure /etc/hosts

Modify the /etc/hosts file to include entries for the VM host and guest computers:

Configure the sshd Service to Listen on the Virtual Private Network 

Configure The VM Host To Be Able To SSH To Itself

Add the VM host's public key to its own authorized_keys file to allow it to SSH to itself without a password prompt: 

Configure vcld to use vcl.key

Configure the keys column in the managementnode table in the VCL database

• Edit the managementnode table in the database: set the keys column to /etc/vcl/vcl.key

Configure the vcld.conf file to use vcl.key:

Configure The DHCP Service 

Save a copy of the original dhcpd.conf file:

ddns-update-style none; shared-network vmnet1 {
         subnet 192.168.0.0 netmask 255.255.0.0 {
                 ignore unknown-clients;
                 option routers 192.168.0.1;
                 host vmguest-1 {
                         option host-name "vmguest-1";
                         hardware ethernet 00:50:56:1a:01:01;
                         fixed-address 192.168.1.1;
                         filename "/tftpboot/pxelinux.0";
                         option dhcp-server-identifier 192.168.0.1;
                         next-server 192.168.0.1;
                 }
          }
}

The DHCP daemon should only listen on the virtual private network (vmnet1) to avoid conflicts with other production VCL networks.  Configure the dhcpd service startup script to only listen on the vmnet1 interface:

start() {
 [ -x $dhcpd ] || return 5
 [ -f $conf ] || return 6
 pidofproc $prog >/dev/null 2>&1
 RETVAL=$?
 [ $RETVAL -eq 0 ] && return $RETVAL 
 echo -n $"Starting $prog: "
 daemon $dhcpd vmnet1 $DHCPDARGS 2>/dev/null
 RETVAL=$?
 echo
 [ $RETVAL = 0 ] && touch $lockfile
 return $RETVAL
}

Configure the dhcpd service to automatically start at runlevels 3-5:

...

Install VCL Components

Begin by completing the VCL 2.2.1 Installation instructions. Install all of the components on the same computer.

Remove Existing Virtualization Components

Make Sure The Host Computer Is Not Running A Xen Kernel

VMWare Server cannot be installed on a computer running a Xen kernel. To determine if a Xen kernel is being used:

The following output indicates a Xen kernel is being used:

If "xen" appears in the output of the previous command, replace the Xen kernel:

Check the grub.conf file to make sure it is not configured to boot using the Xen Kernel

The grub.conf file should NOT look like this:

After removing the Xen kernel, reboot the computer:

Install VMware Server

Download the latest VMware Server 2.0 RPM from http://www.vmware.com

Install VMware Server:

Configure VMware Server:

Answer the questions asked by vmware-config.pl as follows:

• Do you accept? (yes/no) yes
• Do you want networking for your virtual machines? (yes/no/help) yes
  • Configuring a bridged network for vmnet0. Please specify a name for this network. Bridged
  • Your computer has multiple ethernet network interfaces available: eth0, eth1. Which one do you want to bridge to vmnet0? eth0
    The following bridged networks have been defined:
    . vmnet0 is bridged to eth0
  • Do you wish to configure another bridged network? (yes/no) no
  • Do you want to be able to use NAT networking in your virtual machines? (yes/no) no
  • Do you want to be able to use host-only networking in your virtual machines? yes
  • Configuring a host-only network for vmnet1. Please specify a name for this network. HostOnly
  • Do you want this program to probe for an unused private subnet? (yes/no/help) no
  • What will be the IP address of your host on the private network? 192.168.0.1
  • What will be the netmask of your private network? 255.255.0.0
    The following host-only networks have been defined:
    . vmnet1 is a host-only network on private subnet 192.168.0.0.
  • Do you wish to configure another host-only network? (yes/no) no
• Please specify a port for remote connections to use: 902
• Please specify a port for standard http connections to use: 8222
• Please specify a port for secure http (https) connections to use: 8333
• The current administrative user for VMware Server  is ''.  Would you like to specify a different administrator? no
  Using root as the VMware Server administrator.
• In which directory do you want to keep your virtual machine files? /var/lib/vmware/Virtual Machines
• The path "/var/lib/vmware/Virtual Machines" does not exist currently. This program is going to create it, including needed parent directories. Is this what you want? yes
• Please enter your 20-character serial number. <Enter the serial number you received from VMware>
• In which directory do you want to install the VMware VIX API binary files? /usr/bin
• In which directory do you want to install the VMware VIX API library files? /usr/lib/vmware-vix/lib
• The path "/usr/lib/vmware-vix/lib" does not exist currently. This program is going to create it, including needed parent directories. Is this what you want? yes
• In which directory do you want to install the VMware VIX API document pages? /usr/share/doc/vmware-vix
• The path "/usr/share/doc/vmware-vix" does not exist currently. This program is going to create it, including needed parent directories. Is this what you want? yes

Verify the host-only network was configured correctly:

You should see a vmnet1 interface using IP address 192.168.0.1:

You should see the following:

Starting VMware services:
Virtual machine monitor \[<span style="color: #339966">OK</span> \]
Virtual ethernet \[<span style="color: #339966">OK</span> \]
Bridged networking on /dev/vmnet0 \[<span style="color: #339966">OK</span> \]
Host-only networking on /dev/vmnet1 (background) \[<span style="color: #339966">OK</span> \]
Starting VMware virtual machines... \[<span style="color: #339966">OK</span> \]

Fix VMware Server 2.0 glibc Problem

VMware Server 2.0 will not run reliably if the version of glibc installed on the host is newer than 2.5-34. This problem is known to affect recent versions of Red Hat Enterprise Linux and CentOS. If not corrected, VMware Server will crash intermittently and the VMware administration web pages will lock up or fail to load.

Check the version of glib installed on the VMware host:

You will need to configure VMware to use glibc 2.5-34 if the version installed on the host is newer than 2.5-34:

Installed Packages
glibc.i686       2.5-42      installed
glibc.x86_64     2.5-42      installed

For CentOS, you will need to download the glibc RPM included with CentOS 5.3. This is available from vault.centos.org:

• For 32-bit CentOS installations: http://vault.centos.org/5.3/updates/i386/RPMS/glibc-2.5-34.el5_3.1.i686.rpm
• For 64-bit CentOS installations: http://vault.centos.org/5.3/updates/x86_64/RPMS/glibc-2.5-34.el5_3.1.x86_64.rpm

Create a temp directory and cd to it:

Download the glibc RPM (change the URL accordingly):

Extract the cpio archive from the glibc RPM:

Create the following directory:

Copy the following file to the new directory:

Make a backup of the original vmware-hostd file:

Edit vmware-hostd:

Navigate to the bottom of the file. You should see the following as the last line:

eval exec "$DEBUG_CMD" "$binary" "$@"

Add the following export line immediately before the last eval line in vmware-hostd:

export LD_LIBRARY_PATH=/usr/lib/vmware/lib/libc.so.6:$LD_LIBRARY_PATH
eval exec "$DEBUG_CMD" "$binary" "$@"

The following sed command can also be used to add the line to vmware-hostd:

Restart the vmware service:

Configure /etc/hosts

Modify the /etc/hosts file to include entries for the VM host and guest computers:

Add the entries in bold:

Configure the sshd Service to Listen on the Virtual Private Network

Add the following line to the end of the file:

Restart the sshd service on the management node:

Configure The VM Host To Be Able To SSH To Itself

Add the VM host's public key to its own authorized_keys file to allow it to SSH to itself without a password prompt:

The following command should execute without having to enter a password:

Configure vcld to use vcl.key

Configure the keys column in the managementnode table in the VCL database

• Edit the managementnode table in the database: set the keys column to /etc/vcl/vcl.key

Configure the vcld.conf file to use vcl.key:

Modify all of the IDENTITY lines to specify the vcl.key file:

Configure The DHCP Service

Save a copy of the original dhcpd.conf file:

Configure the dhcpd.conf file:

The dhcpd.conf file should contain the following:

ddns-update-style none; shared-network vmnet1 {
subnet 192.168.0.0 netmask 255.255.0.0 {
ignore unknown-clients;
option routers 192.168.0.1;
host vmguest-1 { option host-name "vmguest-1"; hardware ethernet 00:50:56:1a:01:01; fixed-address 192.168.1.1; filename "/tftpboot/pxelinux.0"; option dhcp-server-identifier 192.168.0.1; next-server 192.168.0.1; }
}
}

The DHCP daemon should only listen on the virtual private network (vmnet1) to avoid conflicts with other production VCL networks. Configure the dhcpd service startup script to only listen on the vmnet1 interface:

Add vmnet1 the to the daemon $dhcpd line as shown:

start() {
\[ \-x $dhcpd \] \|\| return 5
\[ \-f $conf \] \|\| return 6
pidofproc $prog >/dev/null 2>&1
RETVAL=$?
\[ $RETVAL \-eq 0 \] && return $RETVAL
echo \-n $"Starting $prog: "
daemon $dhcpd vmnet1 $DHCPDARGS 2>/dev/null
RETVAL=$?
echo
\[ $RETVAL = 0 \] && touch $lockfile
return $RETVAL
}

Configure the dhcpd service to automatically start at runlevels 3-5:

Start the dhcpd service:

Configure the VCL Database for the VM Guest and Host

• Create the following computer groups:
  Go to Manage Groups -> Resource Groups -> Add
  • all vm host computers
  • all vm guest computers

• Map all computer groups to management node group
  • Management Nodes -> Edit Management Node Mapping

• Configure the management node to check in with the database
  • Management Nodes -> Edit Management Node Information -> Add
    • Hostname: localhost
    • IP Address: 127.0.0.1
    • Owner: admin
    • State: available
    • Predictive Loading Module: Predictive Loading Level 0 Module
    • Check-in Interval: 5
    • Install Path: /install
    • End Node SSH Identitiy Key Files: /etc/vcl/vcl.key
    • SSH Port for this node: 22
    • Enable Image Library: no
• Add VM host computer:
  • Manage Computers -> Edit Computer Information -> Submit -> Add
    • Hosthame: localvmhost
    • IP Address: 192.168.0.1 (NOTE: there is currently a bug restricting the size of the field, so hopefully one octet has less than 3 digits.)
    • State: available
      Note: do not attempt to add the computer in the maintenance state because of the following issue:
      https://issues.apache.org/jira/browse/VCL-189
    • Owner: admin
    • Platform: i386
    • Schedule: VCL 24x7
    • RAM: 1024
    • No Processors: 1
    • Processor Speed: 2000
    • Network Speed: 100
    • Type: blade
    • Provisioning engine: xCAT 1.x
      Note: the Type and Provisioning engine values don't matter for the localvmhost computer in this test environment because vcld isn't provisioning it
    • Computer Groups: all vm host computers
• Add VM guest computer:
  • Manage Computers -> Edit Computer Information -> Submit -> Add
    • Hosthame: vmguest-1
    • IP Address: current public ip address used by Windows XP VM
    • State: available
    • Owner: admin
    • Platform: i386
    • Schedule: VCL 24x7
    • RAM: 1024
    • No Processors: 1
    • Processor Speed: 2000
    • Network Speed: 100
    • Type: virtualmachine
    • Provisioning engine: VMWare Server Provisioning
    • Computer Groups: all vm guest computers
• Note the fix for the IP address bug is recorded here: https://issues.apache.org/jira/browse/VCL-193
• Configure the VM guest's MAC address in the computer table in the database (as there currently does not seem to be a way to do this through the UI):
  • eth0: 00:50:56:1a:01:01
  • eth1: 00:50:56:1a:01:02
• Configure the VM host profile:
  • Virtual Hosts -> VM Host Profiles tab -> VMware GSX standard -> configure Profile
    • Virtual Switch 0: VMnet1
    • Virtual Switch 1: VMnet0
• Change state of localvmhost to vmhostinuse (edit the database directly, do not use the Virtual Hosts utility on the website)
• Assign vm guests to localvmhost
• Create node in priviledge tree
  • Name: VM image access
  • Add resource groups:
    • all vm guest computers
    • all vm guest images