{composition-setup} cloak.toggle-type=default {composition-setup}

Create and configure the VM

This guide will help you set up the preconfigured VM referenced at devcloud-kvm. It's much easier to use the preconfigured image but this guide may help you if you wish to use a different development enviroment.

  1. {toggle-cloak:id=VM Definition XML}

    Create the VM XML (click to show):

    {toggle-cloak:id=VM Definition XML}

    {cloak:id=VM Definition XML} cat > devcloud-kvm.xml << EOL <domain type='kvm'> <name>devcloud-kvm</name> <memory>8388608</memory> <currentMemory>8388608</currentMemory> <vcpu>4</vcpu> <os> <type arch='x86_64' machine='pc-1.0'>hvm</type> <boot dev='hd'/> <bootmenu enable='yes'/> </os> <features> <acpi/> <apic/> <pae/> </features> <cpu match='exact'> <model>Westmere</model> <vendor>Intel</vendor> <feature policy='require' name='vmx'/> </cpu> <clock offset='utc'/> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>restart</on_crash> <devices> <emulator>/usr/bin/kvm</emulator> <disk type='file' device='disk'> <driver name='qemu' type='qcow2'/> <source file='/var/lib/libvirt/images/devcloud-kvm.qcow2'/> <target dev='vda' bus='virtio'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/> </disk> <disk type='block' device='cdrom'> <driver name='qemu' type='raw'/> <target dev='hdc' bus='ide'/> <readonly/> <address type='drive' controller='0' bus='1' unit='0'/> </disk> <controller type='usb' index='0'> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/> </controller> <controller type='ide' index='0'> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <interface type='network'> <mac address='52:54:00:4e:ff:4f'/> <source network='default'/> <model type='virtio'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/> </interface> <interface type='network'> <mac address='52:54:00:52:b1:5e'/> <source network='private1'/> <model type='virtio'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/> </interface> <serial type='pty'> <target port='0'/> </serial> <console type='pty'> <target type='serial' port='0'/> </console> <input type='tablet' bus='usb'/> <input type='mouse' bus='ps2'/> <graphics type='vnc' port='-1' autoport='yes'/> <video> <model type='cirrus' vram='9216' heads='1'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/> </video> <memballoon model='virtio'> <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/> </memballoon> </devices> </domain> EOL {cloak}

  2. Define VM with xml as created above virsh define devcloud-kvm.xml
  3. Create hard disk that XML points to: qemu-img create -f qcow2 /var/lib/libvirt/images/devcloud-kvm.qcow2 60G
  4. {toggle-cloak:id=NetXML}

    Create the network xml(click to show):

    {toggle-cloak:id=NetXML}

    {cloak:id=NetXML} cat > devcloud-kvm-net.xml << EOL <network> <name>private1</name> <uuid>f49f9a26-6c7a-ece4-9d4d-d2e295e6fb80</uuid> <bridge name='virbr1' stp='off' delay='0' /> <mac address='52:54:00:8D:BA:A5'/> </network> EOL {cloak}

  5. Create/edit networks required: virsh net-destroy default virsh net-edit default (change ip address range for dhcp so that we have some to manually assign) virsh net-start default virsh net-define devcloud-kvm-net.xml virsh net-autostart private1 virsh net-start private1
  6. Start the vm, attach to vnc virsh start kvm-cloudstack virsh vncdisplay kvm-cloudstack
    • launch your favorite vnc viewer and connect to the localhost port returned by the previous command
  7. Attach CentOS installation iso virsh attach-disk kvm-cloudstack ~/Downloads/CentOS-6.3-x86_64-minimal.iso hdc --type cdrom

    Once you attach the disk the VM should reboot on its own. But you may need to reboot it manually.

  8. Install minimal CentOS Use 1 partition of 30G for /, and leave another 30G partition blank for a volume group

Configure the guest network

  1. Set eth0 to use br0 (/etc/sysconfig/network-scripts/ifcfg-eth0) BOOTPROTO=none ONBOOT=yes BRIDGE=cloudbr0 DEVICE=eth0
  2. Set eth1 to use br1 (/etc/sysconfig/network-scripts/ifcfg-eth1) BOOTPROTO=none ONBOOT=yes BRIDGE=cloudbr1 DEVICE=eth1
  3. Set br0 to use IP (/etc/sysconfig/network-scripts/ifcfg-br0) DEVICE="cloudbr0" BOOTPROTO="static" GATEWAY="172.17.10.1" IPADDR="172.17.10.10" NETMASK="255.255.255.0" ONBOOT="yes" TYPE="Bridge"
  4. Set br1 to use IP (/etc/sysconfig/network-scripts/ifcfg-br1) DEVICE="cloudbr1" BOOTPROTO="static" ONBOOT="yes" IPADDR="192.168.100.10" NETMASK="255.255.255.0" TYPE="Bridge"
  5. Configure networking # Edit /etc/hosts and create an entry for "192.168.100.10 devcloud-kvm" -- we want to treat the internal/management interface as the main IP for this host set a nameserver in /etc/resolv.conf disable selinux in /etc/sysconfig/selinux
  6. reboot then ssh into the server (optional) yum update yum install git java-1.6.0-openjdk-devel java-1.6.0 rpm-build mysql-connector-java mysql mysql-server ant* jsvc ipmitool jakarta-commons-lang jna dnsmasq wget tomcat6 ws-commons-utils gcc glibc-devel MySQL-python mkisofs java-1.7.0-openjdk-devel java-1.7.0-openjdk kvm libvirt libvirtd ebtables vconfig python-paramiko sudo python-setuptools chkconfig mysqld on chkconfig dnsmasq on chkconfig nfs on chkconfig rpcbind on mkdir -m 777 -p /nfs/primary mkdir -m 777 /nfs/secondary echo '/nfs/primary *(rw,insecure,async,no_root_squash)' > /etc/exports echo '/nfs/secondary *(rw,insecure,async,no_root_squash)' >> /etc/exports
  7. Edit /etc/sysconfig/nfs and add the following: LOCKD_TCPPORT=32803 LOCKD_UDPPORT=32769 MOUNTD_PORT=892 RQUOTAD_PORT=875 STATD_PORT=662 STATD_OUTGOING_PORT=2020
  8. Add services to iptables, just after the port 22 rule (/etc/sysconfig/iptables): -A INPUT -i eth1 -m state --state NEW -p udp --dport 53 -j ACCEPT -A INPUT -i eth1 -m state --state NEW -p tcp --dport 53 -j ACCEPT -A INPUT -i eth1 -m state --state NEW -p udp --dport 111 -j ACCEPT -A INPUT -i eth1 -m state --state NEW -p tcp --dport 111 -j ACCEPT -A INPUT -i eth1 -m state --state NEW -p tcp --dport 2049 -j ACCEPT -A INPUT -i eth1 -m state --state NEW -p tcp --dport 32803 -j ACCEPT -A INPUT -i eth1 -m state --state NEW -p udp --dport 32769 -j ACCEPT -A INPUT -i eth1 -m state --state NEW -p tcp --dport 892 -j ACCEPT -A INPUT -i eth1 -m state --state NEW -p udp --dport 892 -j ACCEPT -A INPUT -i eth1 -m state --state NEW -p tcp --dport 875 -j ACCEPT -A INPUT -i eth1 -m state --state NEW -p udp --dport 875 -j ACCEPT -A INPUT -i eth1 -m state --state NEW -p tcp --dport 662 -j ACCEPT -A INPUT -i eth1 -m state --state NEW -p udp --dport 662 -j ACCEPT

Install Maven

wget http://apache.cs.utah.edu/maven/maven-3/3.0.4/binaries/apache-maven-3.0.4-bin.tar.gz tar -C /opt -xzf apache-maven-3.0.4-bin.tar.gz echo export PATH=\$PATH:/opt/apache-maven-3.0.4/bin >> /etc/bashrc

Reboot to apply yum updates/start services

Install cloudstack from source

git clone https://git-wip-us.apache.org/repos/asf/incubator-cloudstack.git cd incubator-cloudstack && git checkout 4.0 && git clean -fxd mvn -P deps && ./waf rpm cd artifacts/rpmbuild/RPMS/x86_64 rm cloud-baremetal* yum erase antlr (weird conflict) rpm -ivh *.rpm cloud-setup-databases cloud:password@localhost --deploy-as=root /usr/lib64/cloud/common/scripts/storage/secondary/cloud-install-sys-tmplt -m /nfs/secondary -u http://download.cloud.com/templates/acton/acton-systemvm-02062012.qcow2.bz2 -h kvm -F cloud-setup-management

You should be able to log into cloudstack now at http://192.168.100.10:8080/client

Running Main Branch:

mv incubator-cloudstack incubator-cloudstack.bak git clone https://git-wip-us.apache.org/repos/asf/incubator-cloudstack.git cd incubator-cloudstack mvn -P developer,systemvm clean install mvn -P developer -pl developer,tools/devcloud-kvm -Ddeploydb rpm -e cloud-server cloud-aws-api cloud-client-ui cloud-usage cloud-cli cloud-setup cloud-client mvn -pl :cloud-client-ui jetty:run

{toggle-cloak:id=agentscript}

Write the custom startup script to /etc/init.d/cloud-agent (click to show):

{toggle-cloak:id=agentscript}

{cloak:id=agentscript} cat > /etc/init.d/cloud-agent << EOL #!/bin/bash # chkconfig: 35 99 10 # description: Cloud Agent # Licensed to the Apache Software Foundation (ASF) under one # or more contributor license agreements. See the NOTICE file # distributed with this work for additional information # regarding copyright ownership. The ASF licenses this file # to you under the Apache License, Version 2.0 (the # "License"); you may not use this file except in compliance # with the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, # software distributed under the License is distributed on an # "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY # KIND, either express or implied. See the License for the # specific language governing permissions and limitations # under the License. # WARNING: if this script is changed, then all other initscripts MUST BE changed to match it as well . /etc/rc.d/init.d/functions whatami=cloud-agent # set environment variables SHORTNAME="$whatami" PIDFILE=/var/run/"$whatami".pid LOCKFILE=/var/lock/subsys/"$SHORTNAME" LOGFILE=/var/log/cloud/agent/agent.log PROGNAME="Cloud Agent" CLASS="com.cloud.agent.AgentShell" JSVC=`which jsvc 2>/dev/null`; CODEHOME="/root/incubator-cloudstack" TARGET="$CODEHOME/plugins/hypervisors/kvm/target" DEPS=`ls /root/incubator-cloudstack/plugins/hypervisors/kvm/target/dependencies/cloud* | tr "\\n" ":"` PLUGIN=`ls $CODEHOME/plugins/hypervisors/kvm/target/* | grep cloud-plugin` # exit if we don't find jsvc if [ -z "$JSVC" ]; then echo no jsvc found in path; exit 1; fi # copy other agent requirements cp -rp $CODEHOME/console-proxy/dist/systemvm.* /usr/lib64/cloud/common/vms/ cp -rp $CODEHOME/scripts /usr/lib64/cloud/common unset OPTIONS [ -r /etc/sysconfig/"$SHORTNAME" ] && source /etc/sysconfig/"$SHORTNAME" # The first existing directory is used for JAVA_HOME (if JAVA_HOME is not defined in $DEFAULT) JDK_DIRS="/usr/lib/jvm/jre /usr/lib/jvm/java-6-openjdk /usr/lib/jvm/java-6-openjdk-i386 /usr/lib/jvm/java-6-openjdk-amd64 /usr/lib/jvm/java-6-sun /usr/lib/jvm/java-1.5.0-sun /usr/lib/j2sdk1.5-sun /usr/lib/j2sdk1.5-ibm" for jdir in $JDK_DIRS; do if [ -r "$jdir/bin/java" -a -z "${JAVA_HOME}" ]; then JAVA_HOME="$jdir" fi done export JAVA_HOME SCP="/usr/share/java/commons-collections.jar:/usr/share/java/commons-dbcp.jar:/usr/share/java/commons-codec.jar:/usr/share/java/commons-logging.jar:/usr/share/java/commons-logging-api.jar:/usr/share/java/commons-pool.jar:/usr/share/java/commons-httpclient.jar:/usr/share/java/commons-fileupload.jar:/usr/share/java/ws-commons-util.jar:/usr/share/java/mysql-connector-java.jar:/usr/share/java/tomcat6-servlet-2.5-api.jar:/usr/share/java/tomcat6-jsp-2.1-api-6.0.24.jar:/usr/share/java/tomcat6-el-2.1-api-6.0.24.jar:/usr/share/java/jakarta-taglibs-core-1.1.1.jar:/usr/share/java/jakarta-taglibs-standard-1.1.1.jar:/usr/share/java/tomcat6/jasper.jar:/usr/share/java/tomcat6/jasper-el.jar:/usr/share/java/tomcat6/jasper-jdt.jar" DCP="/usr/share/java/axis2-1.5.1.jar:/usr/share/java/geronimo-activation_1.1_spec-1.0.1.jar:/usr/share/java/ejb-api-3.0.jar:/usr/share/java/junit-4.10.jar:/usr/share/java/commons-collections-3.2.1.jar:/usr/share/java/rampart-core-1.5.jar:/usr/share/java/xmlrpc-common-3.1.3.jar:/usr/share/java/commons-fileupload-1.2.jar:/usr/share/java/backport-util-concurrent-3.1.jar:/usr/share/java/commons-lang-2.1.jar:/usr/share/java/bcprov-jdk16-1.45.jar:/usr/share/java/commons-logging-1.1.1.jar:/usr/share/java/joda-time-1.5.2.jar:/usr/share/java/jmdns-2.1.jar:/usr/share/java/xmltooling-1.3.1.jar:/usr/share/java/javax.persistence-2.0.0.jar:/usr/share/java/jcl-over-slf4j-1.6.1.jar:/usr/share/java/opensaml-1.1.jar:/usr/share/java/jul-to-slf4j-1.6.1.jar:/usr/share/java/XmlSchema-1.4.2.jar:/usr/share/java/commons-codec-1.6.jar:/usr/share/java/woden-impl-dom-1.0M8.jar:/usr/share/java/antlr-2.7.7.jar:/usr/share/java/rampart-policy-1.5.jar:/usr/share/java/axis2-adb-codegen-1.4.1.jar:/usr/share/java/woden-api-1.0M8.jar:/usr/share/java/axis-jaxrpc-1.4.jar:/usr/share/java/xercesImpl-2.8.1.jar:/usr/share/java/jsr107cache-1.0.jar:/usr/share/java/hamcrest-core-1.1.jar:/usr/share/java/oro-2.0.8.jar:/usr/share/java/axis2-codegen-1.4.1.jar:/usr/share/java/velocity-1.5.jar:/usr/share/java/commons-httpclient-3.1.jar:/usr/share/java/servlet-api-2.5-20081211.jar:/usr/share/java/log4j-over-slf4j-1.6.1.jar:/usr/share/java/opensaml-2.5.1-1.jar:/usr/share/java/javassist-3.9.0.GA.jar:/usr/share/java/ws-commons-util-1.0.2.jar:/usr/share/java/rampart-trust-1.5.jar:/usr/share/java/commons-dbcp-1.4.jar:/usr/share/java/xmlParserAPIs-2.6.0.jar:/usr/share/java/apache-log4j-extras-1.1.jar:/usr/share/java/servlet-api-2.3.jar:/usr/share/java/httpcore-4.0.jar:/usr/share/java/jasypt-1.9.0.jar:/usr/share/java/jstl-1.2.jar:/usr/share/java/axis2-adb-1.4.1.jar:/usr/share/java/gson-1.7.1.jar:/usr/share/java/trilead-ssh2-build213-svnkit-1.3-patch.jar:/usr/share/java/log4j-1.2.16.jar:/usr/share/java/axiom-impl-1.2.8.jar:/usr/share/java/xml-apis-1.3.04.jar:/usr/share/java/xstream-1.3.1.jar:/usr/share/java/slf4j-api-1.5.11.jar:/usr/share/java/xmlsec-1.4.2.jar:/usr/share/java/wstx-asl-3.2.4.jar:/usr/share/java/esapi-2.0GA.jar:/usr/share/java/stringtemplate-3.2.1.jar:/usr/share/java/axis2-1.5.1.jar:/usr/share/java/jcip-annotations-1.0.jar:/usr/share/java/xmlrpc-client-3.1.3.jar:/usr/share/java/commons-io-1.4.jar:/usr/share/java/axis2-kernel-1.4.1.jar:/usr/share/java/axis2-ant-plugin-1.4.1.jar:/usr/share/java/jaxen-1.1.1.jar:/usr/share/java/neethi-2.0.4.jar:/usr/share/java/mail-1.4.jar:/usr/share/java/geronimo-jms_1.1_spec-1.1.jar:/usr/share/java/slf4j-jdk14-1.5.11.jar:/usr/share/java/wss4j-1.5.8.jar:/usr/share/java/httpcore-nio-4.0-beta1.jar:/usr/share/java/axiom-dom-1.2.7.jar:/usr/share/java/activation-1.1.jar:/usr/share/java/axiom-api-1.2.8.jar:/usr/share/java/geronimo-stax-api_1.0_spec-1.0.1.jar:/usr/share/java/json-simple-1.1.jar:/usr/share/java/axis-1.4.jar:/usr/share/java/bcprov-jdk15-1.45.jar:/usr/share/java/geronimo-javamail_1.4_spec-1.2.jar:/usr/share/java/axis2-java2wsdl-1.4.1.jar:/usr/share/java/ehcache-1.5.0.jar:/usr/share/java/axis2-mtompolicy-1.5.1.jar:/usr/share/java/mysql-connector-java-5.1.21.jar:/usr/share/java/xapi-5.6.100-1-SNAPSHOT.jar:/usr/share/java/libvirt-0.4.9.jar:/usr/share/java/xalan-2.7.0.jar:/usr/share/java/annogen-0.1.0.jar:/usr/share/java/xpp3_min-1.1.4c.jar:/usr/share/java/ant-1.7.0.jar:/usr/share/java/openws-1.4.1.jar:/usr/share/java/jetty-6.1.26.jar:/usr/share/java/CAStorSDK-1.3.1-CS40.jar:/usr/share/java/jetty-util-6.1.26.jar:/usr/share/java/wsdl4j-1.6.2.jar:/usr/share/java/dom4j-1.6.1.jar:/usr/share/java/xml-resolver-1.2.jar:/usr/share/java/mex-1.5.1-impl.jar:/usr/share/java/ant-launcher-1.7.0.jar:/usr/share/java/jsch-0.1.42.jar:/usr/share/java/commons-pool-1.6.jar:/usr/share/java/cglib-nodep-2.2.2.jar:/usr/share/java/bcprov-jdk14-140.jar:/usr/share/java/commons-configuration-1.8.jar:/usr/share/java/not-yet-commons-ssl-0.3.9.jar:/usr/share/java/antlr-runtime-3.4.jar:/usr/share/java/commons-discovery-0.5.jar" ACP="${DEPS}${PLUGIN}:/usr/share/java/jna.jar" JCP="/usr/share/java/commons-daemon.jar" # We need to append the JSVC daemon JAR to the classpath # AgentShell implements the JSVC daemon methods export CLASSPATH="$SCP:$DCP:$ACP:$JCP:/etc/cloud/agent:/usr/lib64/cloud/agent" start() { echo -n $"Starting $PROGNAME: " if hostname --fqdn >/dev/null 2>&1 ; then $JSVC -cp "$CLASSPATH" -pidfile "$PIDFILE" $CLASS RETVAL=$? echo else failure echo echo The host name does not resolve properly to an IP address. Cannot start "$PROGNAME". > /dev/stderr RETVAL=9 fi [ $RETVAL = 0 ] && touch ${LOCKFILE} return $RETVAL } stop() { echo -n $"Stopping $PROGNAME: " $JSVC -pidfile "$PIDFILE" -stop $CLASS RETVAL=$? echo [ $RETVAL = 0 ] && rm -f ${LOCKFILE} ${PIDFILE} } # See how we were called. case "$1" in start) start ;; stop) stop ;; status) status -p ${PIDFILE} $SHORTNAME RETVAL=$? ;; restart) stop sleep 3 start ;; condrestart) if status -p ${PIDFILE} $SHORTNAME >&/dev/null; then stop sleep 3 start fi ;; *) echo $"Usage: $whatami {start|stop|restart|condrestart|status|help}" RETVAL=3 esac exit $RETVAL EOL {cloak}
  • No labels