Fujitsu XF Foundation log Analysis

Nutanix foundation tool is used to install the hypervisor e.g AHV, Vmware Esxi, Hyper-V and Citrix Xen on top of it install the Controller-VM to manage storage. Nutanix foundation tool generate logs during imaging process that logs help to analysis to find out the actual background process steps which runs by the Nutanix Foundation tool in backgrounds to image the Nutanix HCI supported hardware.

Today i will do analysis the foundation process logs of Nutanix hardware OEM partner Fujitsu XF hardware to install the AHV hypervisor and Controller-VM: CVM to complete basic installation.

Mount the Nutanix Phoenix ISO image to virtual media of hardware through iRMC interface on port number TCP: 623.

Share type NFS
Server IP address : Foundation_IP_Address
share Name : /home/nutanix/foundation/tmp/sessions/20190724-030727-4/phoenix_node_isos
Image Name : foundation.node_192.168.0.21.iso

Nutanix Foundation Process Steps

Learn how Nutanix Foundation Tool works to install the hypervisor and AOS on Nutanix Supported Hardware. The Fujitsu XF hardware foundation process described below with Logs and Analysis step to step.

Nutanix foundation tool validation of supported hardware

20190723 23:33:32 INFO Validating parameters. This may take few minutes
20190723 23:33:35 INFO Running ) @4290>
20190723 23:33:35 INFO Validating parameters. This may take few minutes
20190723 23:35:25 ERROR Node with ip 192.168.0.21 is not in cvm or is not reachable
20190723 23:35:28 ERROR Node with ip 192.168.0.21 is not in phoenix or is not reachable
20190723 23:35:31 ERROR Node with ip 192.168.0.21 is not in cvm or is not reachable
20190723 23:35:34 ERROR Node with ip 192.168.0.21 is not in phoenix or is not reachable
20190723 23:35:34 INFO Completed ) @4290>

Determine the IP address of Host hypervisor and Controller-VM: CVM

20190723 23:35:34 INFO Running ) @41d0>
20190723 23:35:34 INFO Node IP: CVM(192.168.0.21) HOST(192.168.0.11) IPMI(192.168.0.1)
20190723 23:37:18 INFO NOS Version is: 99.0
20190723 23:37:18 INFO Completed ) @41d0>
20190723 23:37:18 INFO Running ) @4250>
20190723 23:37:18 INFO Attempting to detect device type on 192.168.0.1
20190723 23:37:18 DEBUG factory mode is False
20190723 23:37:18 INFO Checking if this is Quanta
20190723 23:37:19 INFO Checking if this is an Ironwood system.
20190723 23:37:21 INFO Detected class irmc for node with IPMI IP 192.168.0.1
20190723 23:37:21 INFO Completed ) @4250>
20190723 23:37:21 INFO Running ) @42d0>
20190723 23:37:21 INFO Imaging Step Prepare Dell skipped
20190723 23:37:21 INFO Completed ) @42d0>
20190723 23:37:21 INFO Running ) @4490>
20190723 23:37:21 INFO Completed ) @4490>
20190723 23:37:21 INFO Running ) @3c50>

Determining the NOS version

20190723 23:37:21 INFO NOS version is 99.0
20190723 23:37:21 INFO Preparing NOS package
20190723 23:37:21 INFO Running ) @4710>
20190723 23:37:21 DEBUG skipped, this node will be imaged via IPMI
20190723 23:37:21 INFO Completed ) @4710>

Creating Phoenix image for every node going to image and mount Phoenix ISO image to virtual media

20190723 23:38:29 INFO Making node specific Phoenix image
20190723 23:38:36 INFO Powering off node
20190723 23:38:41 INFO Mounting phoenix iso image
20190723 23:38:41 INFO Setting boot mode to Legacy
20190723 23:42:40 INFO Mounting ‘/home/nutanix/foundation/tmp/sessions/20190723-233332-2/phoenix_node_isos/foundation.node_192.168.0.21.iso’ as virtual CD drive
20190723 23:43:46 INFO Setting boot device to CDROM for next boot
20190723 23:43:46 INFO Waiting up to 300 second for node to power off
20190723 23:43:46 INFO Waiting for remote node to boot into phoenix, this may take 20 minutes
20190723 23:47:12 INFO phoenix_callback: greetings from phoenix
20190723 23:47:13 INFO Rebooted into Phoenix successfully

Un-mounting ISO image on virtual media from node

20190723 23:47:13 INFO Unmounting virtual media
20190723 23:47:13 INFO Completed ) @3c50>
20190723 23:47:13 INFO Running ) @4810>
20190723 23:47:13 INFO Rebooting into staging environment
20190723 23:48:50 INFO Node with ip 192.168.0.21 is in phoenix. Generating hardware_config.json
20190723 23:48:53 INFO Boot device WWN: 500a0XXXXXXXXXXX
20190723 23:48:54 INFO Boot device serial: 191922XXXXXX
20190723 23:48:55 INFO Copied /home/nutanix/foundation/templates/crystal_plat_reference.json to phoenix at ip 192.168.0.21
20190723 23:48:59 INFO NIC with PCI address 01:00:0 will be used for NIC teaming if default teaming fails
20190723 23:48:59 INFO This node is not a gold node
20190723 23:49:00 ERROR Command ‘/usr/bin/ipmicfg-linux.x86_64 -tp info’ returned error code 13
stdout:

stderr:
Not TwinPro
20190723 23:49:01 ERROR Command ‘/usr/bin/ipmicfg-linux.x86_64 -tp nodeid’ returned error code 13
stdout:
stderr:
Not TwinPro

20190723 23:49:01 INFO Completed ) @4810>
20190723 23:49:01 INFO Running ) @48d0>
20190723 23:49:01 INFO Running ) @4a10>
20190723 23:49:01 INFO Making node specific Phoenix json. This may take few minutes
20190723 23:49:38 ERROR Command ‘test -f /tmp/fatal_marker’ returned error code 1
stdout:
stderr:

Downloading AOS and AHV image from Nutanix Foundation tool to Node memory to execute the installation process

Downloading AOS and hypervisor AHV image
20190723 23:49:48 INFO Start downloading resources, this may take several minutes
20190723 23:49:48 INFO Waiting for Phoenix to finish downloading resources
20190723 23:49:50 INFO Model detected: XF8055-VDI
20190723 23:49:51 INFO Detecting Fujitsu block and node information…
20190723 23:49:51 INFO Chassis serial: YM6DXXXXXX
20190723 23:49:51 INFO Node serial: None
20190723 23:49:51 INFO Node position: None
20190723 23:49:51 INFO Using block_id from FRU
20190723 23:49:51 INFO Generating cluster_id
20190723 23:49:51 INFO Using node_position from AZ_CONFIG
20190723 23:49:51 INFO node_serial = 98c08416-XXX9-4f34-XXXXXXXXXXXXXXXXX, node_uuid = e1eXXb24-da07-46ad-XXXXXXXXXXXXXX, block_id = YM6XXXXXX, cluster_id = 91353XXXXXXXXXX, model = USE_LAYOUT, model_string = XF8055-VDI, node_position = A
20190723 23:49:51 INFO Running updated Phoenix
20190723 23:49:51 INFO Downloading AOS tarball
20190723 23:49:51 INFO Downloading AOS tarball: Downloading AOS tarball
20190723 23:49:51 INFO Downloading file ‘nutanix_installer_package-release-euphrates-5.10.4-stable.tar’ with size: 4895365120 bytes.
20190723 23:50:06 INFO Downloaded 410 / 4668 MB
20190723 23:50:21 INFO Downloaded 827 / 4668 MB
20190723 23:50:37 INFO Downloaded 1228 / 4668 MB
20190723 23:50:52 INFO Downloaded 1648 / 4668 MB
20190723 23:51:07 INFO Downloaded 2022 / 4668 MB
20190723 23:51:22 INFO Downloaded 2452 / 4668 MB
20190723 23:51:37 INFO Downloaded 2880 / 4668 MB
20190723 23:51:52 INFO Downloaded 3319 / 4668 MB
20190723 23:52:07 INFO Downloaded 3768 / 4668 MB
20190723 23:52:22 INFO Downloaded 4217 / 4668 MB
20190723 23:52:37 INFO Downloaded 4668 / 4668 MB
20190723 23:52:37 INFO Downloading Anaconda bits
20190723 23:52:37 INFO Downloading file ‘anaconda.tar.gz’ with size: 263700099 bytes.
20190723 23:52:46 INFO Downloading hypervisor iso
20190723 23:52:46 INFO Downloading hypervisor iso: Downloading hypervisor iso
20190723 23:52:46 INFO Downloading file ‘host-bundle-el6.nutanix.20170830.270.tar.gz’ with size: 198188985 bytes.
20190723 23:52:53 INFO Downloading AHV OEM RPMs
20190723 23:52:53 INFO Downloading file ‘DellPTAgent-1.8.0-0.112.x86_64.rpm’ with size: 5463508 bytes.
20190723 23:52:53 INFO Downloading file ‘OM-iSM-Dell-Web-LX-330-1290_A00.tar.gz’ with size: 4696608 bytes.

Running CVM in memory to kick start the hypervisor installation

20190723 23:52:56 INFO Running CVM Installer: Running CVM Installer
20190723 23:52:56 INFO Running CVM Installer
20190723 23:52:56 INFO Generating unique SSH identity for this Hypervisor-CVM pair.
20190723 23:52:56 INFO Generating SSL certificate for this Hypervisor-CVM pair.
20190723 23:52:56 INFO Extracting the SVM installer into memory. This will take some time…
20190723 23:52:59 INFO Injecting SSH keys into SVM installer.
20190723 23:52:59 INFO Checking if a newer HCL exists on CVM
20190723 23:52:59 INFO Getting NOS version from the CVM

Scanning Storage Media to initilize and format to install the Hypervior: AHV

20190723 23:53:00 INFO Scanning devices to assemble RAID. This may take few minutes
20190723 23:53:00 INFO Scanning devices: [‘sda’, ‘sdc’]
20190723 23:53:02 INFO Using hcl from /mnt/svm_installer/install/config/hcl.json with last_edit 1552457147
20190723 23:53:02 INFO Imaging the SVM
20190723 23:53:03 INFO Formatting all data disks [‘sdd’, ‘sde’, ‘sdf’, ‘sdg’, ‘sda’, ‘sdb’, ‘sdc’, ‘sdh’]
20190723 23:53:03 INFO Executing /mnt/svm_installer/install/bin/svm_rescue with arg_list [‘-i’, ‘/mnt/svm_installer/install’, ‘–factory_deploy’, ‘–node_name=YM6XXXXXXX-A’, ‘–node_serial=98c08416-e519-4f34-XXXXXXXXXXXXXX’, ‘–node_model=USE_LAYOUT’, ‘–cluster_id=913535XXXXXXXXXXX’, ‘–node_uuid=e1e93b24-da07-46ad-XXXXXXXXXXXXXXXXXX’]
20190723 23:53:04 INFO AHV iso created in /tmp/kvm.iso
20190723 23:53:05 INFO kvm iso unpacked in /tmp/tmp7InKn7
20190723 23:53:05 INFO Kickstart file created
20190723 23:53:05 DEBUG Bootloader config created for AHV-el6
20190723 23:53:05 INFO KVM iso packed
20190723 23:53:05 INFO Installation Device = /dev/sdi
20190723 23:53:05 INFO Executing /usr/bin/qemu-system-x86_64 -m 4096 -machine q35 -enable-kvm -drive file=/dev/sdi,cache=writethrough,format=raw -cdrom /phoenix/imaging_helper/installer.iso -netdev user,id=net0,net=192.168.5.0/24 -device e1000,netdev=net0,id=net0,mac=4c:52:62:XX:XX:XX -vnc :1 -boot order=d -pidfile installer_vm.pid -daemonize -smp 4

Nutanix CVM started to Install Hypervisor into SATADOM

20190723 23:53:05 INFO Installer VM is now running the installation
20190723 23:53:05 INFO Installer VM running with PID = 3081
20190723 23:53:35 INFO Installing AHV: Installing AHV
20190723 23:53:35 INFO [30/1230] Hypervisor installation in progress
20190723 23:54:05 INFO [60/1230] Hypervisor installation in progress
20190723 23:54:35 INFO [90/1230] Hypervisor installation in progress
20190723 23:55:06 INFO [120/1230] Hypervisor installation in progress
20190723 23:55:36 INFO [150/1230] Hypervisor installation in progress
20190723 23:56:06 INFO [180/1230] Hypervisor installation in progress
20190723 23:56:36 INFO [210/1230] Hypervisor installation in progress
20190723 23:56:52 INFO touching .autorelabel
20190723 23:56:52 INFO Creating layout file for XF8055-VDI in position A
20190723 23:56:52 INFO Running firmware detection: Running firmware detection
20190723 23:56:52 INFO Could not generate firmware config. Proceeding with imaging without it
20190723 23:56:53 INFO Imaging of SVM has completed successfully!

Scanning Storage Media to Re-partitioning as per requirement

20190723 23:56:53 DEBUG 2019-07-24 08:52:33 INFO svm_rescue:635 Will image [‘/dev/sda’, ‘/dev/sdc’] from /mnt/svm_installer/install/images/svm.tar.xz.
2019-07-24 08:52:33 INFO svm_rescue:102 exec_cmd: mdadm –stop –scan
2019-07-24 08:52:33 INFO svm_rescue:471 Disks detected from Phoenix: [‘/dev/sdd’, ‘/dev/sde’, ‘/dev/sdf’, ‘/dev/sdg’, ‘/dev/sda’, ‘/dev/sdb’, ‘/dev/sdc’, ‘/dev/sdh’]
2019-07-24 08:52:33 INFO svm_rescue:493 Repartitioning disk /dev/sdd
2019-07-24 08:52:33 INFO svm_rescue:102 exec_cmd: /mnt/cdrom/bin/repartition_disks -d /dev/sdd
2019-07-24 08:52:35 INFO svm_rescue:493 Repartitioning disk /dev/sde
2019-07-24 08:52:35 INFO svm_rescue:102 exec_cmd: /mnt/cdrom/bin/repartition_disks -d /dev/sde
2019-07-24 08:52:36 INFO svm_rescue:493 Repartitioning disk /dev/sdf
2019-07-24 08:52:36 INFO svm_rescue:102 exec_cmd: /mnt/cdrom/bin/repartition_disks -d /dev/sdf
2019-07-24 08:52:38 INFO svm_rescue:493 Repartitioning disk /dev/sdg
2019-07-24 08:52:38 INFO svm_rescue:102 exec_cmd: /mnt/cdrom/bin/repartition_disks -d /dev/sdg
2019-07-24 08:52:40 INFO svm_rescue:493 Repartitioning disk /dev/sda
2019-07-24 08:52:40 INFO svm_rescue:102 exec_cmd: parted -s /dev/sda unit s print
2019-07-24 08:52:40 INFO svm_rescue:154 No partition table present on disk /dev/sda
2019-07-24 08:52:40 INFO svm_rescue:445 Need to repartition and format blank boot drive /dev/sda
2019-07-24 08:52:40 INFO svm_rescue:102 exec_cmd: /mnt/cdrom/bin/repartition_disks -b /dev/sda
2019-07-24 08:52:40 INFO svm_rescue:493 Repartitioning disk /dev/sdb
2019-07-24 08:52:40 INFO svm_rescue:102 exec_cmd: /mnt/cdrom/bin/repartition_disks -d /dev/sdb
2019-07-24 08:52:42 INFO svm_rescue:493 Repartitioning disk /dev/sdc
2019-07-24 08:52:42 INFO svm_rescue:102 exec_cmd: parted -s /dev/sdc unit s print
2019-07-24 08:52:42 INFO svm_rescue:154 No partition table present on disk /dev/sdc
2019-07-24 08:52:42 INFO svm_rescue:445 Need to repartition and format blank boot drive /dev/sdc
2019-07-24 08:52:42 INFO svm_rescue:102 exec_cmd: /mnt/cdrom/bin/repartition_disks -b /dev/sdc
2019-07-24 08:52:43 INFO svm_rescue:493 Repartitioning disk /dev/sdh
2019-07-24 08:52:43 INFO svm_rescue:102 exec_cmd: /mnt/cdrom/bin/repartition_disks -d /dev/sdh
2019-07-24 08:52:45 INFO svm_rescue:432 Formatting disks [‘/dev/sda4’, ‘/dev/sdb1’, ‘/dev/sdc4’, ‘/dev/sdd1’, ‘/dev/sde1’, ‘/dev/sdf1’, ‘/dev/sdg1’, ‘/dev/sdh1’]
2019-07-24 08:52:45 INFO svm_rescue:102 exec_cmd: /mnt/cdrom/bin/clean_disks -p /dev/sda4,/dev/sdb1,/dev/sdc4,/dev/sdd1,/dev/sde1,/dev/sdf1,/dev/sdg1,/dev/sdh1
2019-07-24 08:54:17 INFO svm_rescue:432 Formatting disks [‘/dev/sda1’, ‘/dev/sda2’, ‘/dev/sda3’]
2019-07-24 08:54:17 INFO svm_rescue:102 exec_cmd: /mnt/cdrom/bin/clean_disks -p /dev/sda1,/dev/sda2,/dev/sda3
2019-07-24 08:54:19 INFO svm_rescue:432 Formatting disks [‘/dev/sdc1’, ‘/dev/sdc2’, ‘/dev/sdc3’]
2019-07-24 08:54:19 INFO svm_rescue:102 exec_cmd: /mnt/cdrom/bin/clean_disks -p /dev/sdc1,/dev/sdc2,/dev/sdc3
2019-07-24 08:54:21 INFO disk_utils.py:78 Creating RAID1 volume /dev/md0 from (‘/dev/sda1’, ‘/dev/sdc1’)
2019-07-24 08:54:21 INFO disk_utils.py:78 Creating RAID1 volume /dev/md1 from (‘/dev/sda2’, ‘/dev/sdc2’)
2019-07-24 08:54:21 INFO disk_utils.py:78 Creating RAID1 volume /dev/md2 from (‘/dev/sda3’, ‘/dev/sdc3’)
2019-07-24 08:54:21 INFO svm_rescue:432 Formatting disks [‘/dev/md0’, ‘/dev/md1’, ‘/dev/md2’]

Extracting SVM_Rescue bundle for further installation

2019-07-24 08:54:21 INFO svm_rescue:102 exec_cmd: /mnt/cdrom/bin/clean_disks -p /dev/md0,/dev/md1,/dev/md2
2019-07-24 08:54:23 INFO svm_rescue:102 exec_cmd: mount /dev/md0 /mnt/disk
2019-07-24 08:54:23 INFO svm_rescue:102 exec_cmd: cd /mnt/disk; tar -xJpvf /mnt/svm_installer/install/images/svm.tar.xz
2019-07-24 08:54:58 INFO svm_rescue:102 exec_cmd: bash -c ‘cd /mnt/disk/usr/local/nutanix; tar -xvzf /mnt/svm_installer/install/pkg/nutanix-bootstrap-el7.3-release-euphrates-5.10.4-stable-b5654b18fc3273784edab3c3028acb81cc49b910.tar.gz’
2019-07-24 08:54:58 INFO svm_rescue:102 exec_cmd: bash -c ‘cd /mnt/disk/usr/local/nutanix; tar -xvzf /mnt/svm_installer/install/pkg/nutanix-core-el7.3-release-euphrates-5.10.4-stable-b5654b18fc3273784edab3c3028acb81cc49b910.tar.gz’

2019-07-24 08:55:15 INFO svm_rescue:102 exec_cmd: bash -c ‘cd /mnt/disk/usr/local/nutanix; tar -xvzf /mnt/svm_installer/install/pkg/nutanix-pe-el7.3-release-euphrates-5.10.4-stable-b5654b18fc3273784edab3c3028acb81cc49b910.tar.gz’
2019-07-24 08:55:16 INFO svm_rescue:102 exec_cmd: bash -c ‘cd /mnt/disk/usr/local/nutanix; tar -xvzf /mnt/svm_installer/install/pkg/nutanix-diagnostics-el7.3-release-euphrates-5.10.4-stable-b5654b18fc3273784edab3c3028acb81cc49b910.tar.gz’
2019-07-24 08:55:18 INFO svm_rescue:102 exec_cmd: bash -c ‘cd /mnt/disk/usr/local/nutanix; tar -xvzf /mnt/svm_installer/install/pkg/nutanix-infrastructure-el7.3-release-euphrates-5.10.4-stable-b5654b18fc3273784edab3c3028acb81cc49b910.tar.gz’
2019-07-24 08:55:19 INFO svm_rescue:102 exec_cmd: bash -c ‘cd /mnt/disk/usr/local/nutanix; tar -xvzf /mnt/svm_installer/install/pkg/nutanix-lcm-2.1.4139.tar.gz’

2019-07-24 08:55:19 INFO svm_rescue:102 exec_cmd: bash -c ‘cd /mnt/disk/usr/local/nutanix; tar -xvzf /mnt/svm_installer/install/pkg/nutanix-serviceability-el7.3-release-euphrates-5.10.4-stable-b5654b18fc3273784edab3c3028acb81cc49b910.tar.gz’
2019-07-24 08:55:19 INFO svm_rescue:102 exec_cmd: bash -c ‘cd /mnt/disk/usr/local/nutanix; tar -xvzf /mnt/svm_installer/install/pkg/nutanix-ncc-el7.3-release-ncc-3.7.1-x86_64-latest.tar.gz’
2019-07-24 08:55:24 INFO svm_rescue:102 exec_cmd: bash -c ‘cd /mnt/disk/usr/local/nutanix; tar -xvzf /mnt/svm_installer/install/pkg/nutanix-minervacvm-el7.3-release-euphrates-5.10.4-stable-b5654b18fc3273784edab3c3028acb81cc49b910.tar.gz’
2019-07-24 08:55:25 INFO svm_rescue:102 exec_cmd: bash -c ‘cd /mnt/disk/usr/local/nutanix; tar -xvzf /mnt/svm_installer/install/pkg/nutanix-perftools-el7.3-release-euphrates-5.10.4-stable-b5654b18fc3273784edab3c3028acb81cc49b910.tar.gz’
2019-07-24 08:55:25 INFO svm_rescue:102 exec_cmd: bash -c ‘cd /mnt/disk/usr/local/nutanix; tar -xvzf /mnt/svm_installer/install/pkg/nutanix-syscheck-el7.3-release-euphrates-5.10.4-stable-b5654b18fc3273784edab3c3028acb81cc49b910.tar.gz’

2019-07-24 08:55:25 INFO svm_rescue:102 exec_cmd: bash -c ‘cd /mnt/disk/srv/; tar -xvzf /mnt/svm_installer/install/pkg/nutanix-salt-el7.3-release-euphrates-5.10.4-stable-b5654b18fc3273784edab3c3028acb81cc49b910.tar.gz’
2019-07-24 08:55:25 INFO svm_rescue:102 exec_cmd: bash -c ‘cd /mnt/disk/usr/local/nutanix; tar -xvzf /mnt/svm_installer/install/pkg/nutanix-intentgateway-el7.3-release-euphrates-5.10.4-stable-b5654b18fc3273784edab3c3028acb81cc49b910.tar.gz’
2019-07-24 08:55:26 INFO svm_rescue:102 exec_cmd: bash -c ‘cd /mnt/disk/usr/local/nutanix; tar -xvzf /mnt/svm_installer/install/pkg/nutanix-clusterconfig-el7.3-release-euphrates-5.10.4-stable-b5654b18fc3273784edab3c3028acb81cc49b910.tar.gz’
2019-07-24 08:55:26 INFO svm_rescue:102 exec_cmd: bash -c ‘cd /mnt/disk/usr/local/nutanix; tar -xvzf /mnt/svm_installer/install/pkg/nutanix-zkcore-el7.3-release-euphrates-5.10.4-stable-b5654b18fc3273784edab3c3028acb81cc49b910.tar.gz’
2019-07-24 08:55:26 INFO svm_rescue:102 exec_cmd: bash -c ‘cd /mnt/disk/usr/local/nutanix; tar -xvzf /mnt/svm_installer/install/pkg/nutanix-athena-el7.3-release-euphrates-5.10.4-stable-b5654b18fc3273784edab3c3028acb81cc49b910.tar.gz’
2019-07-24 08:55:36 INFO svm_rescue:102 exec_cmd: bash -c ‘cd /mnt/disk/usr/local/nutanix; tar -xvzf /mnt/svm_installer/install/pkg/nutanix-xtrim-el7.3-release-euphrates-5.10.4-stable-b5654b18fc3273784edab3c3028acb81cc49b910.tar.gz’

2019-07-24 08:55:36 INFO svm_rescue:677 Making post deployment modifications on /dev/md0
2019-07-24 08:55:37 INFO svm_rescue:102 exec_cmd: blkid -c /dev/null /dev/md0
2019-07-24 08:55:37 INFO svm_rescue:400 Root filesystem (on /dev/md0) UUID is 5cead7e7-6a33-426c-a374-148e782a4157 instead of ad6af956-f77d-45dd-8d44-9c006cbaddd5.
2019-07-24 08:55:37 INFO svm_rescue:603 Injecting mdadm.conf into boot partition.
2019-07-24 08:55:37 INFO svm_rescue:608 Injecting mdadm.conf into initrd /mnt/disk/boot/initramfs-3.10.0-862.14.4.el7.nutanix.20190207.cvm.x86_64.img
2019-07-24 08:55:37 INFO svm_rescue:102 exec_cmd: cd /tmp/tmp_b02h5; gunzip -c /mnt/disk/boot/initramfs-3.10.0-862.14.4.el7.nutanix.20190207.cvm.x86_64.img | cpio -id
2019-07-24 08:55:37 INFO svm_rescue:102 exec_cmd: cd /tmp/tmp_b02h5; find . | cpio -o -H newc | gzip > /mnt/disk/boot/initramfs-3.10.0-862.14.4.el7.nutanix.20190207.cvm.x86_64.img
2019-07-24 08:55:40 INFO svm_rescue:180 Creating Nutanix boot marker file from grub.conf …
2019-07-24 08:55:40 INFO svm_rescue:207 Wrote marker file, contents:
KERNEL=/boot/vmlinuz-3.10.0-862.14.4.el7.nutanix.20190207.cvm.x86_64
CMDLINE=’ro root=UUID=5cead7e7-6a33-426c-a374-148e782a4157 rd_NO_LUKS rd_NO_LVM rd_MD_UUID=ef9f935e:9cc833d6:f94861a2:a4dab64d rd_NO_DM LANG=en_US.UTF-8 SYSFONT=latarcyrheb-sun16 rhgb crashkernel=no KEYBOARDTYPE=pc KEYTABLE=us audit=1 nousb fips=1 nomodeset biosdevname=0 net.ifnames=0 scsi_mod.use_blk_mq=y panic=30 console=ttyS0,115200n8 console=tty0 clocksource=tsc kvm_nopvspin=1 xen_nopvspin=1 hv_netvsc.ring_size=512 panic=30 console=ttyS0,115200n8 console=tty0 mpt2sas.prot_mask=1 mpt3sas.prot_mask=1 spectre_v2=off nopti’

Setting up appropiate permission on /home/nutanix directory

INITRD=/boot/initramfs-3.10.0-862.14.4.el7.nutanix.20190207.cvm.x86_64.img
2019-07-24 08:55:40 INFO svm_rescue:238 Adding /dev/md2 to /etc/fstab to be mounted at /home…
2019-07-24 08:55:40 INFO svm_rescue:102 exec_cmd: blkid -c /dev/null /dev/md2
2019-07-24 08:55:40 INFO svm_rescue:102 exec_cmd: mount /dev/md2 /mnt/data
2019-07-24 08:55:40 INFO svm_rescue:726 Fixing permissions on /home.
2019-07-24 08:55:40 INFO svm_rescue:726 Fixing permissions on /home./nutanix

Finalizing the Hypervisor Installation

2019-07-24 08:55:40 INFO svm_rescue:751 Copying installer to /mnt/data/nutanix/data/installer/el7.3-release-euphrates-5.10.4-stable-b5654b18fc3273784edab3c3028acb81cc49b910
2019-07-24 08:55:40 INFO svm_rescue:102 exec_cmd: tar -C ‘/mnt/svm_installer/install’ -cf – . | tar -C ‘/mnt/data/nutanix/data/installer/el7.3-release-euphrates-5.10.4-stable-b5654b18fc3273784edab3c3028acb81cc49b910’ -xvf –
2019-07-24 08:55:43 INFO svm_rescue:102 exec_cmd: tar -xvzf /mnt/svm_installer/install/pkg/nutanix-foundation-4.3.4-20190501-da37825c.tar.gz -C /mnt/data/nutanix
2019-07-24 08:56:02 INFO svm_rescue:797 Setting up SSH configuration
2019-07-24 08:56:02 INFO svm_rescue:803 Writing out rc.nutanix
2019-07-24 08:56:02 INFO svm_rescue:885 Running setfiles.sh on the chroot: /mnt/disk
2019-07-24 08:56:18 INFO svm_rescue:102 exec_cmd: sync; sync; sync
2019-07-24 08:56:18 INFO svm_rescue:102 exec_cmd: umount /mnt/disk
2019-07-24 08:56:19 INFO svm_rescue:102 exec_cmd: umount /mnt/data
20190723 23:56:53 INFO 0/330 Waiting for md arrays to complete resync
20190723 23:57:06 INFO [240/1230] Hypervisor installation in progress
20190723 23:57:23 INFO Imaging thread ‘svm’ has completed successfully
20190723 23:57:36 INFO [270/1230] Hypervisor installation in progress
20190723 23:58:06 INFO [300/1230] Hypervisor installation in progress
20190723 23:58:36 INFO [330/1230] Hypervisor installation in progress
20190723 23:59:06 INFO [360/1230] Hypervisor installation in progress
20190723 23:59:13 INFO Rebooting AHV: Rebooting AHV
20190723 23:59:13 INFO Completed ) @48d0>
20190723 23:59:37 INFO [390/1230] Hypervisor installation in progress
20190723 23:59:37 INFO Installer VM finished in 390.591794968s.
20190723 23:59:37 INFO Hypervisor installation is done

Customizing the CVM template as per configureation

20190723 23:59:37 INFO Re-reading partition table for /dev/sdi
20190723 23:59:37 INFO Customizing KVM instance
20190723 23:59:37 INFO Setting hostname to ‘Node-1’
20190723 23:59:37 INFO Copying SVM template files
20190723 23:59:37 INFO Configuring SVM resources
20190723 23:59:37 INFO Setting CVM memory to 32GB
20190723 23:59:37 INFO Setting vCPUs to 10
20190723 23:59:37 INFO Setting cpuset to 0,1,2,3,4,5,6,7,8,9,20,21,22,23,24,25,26,27,28,29
20190723 23:59:37 INFO Fetching the list of HBAs and nics from layout
20190723 23:59:37 INFO Adding device with bus 5e:00.0, vendor 1000 and device 0097 to passthrough devices
20190723 23:59:38 INFO Regenerating initramfs
20190723 23:59:58 INFO Setting up authorized_keys
20190723 23:59:59 INFO Copying firstboot scripts into /mnt/stage/root/firstboot
20190723 23:59:59 INFO Copying SSH keys
20190723 23:59:59 INFO Copying network configuration crashcart scripts into /mnt/stage/root/nutanix-network-crashcart
20190723 23:59:59 INFO Installing firstboot marker file
20190723 23:59:59 INFO Cleaning up
20190723 23:59:59 INFO Imaging thread ‘hypervisor’ has completed successfully
20190723 23:59:59 INFO Imaging process completed successfully!
20190723 23:59:59 INFO Installation of Acropolis base software successful: Installation successful.
20190723 23:59:59 INFO Rebooting node. This may take several minutes: Rebooting node. This may take several minutes.

Setting up the networking confiration on Hypervisor and CVM

20190723 23:59:59 INFO Rebooting node. This may take several minutes
20190724 00:03:43 INFO Running cmd [‘ovs-appctl bond/list’]
20190724 00:03:43 INFO Running cmd [u’ovs-appctl bond/set-active-slave br0-up eth0′]
20190724 00:03:43 INFO Running cmd [u’ping -c 1 192.168.0.101′]
20190724 00:03:43 INFO Using eth0 as the active slave in bond br0-up
20190724 00:03:43 INFO Running firstboot scripts: Running firstboot scripts
20190724 00:03:43 INFO Expanding boot partition. This may take some time.
20190724 00:03:43 INFO Running cmd [‘/usr/bin/nohup /sbin/resize2fs /dev/sda1 &>/dev/null &’]
20190724 00:03:43 INFO Running cmd [‘touch /root/firstboot/phases/expand_boot_partition’]

20190724 00:03:43 INFO Running cmd [‘virsh net-list –all’]
20190724 00:03:43 INFO Running cmd [‘virsh net-list –all’]
20190724 00:03:43 INFO Running cmd [‘virsh net-define /root/net-VM-Network.xml’]
20190724 00:03:43 INFO Running cmd [‘virsh net-start VM-Network’]
20190724 00:03:43 INFO Running cmd [‘virsh net-autostart VM-Network’]
20190724 00:03:43 INFO Running cmd [‘virsh net-list –all’]
20190724 00:03:43 INFO Running cmd [‘virsh net-define /root/net-NTNX-Local-Network.xml’]
20190724 00:03:44 INFO Running cmd [‘virsh net-start NTNX-Local-Network’]
20190724 00:03:44 INFO Running cmd [‘virsh net-autostart NTNX-Local-Network’]

20190724 00:03:44 INFO Running cmd [‘touch /root/firstboot/phases/create_libvirt_networks’]
20190724 00:03:44 INFO Creating a new CVM: Creating a new CVM
20190724 00:03:44 INFO Running cmd [‘echo “$(hostname)-CVM”‘]
20190724 00:03:44 INFO Running cmd [u’sed -i “s/NTNX-CVM/NTNX-Node-1-CVM/” /root/NTNX-CVM.xml’]
20190724 00:03:44 INFO Running cmd [‘sed -i “//d” /root/NTNX-CVM.xml’]
20190724 00:03:44 INFO Running cmd [‘chmod 644 /var/lib/libvirt/NTNX-CVM/svmboot.iso’]
20190724 00:03:44 INFO Running cmd [‘chown qemu:qemu /var/lib/libvirt/NTNX-CVM/svmboot.iso’]
20190724 00:03:44 INFO Running cmd [‘virsh define /root/NTNX-CVM.xml’]
20190724 00:03:44 INFO Running cmd [‘service libvirtd restart’]
20190724 00:03:44 INFO Running cmd [u’virsh start “NTNX-Node-1-CVM”‘]
20190724 00:03:50 INFO Running cmd [u’virsh autostart “NTNX-Node-1-CVM”‘]

20190724 00:03:50 INFO Running cmd [‘touch /root/firstboot/phases/create_cvm’]
20190724 00:04:14 INFO [1/160] Waiting for CVM to initialize network
20190724 00:04:39 INFO [2/160] Waiting for CVM to initialize network
20190724 00:05:03 INFO [3/160] Waiting for CVM to initialize network
20190724 00:05:27 INFO [4/160] Waiting for CVM to initialize network
20190724 00:05:46 INFO [5/160] Waiting for CVM first boot to create /tmp/svm_boot_succeeded
20190724 00:06:02 INFO [6/160] Waiting for CVM first boot to create /tmp/svm_boot_succeeded
20190724 00:06:18 INFO [7/160] Waiting for CVM first boot to create /tmp/svm_boot_succeeded
20190724 00:06:34 INFO [8/160] Waiting for CVM first boot to create /tmp/svm_boot_succeeded
20190724 00:06:50 INFO [9/160] Waiting for CVM first boot to create /tmp/svm_boot_succeeded
20190724 00:07:07 INFO [10/160] Waiting for CVM to finish first boot
20190724 00:07:23 INFO [11/160] Waiting for CVM to finish first boot
20190724 00:07:40 INFO [12/160] Waiting for CVM to finish first boot
20190724 00:07:57 INFO [13/160] Waiting for CVM to finish first boot
20190724 00:08:14 INFO [14/160] Waiting for CVM to finish first boot
20190724 00:09:33 INFO [15/160] Waiting for CVM to finish first boot
20190724 00:09:34 INFO CVM booted up successfully: CVM booted up successfully
20190724 00:09:34 INFO Running cmd [‘touch /root/firstboot/phases/cvm_firstboot’]
20190724 00:09:34 INFO Last reboot complete: Firstboot successful
20190724 00:09:34 INFO Running cmd [‘touch /root/.firstboot_success’]
20190724 00:09:34 INFO Running cmd [‘service ntpd start’]
20190724 00:09:34 INFO Running cmd [‘/sbin/chkconfig ntpd on’]
20190724 00:09:34 INFO Completed ) @4a10>

Conclusion

Nutanix Foundation tool works on pre-defined instractions to image the node with any supported hyprevisor and take upto 40-50 minutes depends on the hypervisor type to image the node. Nutanix Foundation is fully automated ot install / image / re-image the node. Nutanix releases the new version of Foundation tool in every 3 to 6 months to deliver more robust and to support latest hardware compatibility.