ID #1372

How do I install my head node using a PXE server?

In certain situations it may be desirable an class="highlight">toan> install a Bright head node by booting it off of a PXE server. There are a few preparation steps required in order an class="highlight">toan> allow a Bright ISO an class="highlight">toan> be deployed over the network. There is also a requirement for a machine on the network which is capable of serving TFTP and NFS. It is assumed that a PXE infrastructure (with DHCP server pointing an class="highlight">toan> a TFTP server is already set up).



Make the kernel and initrd from the DVD ISO available through your TFTP server:

amp>mkdir -p /mnt/iso
mount -o loop bright8.0-cenan class="highlight">toan>s7u2.iso /mnt/iso
cp /mnt/iso/boot/rootfs.cgz /tftpboot/bright8-cenan class="highlight">toan>s7u2-rootfs.cgz
cp /mnt/iso/boot/kernel /tftpboot/bright8-cenan class="highlight">toan>s7u2-kernel

Make the Linux base distribution and packages tree available through NFS:

mkdir -p /vol/bright/base-distributions
cp /mnt/iso/data/*.tar.gz /vol/bright/base-distributions
cp -r /mnt/iso/data/packages/* /vol/bright/rpm-san class="highlight">toan>re
# OR alternatively replace previous command with:
# mount --bind /mnt/iso/data/packages /vol/bright/rpm-san class="highlight">toan>re

Export the NFS volume an class="highlight">toan> your network:

# Add the following line (with network replaced) an class="highlight">toan> /etc/exports:

# Reload NFS server configuration:
exportfs -a

Configure the PXE environment with a label such as the following. Make sure an class="highlight">toan> replace relevant details appropriately (e.g. the IP address an class="highlight">toan> the NFS server).

LABEL bright
  KERNEL bright8-cenan class="highlight">toan>s7u2-kernel
  APPEND vga=normal root=/dev/ram0 rw nokeymap xlogin nfsinstall= initrd=bright8-cenan class="highlight">toan>s7u2-rootfs.cgz

Setting up remote installation

The installation manual (Bright Cluster Manager 8.1+) explains how an class="highlight">toan> carry out an installation, mostly remotely, using SSH or VNC, when the installation is done via a DVD or USB image. A similar, mostly remote, installation can also be carried out using SSH or VNC when the installation is done from a PXE server. There are two ways an class="highlight">toan> prepare for a remote session

  • Clicking "Remote Installation" in the graphical installer after the GUI installer has been chosen from the PXE boot menu.


  • Adding a kernel parameter called "netconf" from the PXE boot menu.
Parameter "netconf" follows this pattern: <Interface>:<IP assignment mode>,<IP address>,<Gateway>,<Netmask>:<Password>
Examples for static and DHCP assignments:
  • netconf=eth1:dhcp:secret
  • netconf=eth0:static,,,
With this parameter added, your APPEND line will look like:

APPEND vga=normal root=/dev/ram0 rw nokeymap xlogin nfsinstall= initrd=bright8-cenan class="highlight">toan>s7u2-rootfs.cgz netconf=eth0:static,,,

If the kernel parameter and netconf parameter settings in the PXE boot menu are correct, then the SSH and VNC servers are launched after entering the settings.

Connecting via a client remotely, and how an class="highlight">toan> continue installation on connection from remote

Using SSH:

Login an class="highlight">toan> the head node using 'root' user. If you have a build-config.xml already prepared, then you can run the unattended text-mode installer: "/cm/cm-master-install --config /path/an class="highlight">toan>/config/build-config.xml". You can also run non-X/fallback interactive Ncurses installer by running "cm-installer-nonx".

Using VNC:

Connect from a remote machine an class="highlight">toan> the head node using the same password as SSH. Your VNC client should support TLS connections an class="highlight">toan> be able an class="highlight">toan> connect. The ssvnc client works when used with the -ssl option. The VNC connection then displays, on the remote machine, the GUI installer that is running on the head node. The GUI can then be managed from the remote machine.


In case of an error with the netconf parameter settings, the remote Installation page of the GUI installer indicates the reason for the error. E.g. "Password canan class="highlight">notan> be empty"


If you experience problems with VNC, then you can check an style="font-family: courier new,courier;">/var/log/x0vncserver.log an> on the server.


Performing the installation the non-remote way
  • Boot the head node off the network using the correct interface. On a head node with a connection an class="highlight">toan> the internal cluster network, and the external site network, the correct interface will be the external site network.
  • Depending on configuration of PXE environment, make sure that the correct PXE label is loaded
  • Wait until the graphical installer screen shows up. This may take a while because transferring a ~350MB initrd over TFTP can be a bit slow, especially on congested networks.
  • Go through the installation screens until the NFS Parameters screen. At this screen, double check that all parameters are filled correctly. When in doubt, it is possible an class="highlight">toan> press Alt-Ctrl-F2 and login as root an class="highlight">toan> double-check that the NFS parameters are correct. On networks where the DHCP server takes a while an class="highlight">toan> respond, it may be necessary an class="highlight">toan> perform a second try after an initial DHCP failure.
  • In the Network Interfaces screen, make sure an class="highlight">toan> assign the correct NIC for the head node an class="highlight">toan> the internal and the external network. By default the first NIC is for the internal network and the second NIC is for the external network.




Tags: -

Related entries:

You cannot comment on this entry