Platform-specific documentation/HP DL3N0

  • Lights Out Manager: HP iLO 4
  • Model(s): HP DL3N0 series servers
  • HP DL360
  • HP DL380

Lights Out Management

The SSH implementation on the remote management interfaces only supports legacy SSH. When using a current openssh release you'll likely need to explicitly enable a key exchange algorithm supported by iLO, e.g.

 ssh -oKeyAlgorithms=+diffie-hellman-group14-sha1 HOST
 -or-
 ssh -oKexAlgorithms=diffie-hellman-group14-sha1 HOST
 -or-
 ssh -oKexAlgorithms=diffie-hellman-group14-sha1 -c 3des-cbc HOST

Common Actions

Reboot and boot from network then console

These boxes take ages to boot, so it will look like it's hanging when you connect to the serial console. Give it a few minutes (it takes 4-5 minutes just to get some screen feedback).

set /system1/bootconfig1/bootsource5 bootorder=1
power reset
VSP

(That will leave it netbooting forever. So at some point, return to ilo and

set /system1/bootconfig1/bootsource5 bootorder=5

Note: this is only true if BootFmDisk is bootsource5. Some newer hardware may only have 4 bootsources:

   bootsource2=BootFmDisk      bootorder=1
   bootsource1=BootFmCd        bootorder=2
   bootsource3=BootFmUSBKey    bootorder=3
   bootsource4=BootFmNetwork1   bootorder=4

In this case the command would be

set /system1/bootconfig1/bootsource2 bootorder=1

Get console

   vsp

or

   start /system1/oemhp_vsp1

Reset Virtual Serial port

Should the message

   Virtual Serial Port is currently in use by another session.

be returned and you know you are not killing someone's else working session, issue

   stop /system1/oemhp_vsp1

Reboot and boot into BIOS then console

Connecting to mgmt interface

  • Via SSH
  • ssh root@servername.mgmt.datacenter.wmnet
  • Example: ssh root@bast1001.mgmt.eqiad.wmnet
  • Via Browser
  • Please note you will have to override an unknown (self signed) certificate, you won't want to save it permanently, as a few of these saved tends to result in errors connecting to other Dell DRAC interfaces via HTTPS.

Connecting to Serial Console

  • Attach to the serial console: vsp
  • Detach from serial console: esc+(
  • BIOS Serial Console Boot Keys:
  • ESC+9 for ROM
  • ESC+0 for Intelligent Provisioning
  • ESC+! for Default Boot Override Options
  • ESC+@ for Network Boot
  • Crash Cart Boot Keys:
  • F9 for ROM-Based Setup Utility
  • F10 for Intelligent Provisioning
  • F11 for Default Boot Override Options
  • F12 for Network Boot

Power cycling

  • Login to the iLO command line interface.
  • Power commands are as follows:
  • power -- Displays the current server power state
  • power on -- Turns the server on
  • power off -- Turns the server off
  • power off hard -- Force the server off using press and hold
  • power reset -- Reset the server

Administrative Actions

Polling for MAC Address

  • Login to iLO command line interface.
  • Run: show system1/network1/Integrated_NICs

Changing iLO User Password

Changing the iLO Network IP Settings

Enable / Disable IPMI over iLO

Setting a one-time boot option

Get MAC address

   show /system1/network1/Integrated_NICs

Unless we are bonding, only the first NIC is used. So the first NIC as reported by ILO should be the one that is plugged.

Disable PCI device

 rbsu> SHOW PCI DEVICE ENABLE/DISABLE 
 rbsu> SET PCI DEVICE ENABLE/DISABLE <entrynum> 0

Enable/Disable Hyperthreading

 rbsu> SHOW CONFIG INTEL(R) HYPERTHREADING OPTIONS
 Intel(R) Hyperthreading Options
 1|Enabled <=
 2|Disabled
 
 rbsu> SET CONFIG INTEL(R) HYPERTHREADING OPTIONS 2
 Intel(R) Hyperthreading Options
 1|Enabled
 2|Disabled <=

Show system event log entries

While at the ILO console:

 # show all recorded entries
 show /system1/log1
 # show a particular entry
 show /system1/log1/record15

Initial System Setup

HP's require F9 to get to BIOS

System Options

Checklist for BIOS settings on HP systems:

  • boot to system setup utilities (F9 on post)
  • Check the following settings in the System Settings > System Configuration > Bios/Platform Configuration (RBSU):
    • System Options > Serial Port Options > Virtual Serial Port : COM 2
    • System Options > USB Options > Internal SD Card Slot : Disabled
    • Processor Options > Intel(R) Hyper-Threading : Enabled
    • Virtualization Options : Disabled on EVERYTHING unless it is a cloudvirt or ganeti server (those are enabled on everything.)
    • Boot Options > Boot Mode : Legacy BIOS Mode
    • Legacy BIOS Boot Order > Standard Boot Order (IPL) : Hard drive is located ahead of network port.
    • Network Options > Network Boot Options : Ensure only the active/primary ethernet port is set to Network Boot and the other ports set to Disabled. (This does NOT disable the port, ONLY disables it attempting to network boot.)
    • Save settings, go back to the System Configuration main menu.
  • If systems have hardware raid, select the embedded raid controller on the System Configuration Screen and setup the raid.
    • Differing systems have differing raid requirements, please see the individual system setup tasks for details on the raid levels.

Setting Management Network Settings

During Post hit F8 to get to ILO (moves slow)

  • Under Network
  • DHCP/DNS Setting
  • Disable DHCP by pressing space bar and ensuring it says OFF hit f10
  • NIC and TCP/IP
  • Enter IP/Subnet/Gateway
  • Under User
  • edit and change Administrator to root
        user name root
        login name root
        password  mgmt password
  • Ensure all iLO privileges are marked yes
  • File
  • Exit and iLO will reset

RAID controller firmware upgrade

Upgrading RAID controller firmware is relatively straightforward and as of Jan 2019 hasn't posed issues, see also bug T141756 for more context.

This guide assumes one of the common controllers we have deployed on the fleet, usually P840.

 version=ea3138d8e8-6.88-1.1
 cd /tmp
 curl apt.wikimedia.org/firmware/firmware-smartarray-${version}.x86_64.tgz | tar zxv
 sudo ./usr/lib/x86_64-linux-gnu/firmware-smartarray-${version}/setup