The Great AT Power Shutdown of January 2017

The power to the AT server room will be turned off on 10 January for several hours (IS Alert 6406).
This page is the MPU's To Do list for its AT-based servers.

circle

Test KVM server. MPUcircleDetails. No RPMs to install at boot (it autoreboots) so we simply shut it down, as for waterloo.
To do on Friday:
  • Test the procedure, make sure the VMs are suspended safely and resume safely afterwards: choice-yes
    • ssh circle
    • nsu
    • /sbin/shutdown -P now "circle shutdown for AT power work"
    • ssh consoles
    • console circle
    • Watch it suspend the VMs safely then power off.
    • ssh atconsoles
    • nsu
    • /usr/sbin/conserver-ipmipower circle.bmc on
    • Ensure that the VMs resume properly.
To do at 17:00 on Tuesday:
  • Shut it down
    • ssh circle
    • nsu
    • /sbin/shutdown -P now "circle shutdown for AT power work"
  • Watch it suspend the VMs safely then power off.
    • ssh consoles
    • console circle

To do on Wednesday morning:

  • Power on
    • ssh atconsoles
    • nsu
    • /usr/sbin/conserver-ipmipower circle.bmc on
  • Watch the VMs resuming.
    • ssh consoles
    • console circle

waterloo

KVM server. MPUwaterlooDetails. It doesn't have any RPMs to install at boot, so shouldn't need to do any multiple reboots when powered on after the work has finished, so it should be OK to let it automatically suspend VMs on shutdown and resume them on boot.
To do at 17:00 on Tuesday:
  • Shut it down
    • ssh waterloo
    • nsu
    • /sbin/shutdown -P now "waterloo shutdown for AT power work"
  • Monitor its shutdown:
    • ssh consoles
    • console waterloo
To do on Wednesday morning:
  • Power on waterloo
    • ssh atconsoles
    • nsu
    • /usr/sbin/conserver-ipmipower waterloo.bmc on
  • Watch the VMs resuming.
    • ssh consoles
    • console waterloo

wildcat

Packages cache server and backup PXE server. We'll need to remove it from the cache.pkgs DNS alias before the shutdown.
To do on Monday:
  • Remove wildcat from cache.pkgs choice-yes
    • rfe dns/inf
To do on Tuesday at 17:00:
  • Shut it down:
    • ssh wildcat
    • nsu
    • /sbin/poweroff
  • Monitor its powerdown:
    • ssh consoles
    • console wildcat
To do on Wednesday morning:
  • Power it on:
    • ssh atconsoles
    • nsu
    • /usr/sbin/conserver-ipmipower wildcat.bmc on
  • Watch it booting:
    • ssh consoles
    • console wildcat
  • Restore it to cache.pkgs
    • rfe dns/inf

schiff

SSH server ssh.inf.ed.ac.uk and student.ssh.inf.ed.ac.uk. It doesn't have any RPMs to install at boot, so it should come straight back up when powered on on Wednesday.
To do at 17:00 on Tuesday:
  • Start the shutdown
    • ssh schiff
    • nsu
    • /sbin/shutdown -P 17:30 "ssh server shutting down for AT power work, back tomorrow morning, staff+PGs please use staff.ssh.inf.ed.ac.uk"
  • Monitor its shutdown:
    • ssh consoles
    • console schiff
To do on Wednesday morning:
  • Power on
    • ssh atconsoles
    • nsu
    • /usr/sbin/conserver-ipmipower schiff.bmc on
  • Watch it booting
    • ssh consoles
    • console schiff

piccadilly

NX server nx.inf.ed.ac.uk. It doesn't have any RPMs to install at boot, so it should come straight back up when powered on on Wednesday.
To do at 17:00 on Tuesday:
  • Start the shutdown
    • ssh nx
    • nsu
    • /sbin/shutdown -P 17:30 "NX server shutting down for AT power work, back tomorrow morning, staff+PGs please use staff.nx.inf.ed.ac.uk"
  • Monitor its shutdown:
    • ssh consoles
    • console piccadilly
To do on Wednesday morning:
  • Power on
    • ssh atconsoles
    • nsu
    • /usr/sbin/conserver-ipmipower piccadilly.bmc on
  • Watch it booting
    • ssh consoles
    • console piccadilly
Edit | Attach | Print version | History: r6 < r5 < r4 < r3 < r2 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r3 - 09 Jan 2017 - 11:45:49 - ChrisCooke
 
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback
This Wiki uses Cookies