Ticket #1588 (closed outage: fixed)

Opened 5 years ago

Last modified 5 years ago

Kernel Upgrade / Reboot for servers

Reported by: smooge Owned by: smooge
Priority: critical Milestone:
Component: Systems Version:
Severity: High Keywords: Meeting
Cc: toshio, skvidal Blocked By:
Blocking: Sensitive:

Description

There have been several kernel updates since our last reboot and they fix various security issues we would like not to see.

We (ricky, abadger1999, skvidal, and some others) will reboot the systems on Thursday August 13, 2009 starting at 18:00 UTC. This will allow for 2 hours before the next infrastructure meeting to record any sky is falling events.

Order of systems will be determined at time of reboots.

Change History

comment:1 Changed 5 years ago by smooge

  • Keywords Meeting added

comment:2 Changed 5 years ago by ricky

  • Cc toshio, skvidal added

There is an initial checklist of machines to update in the "2009-08-13 Update" document in gobby - we can hopefully use that to track where we are and check things off as we go.

comment:3 Changed 5 years ago by smooge

  • Status changed from new to assigned

Systems were updated and rebooted according to schedule. Some lessons learned were that:

1) Check with releng that a system is in their critical fix. 2) Move critical systems to iscsi so they can be dropped on one and brought up on another. 3) Update/rebuild system puppet1 is FIRST (eg puppets xen hardware, other xen guests) 4) Update/rebuild database servers NEXT so logins etc work 5) Do non-local systems Next. 6) Keep going.

comment:4 Changed 5 years ago by smooge

  • Resolution set to fixed
  • Status changed from assigned to closed
Note: See TracTickets for help on using tickets.