Infrastructure:Incident 2015-04-23: Difference between revisions

imported>Telnoratti
No edit summary
 
(9 intermediate revisions by 4 users not shown)
Line 5: Line 5:
** This is a club of Linux users, someone should step up!
** This is a club of Linux users, someone should step up!
* Lack of a disaster recovery plan.
* Lack of a disaster recovery plan.
* Undocumented systems with several different iterations of init scripts none of which were removed and many broken packages that were unused


Some steps that should be taken to reduce the length and impact of future outages include:
Some steps that should be taken to reduce the length and impact of future outages include:
* Rebuild VMs like [[Infrastructure:milton|milton]], which have had too much maintenance deferred, and move them to cyberdelia.
* Rebuild VMs like [[Infrastructure:Milton|milton]], which have had too much maintenance deferred, and move them to [[Infrastructure:Cyberdelia|cyberdelia]].
* Install NTP on all servers.
* Install NTP on all servers.
* Find a dedicated sysadmin.
* Find a dedicated sysadmin.
* Create a disaster recovery plan.
* Create a disaster recovery plan.
* Reduce services to match maintenance capabilities
[[Category:Incidents]]