Status

This page is updated manually with status of current and recent (30ish days) events.

(Times are US/Arizona UTC-7)

Current status is: Green: I am completely operational, and all my circuits are functioning perfectly normally.

20180508 @ 11:22PM – Second and final round of updates for tonight done. Servers were down for just under 9 minutes.

20180508 @ 10:45PM – First round done. Servers in that batch were down for < 5 min.

20180508 @ 10:30PM – We’re doing a quick round of reboots to install security updates on a few Quebec web servers. Estimated downtime is 10-15 minutes.

20180501 @ 12:27AM – Gotta love when everything goes well. Actual downtime was 4 minutes.

20180501 @ 12:22AM – We’re doing a quick round of reboots to install security updates on a few Phoenix web servers and one of our routers. Estimated downtime is 10-15 minutes.

20180429 @11:32 PM – Back up after fixing backups, rebooting, doing updates, and rebooting. Ready for the week.

20180429 @11:10PM – One Phoenix server hung during reboots. We’re resetting it, then will do some needed security updates, and a more planned reboot. Estimated downtime (including unplanned) will be 20 minutes.

20180427 @ 10:25AM – We noticed our phone system wasn’t working. It came back after being updated and restarted.

20180415 @ 10:32AM – Rebooted some of the servers last night to change a security setting which was impacting performance.

20180414 @11:52PM – Affected servers rebooted without incident. We’ll be rebooting all servers over the next week or so.

20180414 @11:48PM – Doing some needed security reboots. Downtime shouldn’t be more than 10 minutes.

20180411 @1:45AM – One server in Quebec hung during backups. We forced a reboot and successfully reran the backup.

Green: I am completely operational, and all my circuits are functioning perfectly normally.

AMBER: External network issues.

RED: Zombie Apocalypse

Magenta – a service is down, but not really an emergency.