Status

This page is updated manually with status of current and recent (30ish days) events.

(Times are US/Arizona UTC-7)

Current status is: Green: I am completely operational, and all my circuits are functioning perfectly normally.

20211019 @11:17PM – Successful upgrade. Love it when a plan comes together.

20211019 @11:12PM – We’ll be upgrading a couple of servers in Quebec tonight. Estimated downtime will be 10 minutes. 

20211014 @7:26PM – Provider changed the physical switch port for our uplink. Link is 100% functional now. 

020211014 @6:55PM – Our low-traffic mostly backup network interface in Phoenix is having packet loss. Ticket is in to the bandwidth provider to troubleshoot.

20211013 @1:43AM -Everything is up and OVH network is looking stable – our snuck in reboots were successful. 

20211013 @1:28AM – Network is coming back up in patches, not yet stable. Might sneak in some reboots on servers up longer than 180 days.

20211013 @12:34AM – Their planned maintenance to do a software update on their routers went wrong. No ETA yet, but unlikely to be a multi-hour event. 

20211013 @12:28AM – Our Quebec sites are offline from our Arizona and San Jose testing locations. Not sure of details yet. More as we know. Will be contacting our vendor as soon as I save this status.

20210926 @2PM – Our VoIP provider (voip.ms) and their security vendors were able to get the DDoS thwarted. Phones are back online,

20210919 All day – Our VoIP provider has been under a constant attack for days and service is degraded to the point of uselessness. Follow their status here: https://twitter.com/voipms

Status key with examples:

Green: I am completely operational, and all my circuits are functioning perfectly normally.

AMBER: External network issues or planned maintenance

RED: Server down or critical bug/security flaw needing immediate fix

Magenta – a non-core web service is down, but not a critical emergency.