The incident is now resolved and all services are back online.
Post Mortem:
At 4:52pm, our network operations were notified that there was an issue at our core site 220Q. Cloud services had failed and the ISP network was failing to authenticate users.
An immediate response was launched. Due to failure to authenticate, all users timed out and disconnected at 5:08pm.
At 5:22pm, a technician was dispatched to 220Q to investigate. At 5:37pm the technician arrived and ascertained that a PDU (power distribution unit) had failed, powering multiple levels of networking equipment.
At 5:41pm, the devices were swapped to an alternate PDU. All devices started to come back online, and by 5:45pm, the entire network was considered restored.
Further restorative actions will take place during the week, after hours to ensure that a new PDU is put in place on multiple power feeds.
This case is now closed. The outage lasted 53 minutes. If you have any further questions or queries, please phone 0508-100-200.