network downtime 6/3/04 (completed)

[GatorBrent]

The entire datacenter was offline today for a brief period. The below message is their official news about the incident.

Network Event Report

June 3, 2004

Summary: This afternoon at approximately 6:20pm CDT, We experienced an issue with our DWDM system between Equinix and DLLSTX2. Engineers were bringing up a new wavelength on the system, and when the wavelength was enabled all circuits across the system lost continuity. The transport system reported no errors even though all circuits being transported across the system were showing down on the terminating equipment. Engineers disabled the new wavelength once the problem was detected, and network connectivity across the transport system was restored at 6:27pm CDT.

Future Mitigation: Engineers are working with the DWDM system vendor to determine the root cause of the problem. If future work is required that could cause downtime, we will make every effort to notify all customers at least 72 hours before the work is performed.