supra.websitewelcome.com 6/28/04 outage

[GatorBrent]

The below was emailed out to most people on supra about the current downtime.

"We are emailing you to inform of a current outage on your server supra.websitewelcome.com 3w-xxxx: scsi0: AEN: WARNING: Sector repair occurred: Port #0. 3w-xxxx: scsi0: AEN: WARNING: Sector repair occurred: Port #0. 3w-xxxx: scsi0: AEN: WARNING: Sector repair occurred: Port #0. 3w-xxxx: scsi0: AEN: WARNING: ATA port timeout: Port #0. 3w-xxxx: scsi0: AEN: ERROR: Unit degraded: Unit #0. One of the server’s hard drives was having corruption and had to be pulled a few minutes ago for an emergency hd swap. The server is setup on raid1 which is a 2nd hard drive mirrored. This mirror means no data should be lost. The bad hard drive was replaced with a good one and now the mirror is rebuilding what's called an array. This rebuild should be done shortly, and your sites back online. We are sorry for the lack of warning, but we feared if we delayed this any further all data could be lost. We will send another email out with further news when we have it. Thank you for your patience! Sincerely, Brent Oxley "

[GatorBrent]

"there have been no appends to the log since starting, which is good. just wanted to let you know it is still rebuilding. once complete. I'll verify the RAID, and put it back online. "


Everthing is going smooth so far.

[Trinity31]

Thank you for the information!

[onsite]

Thanks for posting this. My sites are down and I would not have gotten e-mail becasue it's on the server. So thanks for posting again.

[GatorBrent]

For those of you wondering what the worst feeling in the world for a webhost is here it is below....

jstewart-06/28/04-13:46):
the first attempt starting failing, so i have replaced the drive (port 0). it is running the RAID rebuild again.


A few minutes later when all hope was lost we get the below message.

------------------------------------------
(jstewart-06/28/04-14:05):
your machine is online


The rebuild seems to have gone flawlessly and everyone is back online!!! Why did we receive the doomsday message? Who knows, but we sure are feeling better. =)

This should also fix a lot of issues that have been taking place on supra from the corruption.

The server might be slower then usual for a little while during it's catchup from being down so long.

[Thomas]

Thank You!