gator1482 :: Emergency FSCK

[GatorRyanP]

Team,

Gator1482 will be coming down immediately for a fsck of /home. We do apologize for the frustrations and inconveniences, however this must be done to ensure the integrity of the data in the array.

We do not have an ETA at this time. We will update this thread accordingly once we have more information.

As always, we thank you for your patience during this time

[GatorRyanP]

At this time the fsck is now 52% complete and coming along nicely.

[GatorJacob]

Hello,

The fsck is still ongoing at this time. I do apologize that we had to bring down this server during peak hours, however this must be done to ensure the integrity of the data on this home partition.

We will continue updating this thread with more information as it becomes available.

Thank you for your patience during this time.

[GatorJacob]

Hello,

At this time we are still within the first pass on this forum. I do apologize that this is taking so long. Unfortunately this inode map seems to be corrupted and the fsck is taking a while to correct it.

We will continue updating this thread with more information as we get it.

[GatorJacob]

At this time the fsck has finished and the partitions are reporting clean.

We are rebooting the box into it's normal run level where we will then assess the file system.

If there are any further complications we will update this thread with such.

[GatorBLeake]

Unfortunately, one of the hard disks on this server has begun throwing errors. We are having the datacenter swap the drive, and will have the RAID begin rebuilding itself as fast as possible.

In order to ensure the integrity of our customer's data on the array, we will be taking down resource intensive services like Apache and MySQL. We sincerely apologize for any inconvenience.

Once the rebuild has completed, we will swap the RAID controller in the box in an effort to prevent further issues.

Once again, we are very grateful for your patience during these problems on the box.

[GatorBLeake]

Due to unforseeable issues with procuring hardware, the rebuild has been slightly delayed. The rebuild is currently a quarter complete; we project that it will complete in a few hours. Again, once the rebuild is complete, the RAID controller will be swapped.

Again, we thank you for your patience during this time.

[GatorBLeake]

The RAID rebuild is still in progress on this box. However, we have discovered other faults with the hardware during the rebuild. It is going down for an emergency chassis swap. The RAID rebuild will restart once the chassis swap is complete.

While the swap should not take too long, we cannot offer an ETA until the issues with this server are completely resolved. We again apologize for any inconvenience, and thank you for your patience.

[GatorKevinS]

We thank you for your patience while we performed the necessary maintenance on gator1482. The maintenance is now complete and the server is back online.