regal problems

joecoollof · #1 01-15-2008, 11:13 AM

Since yesterday regal has been having problems. I have gotten mixed messages from support. I have been told it was a load issue and at another time that it was a drive issue (I am familiar with the thread in here about the drive replacement last night). I just received an email saying the rebuild caused load issues and is rescheduled for tonight but it should be working just slow.

At this moment pop is in a failed state.

Can someone explain to me what the real problem is and when it is expected to be resolved?

Thanks.

***GatorDaveC*** · #2 01-15-2008, 05:29 PM

One of the drives in the server was failing which needed to be replaced. The rebuild process causes high disk IO, and during the rebuild caching is also disabled which can cause high IO.

At this time we have paused the array rebuild, and will continue around 10PM tonight. I've made sure the rebuild priority has been set a bit lower as well.

There aren't really any issues with the server at this time, but its possible that the IO may have knocked out POP.

joecoollof · #3 01-15-2008, 06:54 PM

Thank you for the response and clarification. Between email and live chat I have been getting mixed information all day.

The pop service has been on and off many times all day but has gotten better over the last couple hours.

I have been getting complaints all day, as I am sure you have even more so. The most frustrating part of this was that I did not have a clear, definitive answer for them and it seemed that everyone I spoke with at HostGator was giving me different answers. Even worse I would be told that it is "all set now" or "will be resolved shortly" only to have it continue to reoccur.

I am looking forward to this not happening tomorrow.

Thanks!

joecoollof · #4 01-16-2008, 04:56 PM

still having problems today.

joecoollof · #5 01-16-2008, 04:56 PM

...although not as bad it was yesterday.

***GatorDaveC*** · #6 01-16-2008, 05:08 PM

I've ensured that the rebuild rate is at a lower priority.

---
./tw_cli set rebuild c0 5
Setting Rebuild Rate on /c0 to 5 (Fastest I/O)...Done.
---

Of course there will be higher IO then usual since the array is rebuilding and cache is off, but it shouldn't be that bad.

joecoollof · #7 01-16-2008, 05:25 PM

oh, its still rebuilding? How long is it going to take?

***GatorDaveC*** · #8 01-16-2008, 05:27 PM

Well the rebuild was paused because of high IO on the server. I resumed it just now.

Usually a rebuild takes about 24 hours. The rebuild rate is at a lower priority to avoid high IO, it looks like the load is pretty stable at the moment.

joecoollof · #9 01-16-2008, 05:42 PM

Thank you for the speedy update!!