Gator245 Disk issues

#1 04-02-2008, 10:33 AM

Shared server Gator245 is currently off line undergoing a file system repair. The automatic repair failed and we are addressing this manually. I will update this thread as updates are available.

***GatorBrent*** · #2 04-02-2008, 11:54 AM

All data on the server is corrupted. We have no choice but to do a full restore from backups. This isn't going to be quick with best case scenario being in the three hour range.

I can't even remember the last time this happened on a server it's so rare. I'll get you guys updated when I have more information.

sms4smil · #3 04-02-2008, 12:41 PM

How long is it going to take? I'm facing trouble since 5:00 PM (Pakistan time)

***GatorDaveC*** · #4 04-02-2008, 01:27 PM

The backups we have are from late March 30th. I'm working as fast as possible to get this server up and running. The new chassis has been up and running for about an hour. The backed up data is currently being moved to the new server at this time.

Kat9119 · #5 04-02-2008, 02:04 PM

How do I know which server I am on? My sites have been down for a few hours as well, and I'm just wondering if its on this server perhaps

Sam · #6 04-02-2008, 02:08 PM

Quote:

Originally Posted by Kat9119

How do I know which server I am on? My sites have been down for a few hours as well, and I'm just wondering if its on this server perhaps

If you post your domain name, i'm sure someone will tell you

Kat9119 · #7 04-02-2008, 02:16 PM

I'd rather not publicly...but I found out from live chat...and yup, I'm on this server. Bummer!

LifeIncome · #8 04-02-2008, 02:29 PM

Hey,

I lost about 14 mhrs of data/work.

It could have been worse.

It could have happened on Saturday.

-Steve
PS: If you dont have CPSiteSaver I recommend
getting it. If you don't know about it,....it saves
your data from the server to your hard drive.

Luckily, we do our backups, but Gator's got the
more recent one for us

sms4smil · #9 04-02-2008, 02:59 PM

More than 3 hours from the initial post and I am still waiting for my website to be up ?

Taking into the account of the backup date "March 30th." I suspect big loss for my site. most probably more than 24 hours of man hours and several user feedback data, how will it get compensated?

and how about the 99.9% uptime guarantee?

In addition to manhour loss, I assume that more than 10,000 users would have been bounced with an error of my site unreachable.

elibogh · #10 04-02-2008, 03:15 PM

Hello, I'm one of those affected. Is there any kind of timeframe on when we can expect our sites to be back up and running??

sms4smil · #11 04-02-2008, 03:17 PM

the timeframe given earlier was minimum of 3 hours, and no maximum time specified...........I feel myself kinda helpless.....

How are you feeling, what is your website about ?

Regards,

Najam

MichaelHensley · #12 04-02-2008, 03:35 PM

99.9% uptime means they can be down over 8 hours per year. That's why professional organizations talk bout FIVE 9's (99.999% uptime), not THREE 9s.

Kat9119 · #13 04-02-2008, 04:00 PM

Well, now I get a 404 error. I suppose thats something right...

nulld · #14 04-02-2008, 04:34 PM

so does this mean that any new mail that has been sent to us today has been lost?

i am also on this server as well, and like the rest of you dealing with a major loss on multiple sites right now. not fun. also, i not a fan of the 404 error page showing up on my sites either, very unprofessional- id rather have it not connect at all... lol

***GatorDaveC*** · #15 04-02-2008, 04:48 PM

The data from /home is still extracting which contains the user home direcotires (public_html, mail etc..). SQL and everything else has been done for hours. Due to the amount of data in /home its going to take a couple more hours to get everything up and running.

MichaelHensley · #16 04-02-2008, 04:53 PM

nulld:

You haven't quite realized how bad it is yet. They only do backups once a week. All email sent since SUNDAY has been lost.

Email sent since the server went down this morning MAY be re-delivered, depending on how the sending server is configured.

LifeIncome · #17 04-02-2008, 05:00 PM

GatorDaveC,

.....that was a good point made earlier about your error page.

It would be nice of you folks to put in a statement that it
is not due to anything we as users of your service have done.

As it reads now,........a unique viewer (pick your # 1-x....) would think that
the person who owns the site did something wrong.

Thus, i or we would lose face.

-steve

nulld · #18 04-02-2008, 05:02 PM

good god, and now "Due to the amount of data in /home its going to take a couple more hours to get everything up and running"

sounds like they'll hit the 8 hour mark fairly soon here... how exactly will we be compensated?

nice... that error page is gone

***GatorDaveC*** · #19 04-02-2008, 05:03 PM

The restore on /home is about 3/4 of the way done at this time. We are restoring the data as quickly as possible.

***GatorDaveC*** · #20 04-02-2008, 05:04 PM

Quote:

Originally Posted by LifeIncome

GatorDaveC,

.....that was a good point made earlier about your error page.

It would be nice of you folks to put in a statement that it
is not due to anything we as users of your service have done.

As it reads now,........a unique viewer (pick your # 1-x....) would think that
the person who owns the site did something wrong.

Thus, i or we would lose face.

-steve

I have changed the 404 to the standard Apache 404 page. I agree with you.

***GatorDaveC*** · #21 04-02-2008, 05:29 PM

All the accounts that were backed up on the weekend have been restored at this time. I am going to continue to investigate the old drives to see if I can get any other data back.

elibogh · #22 04-02-2008, 05:40 PM

Quote:

Originally Posted by GatorDaveC

All the accounts that were backed up on the weekend have been restored at this time. I am going to continue to investigate the old drives to see if I can get any other data back.

So, as mine are not back up...this means that my sites were not backed up???

...and for the sites that weren't backed up over the weekend...will those be able to be recovered? AND why wasn't everything backed up? How do you choose what to back up and what not to? Why isn't everything backed up? That doesn't make sense to me.

nulld · #23 04-02-2008, 05:54 PM

wow. so my sites arent up yet... after a quick live chat, i am told this:

"Okay, unfortunately a backup from Sunday was not created due to your account being over its inode limit."

so i ask when was the last backup?

"Old backups are deleted every Sunday."

so there is nothing backed up?

"I'm afraid not."

this is definitely something you never want to hear. what in the hell do i do now? i have my own nightly backups of my databases, but im going to have to dig for hours/days for the thousands of files.

any comment or advise on this? yes i realize i should have backed up my files more often.

elibogh · #24 04-02-2008, 05:56 PM

Quote:

Originally Posted by nulld

"Okay, unfortunately a backup from Sunday was not created due to your account being over its inode limit."

Well, I'm assuming this goes for me as well....now WTF is an "inode limit"??

nulld · #25 04-02-2008, 06:02 PM

im pretty sure it is something along the lines of a file limit... like you cant have over 50,000 files or something.

from hostgator terms of service:

"7b.) INODES
The use of more than 50,000 inodes on any shared account may potentially result in suspension. Accounts found to be exceeding the 50,000 inode limit will automatically be removed from our backup system to avoid overusage. Every file on your account uses up 1 inode.

Simply exceeding the limit does not constitute grounds for suspension however accounts that constantly create and delete large numbers of files on a regular basis or causing file system damage may cause your account to be flagged for review."

i'd like to know when i reached their limit and when they stopped backing up my data.

how are customers supposed to know when they have exceeded their inode limit?