Downtime info updates

[abstraktMedia]

Hi guys,

it would be nice if you could update the forums with outage infos. Yesterday Hummer (mysql connection) was down for almost 3 hours. As of now it's down for almost an hour already. I'm not use to HG not updating/informing us about such big issues/downtime...

[GatorJacob]

Hello,

This is something that we normally do, however the monitoring team and I were un-aware of any issues with hummer yesterday. I'm looking into this more now.

Do you have a ticket by any chance? If you do, can you PM me the ticket ID?

Thanks!

[abstraktMedia]

chat IDs 3054602 and 3054907

No I don't have a ticket per se as I was talking to support via live chat every hour (Tyler, Zach and someone else). Today it was Stephen and someone else- Basicly the downtime was same as yesterday (cca 3 hours)..from 5 Am till 8 AM (your time). I suspected some cron job or crawler because it started at the same time (almost same minute) and I got answer from LIVE support that it was MSN crawler (at least for today)...basicly our webshops were not accesible from 12:00 AM till 15:00 (our time) which is middle of a bussiness day :/

[GatorJacob]

Originally Posted by abstraktMedia

chat IDs 3054602 and 3054907

No I don't have a ticket per se as I was talking to support via live chat every hour (Tyler, Zach and someone else). Today it was Stephen and someone else- Basicly the downtime was same as yesterday (cca 3 hours)..from 5 Am till 8 AM (your time). I suspected some cron job or crawler because it started at the same time (almost same minute) and I got answer from LIVE support that it was MSN crawler (at least for today)...basicly our webshops were not accesible from 12:00 AM till 15:00 (our time) which is middle of a bussiness day :/

Hello,

I apologize for the inconveniences and the frustrations. I've spoken with the monitoring team about this server. This morning we were being hit by the crawlers again. Our administrator management tried different things before completely blocking the bad-bot. While this shouldn't have taken 3 hours, it did. I do apologize that your sites were down during your peak hours.

We're making changes so that this won't happen anymore. I'm also writing up a ticket to you as well, so please be on the lookout for that.

[abstraktMedia]

Hi Jacob,

thanx..got the ticket..we can continue via tickets..

just my $0.02 on this matter...If it is MSN bot be careful with blocking all of his IP's because the blockage can have impact on the MSN (ok not so important) and yahoo search engine positions for the pages on that server.we had the same problem but we allowed only few of his IP's to go thru and index what they need. I don't know why sometimes MSN bots don't "listen" to robots.txt instructions. On the other hand I had that problem in 2009 and I can't believe they (MS) didn't fix that yet...

[GatorJacob]

Hello,

The weird issue here is that 'MSNBot 2.0b' was retired in November, and replaced with the BingBot. It looks like they brought MSNBot back online and it's not listening to any robots.txt we put in. We've been in contact with an Engineer on the BingBot team, however they haven't been much help

[abstraktMedia]

as expected :/ today it was the same...3h downtime again - and again at the same time.. and again HG support is silent about it..today even the chat support was just horrible...I waited 25 minutes for "checking one moment please"..then I got fed up and closed the chat window....is this going to be an everyday thing now?should I notice my cutomers that the server is "closed" every day from 12:00 to 15:00!?? :/

[chaloupe]

Was it again only the MySQL service that was not running?

[abstraktMedia]

yes it was...

actually I was not at the comp today but judging from customers the messages were the same (too many connections to mysql)...

[WEG0508]

Originally Posted by chaloupe

Was it again only the MySQL service that was not running?

Seems that MySQL was running. The question is was it a situation of too many connections system-wide or was it too many connections for this particular site?

Previously from what I could see it appeared that the maximum number of connections system wide was 100 which was the MySQL installation default. Now it appears to be 150 which is the current MySQL installation default.

Other hosts I use typical are either 400 or 500. One of HG's competitors was at 400 maximum system-wide connections several years ago and still uses that figure for their reseller servers.

The attached image shows statistics for a machine with the system-wide value set at 500. My Hostgator server is set at 100 and is averaging 1000 queries per second as opposed to 31 per second (max concurrent connections reached: 49).

Perhaps it it time to bump the maximum no. of connections up at least temporarily on an experimental machine and see what the results are...

[abstraktMedia]

we concluded (long story short) that it was MSNBot issue which was cloging the mysql service. My issue has been resolved although my inital commennt still stands. If I didn't write anything to the forum there would be no info about 3days x 3h outage on hummer. I wish to thank Jacob for all the work he's done and all the help he provided. This is why I've been loyal to HG for almost 8 years !!!

[chaloupe]

Glad to hear that a solution was found for you!

Geez you we're here before me !! 8 years !!

[abstraktMedia]

Yeah I got lucky and found HG few months after they started...