Aerio

[Abomb]

Sites are timing out on aerio at the moment.

[GatorJoshL]

Good afternoon,

I have checked a couple of sites on that server and they are pulling up fine. If you would, please contact either Live Support by phone or chat or email support@hostgator.com with your domains that are not showing up.

Thank you,
Josh Loe

[Abomb]

I guess it was restarted earlier today. With WHMCS, it's status shows it's uptime as being only a few hours. Maybe I was looking at the time of reboot.

[Abomb]

Aerio is acting up again. Here's a copy-paste from a spotcheck from alertra.com.

Timestamp Location Result Size Time
2008-04-30 09:59:40 EDT Hong Kong CHN Error N/A 26.92
2008-04-30 09:59:40 EDT Sydney AUS Error N/A 26.91
2008-04-30 09:59:40 EDT Frankfurt DEU Error N/A 26.93
2008-04-30 09:59:40 EDT Chicago USA Error N/A 26.93
2008-04-30 09:59:40 EDT Atlanta USA Error N/A 26.89
2008-04-30 09:59:40 EDT Las Vegas USA Error N/A 26.91
2008-04-30 09:59:40 EDT Orlando USA Error N/A 26.90
2008-04-30 09:59:40 EDT Shanghai CHN Error N/A 26.91

Complete.

[rota919]

I have been in contact with live support about 4 times already in the last couple of hours.

It should crash again in about 30 minutes max.
Currently Server load is 21.71 and going up.
Memory used is 90%.

[rota919]

Ok so we got passed 30 minutes.

ftpd failed about 10 minutes ago with CPU at 26 and Memory usage at 83%.

Looks like whatever is happening is now happening every 50 minutes.

[rota919]

50 minutes later

500 server error this time...

[Abomb]

The server is having issues today.

[rota919]

That's an understatement...
Lets hope they get it sorted now.

[rota919]

Ok it might be a good idea if some admin can start to work on AERIO please.

I have reported this issue about 8 hours ago via live chat and was given the generic answer "The server is being worked on. It should be resolved within 15 minutes"

Since then I have been on chat a couple of times and got the same generic answer every time.

Once the server comes back online it will take about 15 minutes for the MEM usage to reach critical point and the server would be unavailable for about 10 minutes. Coming back online a couple of services would show as failed, slowly coming back online.
By the time everything is working again the MEM usage would be at 60% and climbing.

Now if an admin is working on the server, like chat seems to think, I am at a loss as to what this admin is trying to doing on this server the whole day.

[codesight]

It's unavailable for me as well.

[rota919]

Apparently there was a memory issue with Apache that was fixed.

[Abomb]

This server is acting up yet again.

[rota919]

I have also been monitoring it for the last hour or so.
It seems it is the same error than last week.

Ticket number GCG-2464156

[Abomb]

Apache is still in the red as is exim. The server has a bit of older softwares running it.

Apache is version 1.3.37 while some security fixes for that have been done in 1.3.39, .40, and now .41.

The native php is 2006's 4.4.4 while the legacy 4.4.8 is now. And many fixes between .4 and .8. The ability to use 5 is 5.2.2 which has some issues fixed upto the 5.2.6 they are planning to upgrade the servers too.

Bind is 9.2.4. Current is 9.5 but I thought they'd have 9.4.2 by now.

MySQL is 4.1.22 from 2006. I wouldn't expect them to waste time putting 4.1.24 (latest version) since they announced the planned upgrades before it's release but .23 has been out almost a year.

Three things that power the site which had security fixes since then is bound to cause issues if the wrong person wanted to cause havoc on them.

The server issues started around 2:45 eastern time and been bouncing up and down since. Mostly down.

[Abomb]

Again, 2:30 pm eastern and Aerio is having downtime again.

[rota919]

AERIO has had some work done on it today.
I was in (nearly) constant contact with various senior admins the hole day and assisted with some fine-tuning.

Unfortunately the admins still did not keep to their promise and update the forum.

One thing to look out for is this.

the newer apache has index.htm preferred against index.php . You may manage this via your .htaccess on your domains though.

[Abomb]

I just see they upgraded Apache there. I didn't notice that until your post. But the php was also upgraded according to cpanel. I have the add-handler going and it's saying 5.2.6 is now on the server. Be back.

[Abomb]

Okay, the server was upgraded to the latest php 5.2.6 and the latest apache (well, latest as far as not being apache2 but the latest apache 1). I need to go through removing the add-handlers on the sites that needed use of php5 now.

[nolatron]

Looks like the PHP upgrade broke some of stuff for me as well.

http://sayitonpaper.net/products.php?cat=gifts

Fatal error: Cannot re-assign $this in /home/sayit/public_html/products.php on line 15

Looks like it broke something in some pagination code. I've been using this code for 3 or 4 years and now it's suddenly broken. Argh.

[nolatron]

Failed to connect
The host 74.52.178.178 could not be contacted. If this persists, you should contact the administrator of the remote site.

Awesome. 2nd time today.

[Abomb]

You can use the add-handler command in the .htaccess for php4 still for a few months. I know there's a thread around here about those. I doubt they completely removed php4 but I can't check that because server is down again.

Please try the PHP5 Addhandler in .htaccess

AddHandler application/x-httpd-php5 .php

[Abomb]

Originally Posted by GatorZach

Please try the PHP5 Addhandler in .htaccess

AddHandler application/x-httpd-php5 .php

Zach, apparently 5 is now the default on Aerio as of today. Someone did a php5 upgrade and upgraded apache as well. But isn't there also an addhandler to get back to php4 too? I thought there was where instead of httpd-php5, it was httpd-php4 or httpd-php. Now that one for 5 is no longer needed since Aerio now has 5 as default at the moment.

[Abomb]

I was told by a livechat op just now that php is being recompiled now.