Aerio

[nolatron]

Looks like $this must be reserver by php for some particular purpose. Renamed it to $records in the code and everything works fine now. Phew.

[Abomb]

It's hard to be a reseller on a server that dies like clockwork after 2:30 pm eastern everyday.

Down again

[GatorChrisN]

Originally Posted by Abomb

It's hard to be a reseller on a server that dies like clockwork after 2:30 pm eastern everyday.

Down again

I will personally monitor the Aerio server throughout my shift (8am-5pm CST) tomorrow and pay extra close attention around 1:30PM CST to any automated processes/crons that run or any sites that may generate a lot of traffic/resource ussage during that time. With the amount of servers we have, it's very difficult to find common themes with specific servers. We may see a high load on Aerio around the same time every day, but a different administrator sees it, or it just doesn't click that it's the same time as the day before, due to the sheer volume of support tickets we have. If anyone reading this notices a common occurrence regarding slow loads at certain times of the day, certain services failing, etc, please do send in a support ticket with your findings, as it is extremely helpful in making sure problems are resolved permanently. I apologize for the issues you have been having, I will make sure they get resolved.

[codesight]

I submitted a ticket as well, but here is what I submitted in case you wanted to look further Chris.

I have a php script that checks imap to see if I have any new emails. If I do, it fires off an email to my cell phone and marks the emails as read.

This has been functioning flawlessly for at least 10 months.

I checked it yesterday and I'm receiving this error:

Warning: imap_open() [function.imap-open]: Couldn't open stream {localhost:143}INBOX in /home/c0desit3/public_html/filename.php on line 31
Couldn't Open Mail Box: Certificate failure for localhost: unable to get local issuer certificate: /C=US/2.5.4.17=77092/ST=TX/L=Houston/2.5.4.9=Suite 300/2.5.4.9=11251 Northwest Freeway/O=WebsiteWelcome.com/OU=Secured SSL/OU=Comodo PremiumSSL Wildcard/CN=*.websitewelcome.com

[Abomb]

It appears that HG did some software upgrades besides the php and apache. I just noticed the linux kernel was recently upgraded as well. I remember just a few days ago it was 2.6.9 and now it's 2.6.24.

I guess whichever tech did the upgrades did everything but database so when Patrick (or whoever does it), Aerio will only need the database upgrade done.

And thanks, Chris. Now watch it have the doctor/car mechanic syndrome of working fine when someone is watching it closely.

[GatorChrisN]

Originally Posted by Abomb

It appears that HG did some software upgrades besides the php and apache. I just noticed the linux kernel was recently upgraded as well. I remember just a few days ago it was 2.6.9 and now it's 2.6.24.

I guess whichever tech did the upgrades did everything but database so when Patrick (or whoever does it), Aerio will only need the database upgrade done.

And thanks, Chris. Now watch it have the doctor/car mechanic syndrome of working fine when someone is watching it closely.

I watched the Aerio server throughout the day today and I did notice the load got much higher in the afternoon. The only issue is that MANY sites are just somewhat busier than normal, but there are so many of them that the load starts to creep up. I could not suspend any one account because none of them were using up 25% of the resources individually (the load reached 30 at it's worst for everyone combined). I am going to talk with one of the upper-tier admins and see if there's anyway to optimize Aerio to handle this climb in traffic in the afternoons better. I will watch it again tomorrow and maybe something will stand out further!

[rota919]

AERIO CPU usage is still going above 20, currently 30 and MEM usage 63%

[Abomb]

Aerio is back at it again with it's issues. Alertra.com's spotcheck shows issue so not just my net.

[Abomb]

Server Load 260.34 (2 cpus)

WOW. And it was above 300 before I refreshed.

[GatorChrisN]

With the issues Aerio has had today, I wanted to let everyone know that we have been monitoring this server all day and also I have monitored it every day since I responded to this last week.

It has sort of been the 'perfect storm' for loads on Aerio in recent times and we have stayed on top of suspending abusive accounts, blocking attacking IPs and most recently we disabled all 'catchalls' which spammers can use to abuse the server. Sometimes these load issues can be elusive, a cron that only runs for a second and starts several processes that run for a short period of time causing the load to jump, or several other factors.

Currently the load is low, but I will definitely continue to monitor the server for any common denominators and keep you guys updated.

Thanks for your patience

[Abomb]

It's down again. Is Aerio a bad vehicle or something? I'll avoid it seeing how the server with the name dies. From alertra.com's spotcheck on the IP:

TIMEOUT 30
DNS 74.52.178.178 74.52.178.178 3.00407409668e-05
ERR Unable to connect

dns_answer_list=74.52.178.178
last_exec_time=30.0003519058
last_msg=Unable to connect
last_timestamp=1214830996.62
last_proto_code=ERR
last_ip=74.52.178.178
dns_answers=1
actual_runtime=30.0006790161
dns_answer_1=74.52.178.178
last_proto_msg=timed out
last_host=74.52.178.178
total_runtime=30.0006709099
last_command=TCP
traceable=Y
last_code=3
stat_connect_time=30.0003519058

[codesight]

It's working fine for me, server load is at 3.62.

[Abomb]

It was down for about 30 minutes yesterday so by the time you posted it had passed.

Now I can't install Drupal with Fantastico on Aerio because it gives an error about global registers are enabled. I opened a ticket about that.

[Abomb]

MySQL keeps going to lala land today on Aerio.