Lincoln Down?

tei727 · #1 03-13-2006, 07:39 PM

All of my sites are down...Is lincoln down?

djshaw · #2 05-23-2006, 02:55 PM

All of my sites on Lincoln are returning "504 Gateway Timeout" errors. Email is down too. Can anyone tell me what the problem is and when we can expect it to be back up? Thank you.

tei727 · #3 05-23-2006, 06:08 PM

Quote:

Originally Posted by tei727

All of my sites are down...Is lincoln down?

I'll just bump this one instead of starting another..lol

John8m · #4 05-23-2006, 06:27 PM

Email and all sites on lincoln down ! I hope this doesn't last as long as the last time ! Was close to loosing a few clients before. Can anyone advise us of the problem and estimated time to fix? Thanks!

djshaw · #5 05-23-2006, 07:22 PM

My sites are coming up again, but email is still slow and sporadic. Some messages bounce and others make it through.

Can we please get an update? Thanks.

tei727 · #6 05-23-2006, 10:10 PM

Any updates at all?

djshaw · #7 05-23-2006, 10:20 PM

Websites are down again as well. Please give us some information so we can provide some answers to our clients.

iranhost · #8 05-24-2006, 12:30 AM

I've 5 HTTP DOWN alert by my web site monitoing system (with 30 min interval) , what's going on out there? BRENT can you give us some info.....?

***GatorBrent*** · #9 05-24-2006, 03:20 AM

>>>>>>>> Reason for downtime >>>>>>>>
In short :
>>>>> Cpanel and huge Bug>>>>
Detailed reason:
Cpanel had a bug where fixrelayd creates a new line in the syslog.conf file every time it's run, which
is the reason for some of the pop issues we have been having and dns not resolving / sites not working.

local0.notice;local0.debug;mail.*;mail.none;mail.i nfo;local0.info
-/var/log/maillog
The more duplicates a server had from this cpanel bug the more it would break until it hit the climax today on a bunch of boxes such as lincoln, acura, avenger, tiburon, many more servers causing havoc.
NOBODY at cpanel was aware of this bug, nor have we seen anyone post about it. Sometimes it takes 1200 servers to notice an issue like this. The fix is simple but the problem lied in a file nobody ever would check.
Think of it like your cars engine catching on fire every time you turn it on, and then finding the problem to be from the air in the tires being combustible slowly leaking into the engine. (something that just doesn't happen) It was one of those bugs!!! We either got lucky finding the problem or were just that good, and or maybe a little of both.