Google can't access sites... Am I alone?

[sneggiwt]

I have two different servers. Both of which Google has been unable to access for some time. One server has not been crawled since the 10th, the other since the 12th.

I logged into Google webmaster tools and it is saying "We can't currently access your home page because of an unknown problem."

Is anyone else having the same issues. I'm this close to switching hosts.

Please print the output of your .htaccess file in public_html, just a hunch.

[sneggiwt]

Sent a PM to you... take a look. Thanks.

[sneggiwt]

Cleared out my .htaccess of all IP deny's just in case somehow google got grouped in... didn't fix the problem. I am now convinced that this HostGator's issue and not mine.

[striddy]

Care to share the site with us?

[Sam]

What's in your robots.txt file?

[sneggiwt]

Network unreachable: robots.txt unreachable
We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit.

Also note, every other bot is accessing my site and robots.txt just fine.

Here's my robot.txt

User-agent: *
Disallow: /forum/ajax.php
Disallow: /forum/attachment.php
Disallow: /forum/calendar.php
Disallow: /forum/cron.php
Disallow: /forum/editpost.php
Disallow: /forum/global.php
Disallow: /forum/image.php
Disallow: /forum/faq.php
Disallow: /forum/inlinemod.php
Disallow: /forum/joinrequests.php
Disallow: /forum/login.php
Disallow: /forum/misc.php
Disallow: /forum/moderator.php
Disallow: /forum/newattachment.php
Disallow: /forum/newreply.php
Disallow: /forum/newthread.php
Disallow: /forum/online.php
Disallow: /forum/postings.php
Disallow: /forum/printthread.php
Disallow: /forum/private.php
Disallow: /forum/register.php
Disallow: /forum/report.php
Disallow: /forum/reputation.php
Disallow: /forum/search.php
Disallow: /forum/sendmessage.php
Disallow: /forum/payments.php
Disallow: /forum/showpost.php
Disallow: /forum/showgroups.php
Disallow: /forum/spiders.php
Disallow: /forum/subscription.php
Disallow: /forum/threadrate.php
Disallow: /forum/usercp.php
Disallow: /forum/usernote.php
Disallow: /forum/admincp/
Disallow: /cgi-bin/
Disallow: /forum/includes/
Disallow: /forum/install/
Disallow: /forum/modcp/
Disallow: /forum/customavatars/
Disallow: /forum/xmlrpc.php
Disallow: /forum/archive/

[vegasb2k]

It clearly says that the issue is with your "Sitemap". Maybe check that file/page or post that info here so we can check it out. Most bots are not as picky as the google bots.

[sneggiwt]

Originally Posted by vegasb2k

It clearly says that the issue is with your "Sitemap". Maybe check that file/page or post that info here so we can check it out. Most bots are not as picky as the google bots.

The sitemap is fine. Notice how it says "can be accessed at that location"... well... it can't.

[sneggiwt]

Just an update... this has been solved.

Hostgator was in fact blocking google.

We found about 8-10 crawler IPs in Google's IP block in the tables. They have been removed at this time. Sorry for any inconvenience this has caused anybody.

[Gorkfu]

Originally Posted by GatorZach

It appears we got flooded a few weeks ago, and nobody bothered to check the route reject tables. We found about 8-10 crawler IPs in Google's IP block in the tables. They have been removed at this time. Sorry for any inconvenience this has caused anybody.

I've been having this problem with google for the last 4 days. Every day I check the google sitemaps site and they still can't access my robots.txt file on my new site. This morning it says they are having problems accessing all of my sites while apparently other bots have no issues.

[slapshotw]

Did you submit a ticket?

[Gorkfu]

Originally Posted by slapshotw

Did you submit a ticket?

Yea, but google seems to be accessing my site ok now.


And to the guy spamming, you must be bored, lol. You typed domain parking twice, does that mean it's twice the unlimitedness!