Go Back   HostGator Peer Support Forums > HostGator Peer Support Forums > Web Hosting Services

Notices

Reply
 
Thread Tools
  #1  
Old 10-22-2007, 08:50 PM
Emmett Emmett is offline
Hatchling Croc
 
Join Date: Oct 2007
Posts: 2
Default Anyone know how to block ALL Bots with .htaccess

I am running a "Completely Local" website and do not see any need for those bots messing around just mucking up the "real" stats for my site.
Anyone familiar with blocking bots with .htaccess post some answers please?

Thanks
Reply With Quote
  #2  
Old 10-22-2007, 08:52 PM
Sam Sam is offline
Emperor Croc
 
Join Date: Jan 2007
Location: /bin/false
Posts: 3,057
Default Re: Anyone know how to block ALL Bots with .htaccess

There is no real way of doing it as you would need to know all the bots user-agents or IP addresses
Reply With Quote
  #3  
Old 10-22-2007, 09:38 PM
kmaw's Avatar
kmaw kmaw is offline
Emperor Croc
 
Join Date: Mar 2005
Location: Ontario, Canada
Posts: 1,924
Default Re: Anyone know how to block ALL Bots with .htaccess

Can't you do this in /robots.txt ?

User-agent: *
Disallow: /
Reply With Quote
  #4  
Old 10-22-2007, 10:29 PM
Emmett Emmett is offline
Hatchling Croc
 
Join Date: Oct 2007
Posts: 2
Default Re: Anyone know how to block ALL Bots with .htaccess

I have read that a lot of the bots bypass the robots.txt file. Especially those you absolutely do not want.

Emmett
Udate - Probable Answer here:
Quote:
http://diveintomark.org/archives/2003/02/26/how_to_block_spambots_ban_spybots_and_tell_unwante d_robots_to_go_to_hell

Last edited by Emmett; 10-22-2007 at 10:52 PM.
Reply With Quote
  #6  
Old 12-01-2007, 10:09 AM
kompreszor's Avatar
kompreszor kompreszor is offline
Swamp Croc
 
Join Date: Jun 2007
Location: Pennsylvania, USA
Posts: 330
Default Re: Anyone know how to block ALL Bots with .htaccess

If by "Completely Local" you mean a local network then what Serra said would be the way to go.

If "Completely Local" means like a local community, town, etc. it's going to be a lot harder to implement and it will never be perfect.
Reply With Quote
  #7  
Old 12-01-2007, 01:10 PM
gwyneth's Avatar
gwyneth gwyneth is offline
Supreme Croc
 
Join Date: Sep 2006
Location: up north
Posts: 6,843
Default Re: Anyone know how to block ALL Bots with .htaccess

Quote:
Originally Posted by kompreszor View Post
If by "Completely Local" you mean a local network then what Serra said would be the way to go.

If "Completely Local" means like a local community, town, etc. it's going to be a lot harder to implement and it will never be perfect.
And, of course, if "Completely Local" means the adolescent in the basement, you have other problems to worry about.
Reply With Quote
Reply

Bookmarks

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT -5. The time now is 02:37 AM.