At the bottom of the front screen in the forum it shows who is online.
For example
DJ, drsmurto, Google [Bot], gregb, Heritrix [Crawler], rwh, scooter75, Yahoo [Bot]
So who or what is a BOT or CRAWLER?
Bot or Crawler??
Bot or Crawler??
DJ
"No Excuses" - Kostya Tszyu
"No Excuses" - Kostya Tszyu
Re: Bot or Crawler??
Crawlers and Bots are much in the same except that those bots are sent out to collect info for search engines like Google, Yahoo, etc. The crawler is probably trying to harvest e-mail addresses and other personal data to sell to spam companies.
http://crawler.archive.org/
http://crawler.archive.org/
Re: Bot or Crawler??
Is there any way to kill that google bot? It worries me that it is there for some reason. Is this a justified concern?
A beer in the hand is worth two in George Bush...
"They say beer will make me dumb. It are go good with pizza"
Psychostick
"They say beer will make me dumb. It are go good with pizza"
Psychostick
Re: Bot or Crawler??
That google bot is what makes people find us. But for it, we would not have many members at all (me included)!
Everything you find when you type a search into a google search box was indexed by a google bot.
Everything you find when you type a search into a google search box was indexed by a google bot.
Re: Bot or Crawler??
Fair enough. As long as they are safe...
A beer in the hand is worth two in George Bush...
"They say beer will make me dumb. It are go good with pizza"
Psychostick
"They say beer will make me dumb. It are go good with pizza"
Psychostick
-
- Administrator
- Posts: 3424
- Joined: Thursday Jul 22, 2004 1:22 am
- Location: West Melbourne, Victoria, Australia
Re: Bot or Crawler??
Indeed, bots are harmless.
But I've now worked out how to hide them from the user list.
They have to be done one by one, so I've only hidden the 20 or so that have ever visited homebrewandbeer.com. Another 30 have never visited so I didn't worry hiding them.
If anyone notices any appearing (they'll probably be for new search engines) let me know and I'll hide them too.
Cheers,
Oliver
But I've now worked out how to hide them from the user list.
They have to be done one by one, so I've only hidden the 20 or so that have ever visited homebrewandbeer.com. Another 30 have never visited so I didn't worry hiding them.
If anyone notices any appearing (they'll probably be for new search engines) let me know and I'll hide them too.
Cheers,
Oliver