FUDforum: How To » Spiders and Bots

Home » FUDforum » How To » Spiders and Bots

Show: Today's Messages :: Polls :: Message Navigator

Re: Spiders and Bots [message #166014 is a reply to message #165961]

Sat, 03 September 2011 18:16

The Witcher

Messages: 675
Registered: May 2009
Location: USA

Karma:

Senior Member

As usual I completely missed the obvious and was reading too much into the simple instructions!
On a fresh 3.0.3RC2 install three bot/spiders are already listed, providing a clear example of the form the name and user agent string needs to take, the only thing missing is the IP address which is easy enough to find on line.

Bot Name	Useragent	
Bing	             msnbot		
Google	             Googlebot
Yahoo!	             Slurp

So obviously the browser type isn't required either which makes sense, seeing as there are so many different browsers in use.

"I'm a Witcher, I solve human problems; not always using a sword!"

Report message to a moderator

[Message index]

		Spiders and Bots By: The Witcher on Sun, 28 August 2011 22:32
		Re: Spiders and Bots By: naudefj on Fri, 02 September 2011 15:11
		Re: Spiders and Bots By: The Witcher on Fri, 02 September 2011 20:34
		Re: Spiders and Bots By: The Witcher on Sat, 03 September 2011 18:16
		Re: Spiders and Bots By: Rocksteve on Mon, 12 December 2011 04:53

Previous Topic:	no images in my forum
Next Topic:	change the default email address

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

]

Current Time: Thu Nov 28 07:37:05 GMT 2024

Total time taken to generate the page: 0.04298 seconds