FUDforum: How To » Spiders, Bots and Crawlers

Home » FUDforum » How To » Spiders, Bots and Crawlers - Problem

Show: Today's Messages :: Polls :: Message Navigator

Aw: Spiders, Bots and Crawlers - Problem [message #172198 is a reply to message #172197]

Mon, 30 September 2013 10:26

danliker

Messages: 57
Registered: January 2004
Location: Schweiz

Karma:

Member

also 220.181.108.163 is Baiduspider:

220.181.108.163 - - [30/Sep/2013:10:22:15 +0200] "GET /index.php/m/1195/15a8285e22b72251933bdb05f0e95e28/ HTTP/1.1" 200 7191 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
220.181.108.163 - - [30/Sep/2013:10:29:34 +0200] "GET /index.php/m/1189/f6f756c96cbe97b8bab3ba1749e8fd2c/ HTTP/1.1" 200 7235 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
220.181.108.163 - - [30/Sep/2013:10:29:40 +0200] "GET /index.php/m/1189/e320b79752a4308f46d2e856150bd843/ HTTP/1.1" 200 7235 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
220.181.108.163 - - [30/Sep/2013:11:06:21 +0200] "GET /index.php/e/Baiduspider/ HTTP/1.1" 200 1813 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
220.181.108.163 - - [30/Sep/2013:11:20:22 +0200] "GET /index.php/m/1139/3706e6fa5c19ee48313ba4f31b5fc044/ HTTP/1.1" 302 523 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
220.181.108.163 - - [30/Sep/2013:12:19:44 +0200] "GET /index.php/f/106/ed1e5b660769bbe16cdf924b4de0b9fa/ HTTP/1.1" 302 505 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
220.181.108.163 - - [30/Sep/2013:12:24:27 +0200] "GET /index.php/e/Baiduspider/ HTTP/1.1" 200 1813 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"

Report message to a moderator

[Message index]

		Spiders, Bots and Crawlers - Problem By: danliker on Thu, 26 September 2013 10:54
		Re: Spiders, Bots and Crawlers - Problem By: naudefj on Thu, 26 September 2013 19:47
		Aw: Spiders, Bots and Crawlers - Problem By: danliker on Fri, 27 September 2013 08:30
		Aw: Spiders, Bots and Crawlers - Problem By: danliker on Fri, 27 September 2013 09:03
		Re: Aw: Spiders, Bots and Crawlers - Problem By: naudefj on Fri, 27 September 2013 16:13
		Re : Re: Aw: Spiders, Bots and Crawlers - Problem By: TheDude on Fri, 27 September 2013 17:07
		Re: Re : Re: Aw: Spiders, Bots and Crawlers - Problem By: naudefj on Fri, 27 September 2013 17:55
		Aw: Spiders, Bots and Crawlers - Problem By: danliker on Mon, 30 September 2013 10:24
		Aw: Spiders, Bots and Crawlers - Problem By: danliker on Mon, 30 September 2013 10:26
		Aw: Spiders, Bots and Crawlers - Problem By: danliker on Wed, 07 May 2014 11:13
		Re: Aw: Spiders, Bots and Crawlers - Problem By: naudefj on Wed, 07 May 2014 14:42
		Aw: Re: Aw: Spiders, Bots and Crawlers - Problem By: danliker on Wed, 07 May 2014 17:40

Previous Topic:	Lightbox plugin help getting started
Next Topic:	Announsment is not working

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

]

Current Time: Fri Nov 22 14:32:42 GMT 2024

Total time taken to generate the page: 0.04386 seconds