Baidu Bot

[rphrus]

Hi,

This is what shows in my security log. Just wonder what I need to do

BPS SECURITY / HTTP ERROR LOG
==============================
==============================

>>>>>>>>>>> 403 GET or Other Request Error Logged - August 21, 2013 - 5:52 pm <<<<<<<<<<<
REMOTE_ADDR: 180.76.5.170
Host Name: baiduspider-180-76-5-170.crawl.baidu.com
SERVER_PROTOCOL: HTTP/1.1
HTTP_CLIENT_IP:
HTTP_FORWARDED:
HTTP_X_FORWARDED_FOR:
HTTP_X_CLUSTER_CLIENT_IP:
REQUEST_METHOD: GET
HTTP_REFERER:
REQUEST_URI: /wp-content/themes/twentythirteen/style.css?ver=2013-07-18
QUERY_STRING:
HTTP_USER_AGENT: Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)

>>>>>>>>>>> 403 GET or Other Request Error Logged - August 21, 2013 - 7:06 pm <<<<<<<<<<<
REMOTE_ADDR: 180.76.5.197
Host Name: baiduspider-180-76-5-197.crawl.baidu.com
SERVER_PROTOCOL: HTTP/1.1
HTTP_CLIENT_IP:
HTTP_FORWARDED:
HTTP_X_FORWARDED_FOR:
HTTP_X_CLUSTER_CLIENT_IP:
REQUEST_METHOD: GET
HTTP_REFERER:
REQUEST_URI: /wp-content/plugins/wp-noter/wp-noter.js
QUERY_STRING:
HTTP_USER_AGENT: Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)

[AITpro Admin]

The Baidu bot/spider/User Agent is generally considered a legitimate Chinese Search Engine bot, but can also be considered as an overly aggressive bot.  I am pretty sure that this bot makes a HEAD Request and that is what is being blocked.  So the choice is up to you/your call on this.

If you would like to allow this bot to crawl your site then click the Forum link below.  If you would like to continue to block this bot then you do not need to do anything since BPS is already blocking this bot.

http://forum.ait-pro.com/forums/topic/split-uptimerobot-whitelist-uptimerobot-bot/#post-8003

[AITpro Admin]

If you would like to know more about the Baidu Spider here is a good post about that bot.

http://searchenginewatch.com/article/2067357/Bye-bye-Crawler-Blocking-the-Parasites

[Author]

Posts