Baidu Bot

Home Forums BulletProof Security Pro Baidu Bot

Viewing 3 posts - 1 through 3 (of 3 total)
  • Author
    Posts
  • #8787
    rphrus
    Participant

    Hi,

    This is what shows in my security log. Just wonder what I need to do

    BPS SECURITY / HTTP ERROR LOG
    ==============================
    ==============================
    
    >>>>>>>>>>> 403 GET or Other Request Error Logged - August 21, 2013 - 5:52 pm <<<<<<<<<<<
    REMOTE_ADDR: 180.76.5.170
    Host Name: baiduspider-180-76-5-170.crawl.baidu.com
    SERVER_PROTOCOL: HTTP/1.1
    HTTP_CLIENT_IP:
    HTTP_FORWARDED:
    HTTP_X_FORWARDED_FOR:
    HTTP_X_CLUSTER_CLIENT_IP:
    REQUEST_METHOD: GET
    HTTP_REFERER:
    REQUEST_URI: /wp-content/themes/twentythirteen/style.css?ver=2013-07-18
    QUERY_STRING:
    HTTP_USER_AGENT: Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
    
    >>>>>>>>>>> 403 GET or Other Request Error Logged - August 21, 2013 - 7:06 pm <<<<<<<<<<<
    REMOTE_ADDR: 180.76.5.197
    Host Name: baiduspider-180-76-5-197.crawl.baidu.com
    SERVER_PROTOCOL: HTTP/1.1
    HTTP_CLIENT_IP:
    HTTP_FORWARDED:
    HTTP_X_FORWARDED_FOR:
    HTTP_X_CLUSTER_CLIENT_IP:
    REQUEST_METHOD: GET
    HTTP_REFERER:
    REQUEST_URI: /wp-content/plugins/wp-noter/wp-noter.js
    QUERY_STRING:
    HTTP_USER_AGENT: Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
    #8789
    AITpro Admin
    Keymaster

    The Baidu bot/spider/User Agent is generally considered a legitimate Chinese Search Engine bot, but can also be considered as an overly aggressive bot.  I am pretty sure that this bot makes a HEAD Request and that is what is being blocked.  So the choice is up to you/your call on this.

    If you would like to allow this bot to crawl your site then click the Forum link below.  If you would like to continue to block this bot then you do not need to do anything since BPS is already blocking this bot.

    http://forum.ait-pro.com/forums/topic/split-uptimerobot-whitelist-uptimerobot-bot/#post-8003

    #8791
    AITpro Admin
    Keymaster

    If you would like to know more about the Baidu Spider here is a good post about that bot.

    http://searchenginewatch.com/article/2067357/Bye-bye-Crawler-Blocking-the-Parasites

Viewing 3 posts - 1 through 3 (of 3 total)
  • You must be logged in to reply to this topic.