SEO知識

1、 百度蜘蛛:Baiduspider Baiduspider-image baiduboxapp Baiduspider-render。IP段參考

#PC搜索UA:

Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)

#移動搜索UA

Mozilla/5.0 (Linux;u;Android 4.2.2;zh-cn;) AppleWebKit/534.46 (KHTML,like Gecko) Version/5.1 Mobile Safari/10600.6.3 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)

圖片搜索:Baiduspider-image

視頻搜索:Baiduspider-video

新聞搜索:Baiduspider-news

百度搜藏:Baiduspider-favo

百度聯盟:Baiduspider-cpro

2、 谷歌蜘蛛:Googlebot (很勤奮的蜘蛛) Googlebot-Image Google-Read-Aloud Googlebot-Video。IP段參考

Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html

Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.5249.103 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

3、 360蜘蛛:360Spider (很勤奮的蜘蛛)。IP段參考

Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.102 Safari/537.36; 360Spider

Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0)

4、 搜狗蜘蛛:SogouSpider, Sogou web spider。IP段參考

Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07

5、 神馬蜘蛛:YisouSpider (UC瀏覽器默認搜索sm.cn的蜘蛛)。IP段參考

Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36

6、 必應蜘蛛:bingbot BingPreview。IP段參考

Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/*.*.*.* Safari/537.36

Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/*.*.*.*?Mobile Safari/537.36? (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

7、 有道蜘蛛:YoudaoBot,YodaoBot。IP段參考

Mozilla/5.0 (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )

8、 MSN蜘蛛:msnbot,msnbot-media。IP段參考

*msnbot/1.0 (+http://search.msn.com/msnbot.htm”)

9、 雅虎蜘蛛:“Yahoo! Slurp China”或者Yahoo!。IP段參考

Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html)

Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)

10、 Yandex蜘蛛:YandexBot (俄羅斯搜索引擎)。IP段參考

Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)

11、 DNSPOD監控蜘蛛:DNSPod-Monitor。IP段參考

DNSPod-Monitor/2.0

12、 MJ12bot:MJ12bot (英國seo分析頁面蜘蛛)。IP段參考

Mozilla/5.0 (compatible; MJ12bot/v1.4.0; http://www.majestic12.co.uk/bot.php?+)

13、 semrush:SemrushBot (美國SEO綜合分析網站的蜘蛛)。IP段參考

Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html)

14、 頭條蜘蛛:Bytespider (今日頭條旗下:高頻抓取 被很多站長封禁后 有所改善)。IP段參考

Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; https://zhanzhang.toutiao.com/)?

15、 華為蜘蛛:AspiegelBot ( 華為旗下Aspiegel公司 瘋狂高頻爬行無節制 )。IP段參考

HuaweiSymantecSpider/1.0+DSE-support@huaweisymantec.com+(compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR ; http://www.huaweisymantec.com/cn/IRL/spider)