百度空间的robots

User-agent: Baiduspider
Allow: /index/

User-agent: Baiduspider-image
Allow: /index/

User-agent: Baiduspider-video
Allow: /index/

User-agent: Baiduspider-news
Allow: /index/

User-agent: Googlebot
Allow: /index/

User-agent: MSNBot
Allow: /index/

User-agent: YoudaoBot
Allow: /index/

User-agent: Sogou web spider
Allow: /index/

User-agent: Sogou inst spider
Allow: /index/

User-agent: Sogou spider2
Allow: /index/

User-agent: Sogou blog
Allow: /index/

User-agent: Sogou News Spider
Allow: /index/

User-agent: Sogou Orion spider
Allow: /index/

User-agent: ChinasoSpider
Allow: /index/

User-agent: Sosospider
Allow: /index/

User-agent: yisouspider
Allow: /index/

User-agent: EasouSpider
Allow: /index/

User-agent: *
Disallow: /

版权声明:
作者:王金阁
链接:https://www.nnbbxx.net/post-6154.html
来源:王金阁博客
文章版权归作者所有,未经允许请勿转载。

THE END
分享
二维码
打赏
< <上一篇
下一篇>>