robots文件生成:http://tool.chinaz.com/robots/
robots.txt文件示例
2023-11-30 08:31:04
2023-11-30 08:31:04
# robots.txt generated at http://tool.chinaz.com/robots/ User-agent: * Disallow: Crawl-delay: 10 Sitemap: http://domain.com/sitemap.xml
robots文件生成:http://tool.chinaz.com/robots/