wordpress的robots并不是自动生成的，而是在搜索引擎抓取的时候会生成在根目录，生成sitemap的插件是Simple Google Sitemap XML我的wordpress robots写法如下：
User-agent: * Disallow: /cgi-bin Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/cache Disallow: /wp-content/themes Disallow: /trackback Disallow: /feed Disallow: /comments Disallow: /category/*/* Disallow: */trackback Disallow: */feed Disallow: */comments Disallow: /*?*