# All robots will spider the domain User-agent: * Disallow: # Disallow Baiduspider+(+http://www.baidu.com/search/spider.htm) User-agent: Baiduspider+(+http://www.baidu.com/search/spider.htm) Disallow: / User-agent: msnbot Disallow: / # Disallow directory /webalizer/ User-agent: * Disallow: /webalizer/ # Disallow directory /wp-admin/ User-agent: * Disallow: /wp-admin/ # Disallow directory /audio/ User-agent: * Disallow: /audio/