# robots.txt file for http://www.althorp.co.nz User-agent: MSNBot Disallow: / User-agent: * Allow: *.html Disallow: *.inc Disallow: *.txt Disallow: *.css Disallow: images/ Disallow: footer.txt Disallow: nav.txt Disallow: response.html Disallow: script.txt