# Robots.txt # For domain: http://www.hemptons.co.za # All robots will spider the domain User-agent: * Disallow: /_private/ Disallow: /images/ Disallow: /_overlay/ Disallow: /_themes/ Disallow: /_vti_cnf/ Disallow: /_vti_pvt/ Disallow: /_fpclass/ Disallow: /_sharedtemplates/