# The Technifox Robots.txt file # http://www.technifox.co.uk/robots.txt # Created: 09 February 2005 # All robots will spider the domain # Disallow directory cgibin, stats, admin User-agent: * Disallow: /cgibin Disallow: /stats Disallow: /admin Disallow: /dev Disallow: /hawnbyhotel