# Robots.txt file # All robots will spider the domain # but not the folders listed below. User-agent: * Sitemap: http://www.connexions-tw.co.uk/sitemap.xml Disallow: /cgi-bin/ Disallow: /scripts/ Disallow: /java_files/ Disallow: /site_search/ Disallow: /images/ Disallow: /css_files/ Disallow: /counter/ Disallow: /multimedia/ Disallow: /text_only/ Disallow: /visitor_stats/ Disallow: /transition/ Disallow: /wow/ Disallow: /new/ Disallow: /kiosk/