# Robots.txt file # updated 6-24-09 User-agent: * Disallow: /admin/ Disallow: /bt/ Disallow: /bt Disallow: /ics/ Disallow: /scripts/ Disallow: /securecheckout/ Disallow: /system/ Disallow: /pages/ # Disallow: /index.cfm?page=cat_home # Disallow: /index.cfm?page=item # Disallow: /index.cfm?itemsysid= SITEMAP: http://www.delphiglass.com/sitemap.xml # User-agent: Googlebot # Disallow: /*itemsysid= # Disallow: /*itemSYSid= # Disallow: /*altcat= # Disallow: /*viewcat= # User-agent: msnbot # Disallow: /*itemsysid=$ # Disallow: /*itemSYSid=$ # Disallow: /*altcat=$ # Disallow: /*viewcat=$ # Google googlebot # MSN Search msnbot # Yahoo yahoo-slurp # Ask/Teoma teoma # GigaBlast gigabot # Scrub The Web scrubby # DMOZ Checker robozilla # Nutch nutch # Alexa/Wayback ia_archiver # Baidu baiduspider