# Robots.txt file for http://successful-sites.com/ # /directory/ <-- covers whole directory # /file.html <-- covers this file User-agent: * Disallow: /cgi-bin/ Disallow: /stats/ Disallow: /images/