#folders to block User-agent: * Disallow: /cgi-bin/manage.pl Disallow: /images/ Disallow: /archive/ Disallow: /admin/ Disallow: /cgi-bin/ Disallow: /cgi-sys/ #block all images from being indexed. Just wastes bandwidth Disallow: *.gif Disallow: *.jpg Disallow: /*.gif$ Disallow: /*.jpg$