User-Agent: * Disallow: /notfound.php Disallow: /cgi-bin/ Disallow: /pdf/