User-agent: * Disallow: /cgi-bin/ Disallow: /js/ Disallow: img_map/ Disallow: /css/ Disallow: /ssi/ User-agent: psbot Disallow: / Disallow: /map_samet.htm User-agent: Microsoft URL Control Disallow: all User-agent: Offline Explorer Disallow: all User-agent: linkwalker Disallow: / User-agent: linksmanager Disallow: / User-agent: pavuk Disallow: / User-Agent: sitecheck.internetseer.com Disallow: /