User-agent: ia_archiver Disallow: / User-Agent: Googlebot-Image Disallow: / User-Agent: Yahoo-MMCrawler Disallow: / User-Agent: Googlebot Disallow: /pad/ User-agent: * Disallow: /de/docs/ Disallow: /en/docs/