User-agent: * Disallow: /css/ Disallow: /d/admin/ Disallow: /temp/ Disallow: /xml/ Disallow: /log/