User-agent: *
Disallow: /css/
Disallow: /lib/
Disallow: /admin/

User-agent: googlebot
Crawl-delay: 1
Request-rate: 10/60
Request-rate: 20/60 0400-0800
Visit-time: 0000-0230