User-agent: * Disallow: /admin Disallow: /dev Disallow: /docs Disallow: /assets Disallow: /manager Disallow: /billing Disallow: /french Disallow: /spanish Disallow: /italian Disallow: /german Disallow: /korean Disallow: /japanese Disallow: /support Disallow: /lists Disallow: /chinese Disallow: /arabic User-agent: libwww-perl/5.803 Disallow: / User-agent: libwww-perl/5.65 Disallow: / User-agent: libwww-perl/5.805 Disallow: / User-agent: Mozilla/3.01 (hotwired-test/0.1) Disallow: /admin Disallow: /dev Disallow: /docs Disallow: /assets Disallow: /manager Disallow: /billing Disallow: /french Disallow: /spanish Disallow: /italian Disallow: /german Disallow: /korean Disallow: /japanese Disallow: /support Disallow: /lists Disallow: /chinese Disallow: /arabic User-agent: Slurp Disallow: /admin Disallow: /dev Disallow: /docs Disallow: /assets Disallow: /manager Disallow: /billing Disallow: /french Disallow: /spanish Disallow: /italian Disallow: /german Disallow: /korean Disallow: /japanese Disallow: /support Disallow: /lists Disallow: /chinese Disallow: /arabic User-agent: Scooter Disallow: /admin Disallow: /dev Disallow: /docs Disallow: /assets Disallow: /manager Disallow: /billing Disallow: /french Disallow: /spanish Disallow: /italian Disallow: /german Disallow: /korean Disallow: /japanese Disallow: /support Disallow: /lists Disallow: /chinese Disallow: /arabic User-agent: Ultraseek Disallow: /admin Disallow: /dev Disallow: /docs Disallow: /assets Disallow: /manager Disallow: /billing Disallow: /french Disallow: /spanish Disallow: /italian Disallow: /german Disallow: /korean Disallow: /japanese Disallow: /support Disallow: /lists Disallow: /chinese Disallow: /arabic User-agent: smallbear Disallow: /admin Disallow: /dev Disallow: /docs Disallow: /assets Disallow: /manager Disallow: /billing Disallow: /french Disallow: /spanish Disallow: /italian Disallow: /german Disallow: /korean Disallow: /japanese Disallow: /support Disallow: /lists Disallow: /chinese Disallow: /arabic User-agent: GoogleBot Disallow: /admin Disallow: /dev Disallow: /docs Disallow: /assets Disallow: /manager Disallow: /billing Disallow: /french Disallow: /spanish Disallow: /italian Disallow: /german Disallow: /korean Disallow: /japanese Disallow: /support Disallow: /lists Disallow: /chinese Disallow: /arabic