User-agent: * Disallow: /cgi-bin/ Disallow: /logs/ Disallow: /library/ Disallow: /application/ Disallow: /preview-form/ Disallow: /*.swf$ Disallow: /*/send-request/ Disallow: /*/translations/ Disallow: /*/translations/ Disallow: /*/services/ Disallow: /*/stores/ Disallow: /*/promotions/ Sitemap: https://haliotis.pt/sitemap # Blocking malicious bots User-agent: Alexibot Disallow: / User-agent: Baiduspider Disallow: / User-agent: CherryPicker Disallow: / User-agent: Copernic Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Flaming AttackBot Disallow: / User-agent: Foobot Disallow: / User-agent: Gaisbot Disallow: / User-agent: Gigabot Disallow: / User-agent: grub-client Disallow: / User-agent: ia_archiver Disallow: / User-agent: Jetbot Disallow: / User-agent: Kenjin Spider Disallow: /