User-agent: * Disallow: /search/ Disallow: /member/ Disallow: /apply/ Disallow: /external/ Disallow: /8616/* Disallow: /contact/job/ Disallow: /contact/recruiter/ Disallow: /unsubscribe/ Disallow: /non-member/* Disallow: /8216/* Allow: /static/favicons/ Disallow: /static/ Disallow: /additional-document/ Disallow: /application-pack/ Disallow: /recommended/ Disallow: /health-check/ Noindex: /static/ Disallow: /browse Crawl-delay: 2 User-agent: Baiduspider Disallow: / Disallow: /external/ User-agent: WeSEE Disallow: / Disallow: /external/ User-agent: proximic Disallow: / Disallow: /external/ User-agent: MJ12bot Disallow: / Disallow: /external/ User-agent: msnbot Crawl-delay: 5 User-agent: MaxPoint Bot Disallow: / Disallow: /external/ User-agent: Jobrapido Disallow: / Disallow: /external/ User-agent: Mozilla/5.0 (compatible; Jobrapido/1.1; +http://www.jobrapido.com) Disallow: / Disallow: /external/ User-agent: Mozilla/5.0 (JobRapido WebPump) Disallow: / Disallow: /external/ User-agent: MaxPointCrawler Disallow: / Disallow: /external/ User-agent: GPTBot Disallow: /