For site owners
About our crawler
If you found EZJobFinderBot in your access logs, this page is why, and how
to make it stop.
What it does
EZJobFinder is a paid service that helps individual job seekers find open roles. Our crawler reads job listings so we can show them to a person who is looking for that kind of work, and links them straight back to your posting.
How it behaves
- Identifies itself honestly as
EZJobFinderBot/1.0 (+https://ezjobfinder.com/bot). - Reads and honours
robots.txtbefore fetching any page. - Makes at most one request per second to any one host.
- Backs off when it receives a 429 or 503, and respects
Retry-After. - Prefers your applicant tracking system's public API or feed over crawling your pages.
- Stores only enough of a posting to explain a match, and links to your posting rather than republishing it.
- Does not attempt to log in, submit forms, or apply to anything.
How to block it
Add this to your robots.txt and we will stop, usually within six hours:
User-agent: EZJobFinderBot Disallow: /
Or email [email protected] and we will remove your site by hand. We will not argue about it.