EverscraperBot visited your site.
If this name is in your server logs, here is what it was doing on your site and how to reach us about it.
What it is
EverscraperBot is the program that reads web pages for Everscraper. Our users describe a dataset they want to keep current, such as the prices in a product category or the businesses in a directory, and the bot reads the public pages that list those records.
How to recognise it
Its requests carry this user agent:
EverscraperBot/0.1 (+https://everscraper.com/bot)Some pages cannot be read with a plain request. Those may be fetched through a third-party rendering service, and such requests do not carry this user agent.
What it does on your site
- It only requests pages. It does not log in, fill in forms or post anything.
- It reads pages that anyone can open without an account.
- The first visit studies a few pages to learn where the records are. After that it returns once a day and reads only the pages that list them, up to 60 pages per listing.
- It makes one request at a time to your domain and waits at least one second between requests.
Questions
If the bot is causing trouble, or you want to know what it collected from your site, write to hi@everscraper.com and include your domain. For personal data, see the Privacy Policy.