Invent Bot
How Invent fetches web pages, and how to control it.
What it is
Invent is a customer service platform. When someone adds a link to their knowledge base, or asks their assistant to read a page, we fetch that page so its content can answer questions.
It is not a search engine crawler. We do not index the web, we do not resell content, and we do not train models on what we fetch. Almost every request happens because a person asked for that exact page.
How to identify it
Requests carry this user agent:
Invent/1.0 (+https://www.useinvent.com/bot)
Pages that need JavaScript are rendered in a headless browser, which sends Chrome's user agent with Invent/1.0 appended.
How to block it
Add this to your robots.txt and we will stop:
User-agent: Invent Disallow: /
What we respect
Honoured for every link we discover ourselves while following a site. A page someone pasted in directly is fetched on their behalf, the same way a browser or a link preview would.
A group addressed to Invent takes precedence over the wildcard group.
On 429 or 503 we stop fetching from the site for exactly as long as it asks.
Not supported. It is not part of the robots standard. Send 429 with Retry-After and we will back off precisely.
How much we request
Invent makes no more than ten requests to your site at a time. If we are ever causing you a problem, tell us and we will stop.
Contact
Questions, or a request to stop crawling your site: abuse@useinvent.com