Skip to content
Usefully

For site owners

UsefullyBot

User agent: UsefullyBot/1.0 (+https://usefully.info/bot)

What it does

UsefullyBot fetches a page when one of our API customers asks to read it (for example to answer a question with up-to-date sources). It fetches only the pages requested; it doesn't crawl your site on its own.

It respects robots.txt

Before fetching, it checks your robots.txt for rules for the UsefullyBot user agent (or *). A disallowed page is never fetched, and isn't fetched another way.

It's polite

Pages are fetched once per request, with redirects limited and private or internal addresses refused.

How to block it

Add a rule to your robots.txt. Changes take effect within an hour.

# robots.txt
User-agent: UsefullyBot
Disallow: /

Questions or problems? Email support@usefully.info.

UsefullyBot · Usefully