SaveSearch's fetcher
Last updated 2 October 2026
When someone saves a link in SaveSearch, our server fetches that one page once, so the person can search its text later. It is not a crawler: it never follows links, never logs in, and never fetches pages nobody saved.
How to recognise it
User-Agent: SaveSearchBot/1.0 (+https://savesearch.app/bot)
What it does
- Fetches only the page a person saved, plus its public metadata (title, description, thumbnail).
- Checks robots.txt before fetching a web page, and stays out where it is told to.
- Never downloads video or audio, never gets around paywalls or logins.
- Keeps requests rare: one fetch per save, and retries back off.
How to block it
Add this to your robots.txt:
User-agent: SaveSearchBot Disallow: /
People can still save your link; we keep just the link, without fetching the page. For anything else, email bryan@foundercreate.com.