SaveSearchSaveSearch
Sign inStart free

SaveSearch's fetcher

Last updated 2 October 2026

When someone saves a link in SaveSearch, our server fetches that one page once, so the person can search its text later. It is not a crawler: it never follows links, never logs in, and never fetches pages nobody saved.

How to recognise it

User-Agent: SaveSearchBot/1.0 (+https://savesearch.app/bot)

What it does

  • Fetches only the page a person saved, plus its public metadata (title, description, thumbnail).
  • Checks robots.txt before fetching a web page, and stays out where it is told to.
  • Never downloads video or audio, never gets around paywalls or logins.
  • Keeps requests rare: one fetch per save, and retries back off.

How to block it

Add this to your robots.txt:

User-agent: SaveSearchBot
Disallow: /

People can still save your link; we keep just the link, without fetching the page. For anything else, email bryan@foundercreate.com.