AllRoostBot
The web crawler behind the AllRoost search index. This page tells you what it does, how to identify it in your logs, and how to opt out.
What it does
AllRoostBot fetches publicly accessible pages from direct booking sites so we can list your property in AllRoost's search results. When a guest searches, we route them straight to your booking page — we don't take a booking, we don't charge a fee, and we never mirror your images. Your photos link directly to your own site.
How to identify it
The bot identifies itself with this user-agent string:
AllRoostBot/1.0 (+https://allroost.com/bot; index direct booking sites)
We follow standard crawler etiquette: one request every three seconds per host at most, we cap our read to 256 KB per page (typically just the <head> section), and we respect your robots.txt.
How to opt out
Three ways, ranked by how binding they are:
- Add to your robots.txt. We honor this immediately on our next crawl:
User-agent: AllRoostBot Disallow: /
- Claim your property via the host portal. Verify your domain, then deactivate any listings you don't want shown. Go to the host portal.
- Email us. hello@allroost.com with the URL you want removed. We honor removal requests within 5 business days.
What we never do
- Scrape Airbnb, Vrbo, Booking.com, or any competitor search engine.
- Store copies of your photos on our servers.
- Reproduce your full property descriptions on AllRoost.
- Charge you a fee, ever, for being listed.
- Route guests through us. They book directly with you.
Questions? Concerns? Email hello@allroost.com. For the full data-source disclosure, see where our data comes from.