BikooshBot
Transparency about the automated requests we make to the web.
Who we are
Bikoosh helps short-term-rental managers detect fraudulent copies of their genuine listings. To do that we fetch a small number of public web pages and compare their photos and text against listings our customers have registered.
Our user agent
BikooshBot/1.0 (+https://bikoosh.com/bot)
Every automated request we make carries this identifiable User-Agent. We never disguise it.
How we behave
- robots.txt is law. We fetch and cache it per domain and obey every
DisallowandCrawl-delay. If your robots.txt excludes us, we do not visit. - Gentle rate. At most one request every 10 to 15 seconds per domain, with a global cap of three concurrent requests, conditional requests, and backoff on errors.
- Public pages only. We never access anything behind a login, paywall, or CAPTCHA, and we never attempt to bypass such controls.
- No evasion. No proxy rotation, no header spoofing beyond the honest agent above. On a 403 or any request to stop, we add the domain to a permanent skip list.
- Data minimalism. We store only what is needed to detect and evidence a clone: public listing content, hashes/embeddings, and screenshots of suspected copies.
Opt out or contact us
To exclude BikooshBot from your site, add to your robots.txt:
User-agent: BikooshBot Disallow: /
Questions, opt-out requests, or abuse reports: [email protected]. We respond promptly and honour removal requests.
BikooshBot also performs customer-requested monitoring crawls for the Watch product family (for example, a funeral home asking us to watch its own obituary pages). Those crawls follow exactly the same rules on this page - robots.txt honored, identified UA, gentle rates. If we're visiting you at a customer's request and you'd rather we didn't, the opt-out above applies identically.