StablecoinPaymentsBot
StablecoinPaymentsBot is the crawler of stablecoinpayments.io, an independent directory of companies that move business money into, across and out of stablecoins. It is run by Outrun Advisory FlexCo, Vienna.
What it does
It reads the public pages of companies in the directory, such as product, pricing, documentation, legal and licence pages, to find facts like supported stablecoins, currencies and licences. It keeps a copy of each page it reads, so every fact in the directory can be traced to the exact page and sentence it came from. An AI model helps find those facts and quotes; nothing it finds is published until an editor has checked it.
It does not log in, fill in forms, or read anything that is not publicly available.
How it behaves
- It identifies itself with the user agent
StablecoinPaymentsBot/0.1 (+https://stablecoinpayments.io/bot). - It follows
robots.txt. - It crawls slowly: one company at a time and at most one page every 10 seconds from the same site.
- Some pages only show their content with JavaScript. Those it opens in a headless browser, which loads the page's own scripts and data from the same site, but never images, video, fonts or anything from other sites, and nothing that robots.txt forbids.
Opting out
To stop it, add this to your robots.txt:
User-agent: StablecoinPaymentsBot
Disallow: /
It is honoured from the next crawl on. To have facts about your company corrected, or for any question about the crawler, email privacy@stablecoinpayments.io.