OppsightBot
The web crawler that helps Oppsight keep business contact details accurate.
What it does
OppsightBot visits a business’s own website to read the contact details that business has chosen to publish: its main phone number and email, and the names and job titles of the people it lists on its team, about or contact pages. Oppsight members use these details to reach businesses for work purposes.
How it behaves
- It identifies itself as
OppsightBot/1.0 (+https://oppsight.ca/bot). - It follows robots.txt on every page. If your robots.txt disallows it, or disallows all bots, it reads nothing.
- It reads at most four pages per site, one page at a time, and only pages anyone can open without signing in. It never fills in forms.
- It keeps business contact information only. It doesn’t collect home addresses, personal social media or anything behind a login.
- It returns every few months, so changes on your site reach Oppsight.
How to opt out
Add this to your site’s robots.txt:
User-agent: OppsightBot Disallow: /
To have details we already hold removed or corrected, or for a person to ask that their name and work details not be shown, email [email protected]. We act on requests within 30 days.