Beschrijving
Dark Visitors – Bot & AI Agent Analytics, Robots.txt Generator & Blocker, LLM Referral Tracker
Beschrijving
Get realtime visibility into crawlers, scrapers, LLM assistants, and AI agents browsing your website. Generate a robots.txt to block AI training.
Track AI agents, bot traffic, and LLM referrals
Bots are now 40% of your website’s traffic. Protect your content from unwanted AI scraping and crawling. Turn the rising wave of AI agents, LLM assistants, and other bots crawling your website into a new growth channel for your business. For full details, visit the Dark Visitors website.
1. Agent Analytics
Get realtime visibility into the hidden ecosystem of crawlers, scrapers, AI agents, and other bots browsing your website.
- Monitor traffic from crawlers and scrapers: Track the hidden activity of all known artificial agents visiting your website in real time.
- Watch AI agents browse your website: Analyze sessions from AI models autonomously navigating and interacting with your website. Optimize their experience to increase conversions and human referrals.
- Spot spoofed visits with agent authentication: Detect bad actors pretending to be legitimate agents.
- Get spike alert notifications: Get notified when an agent’s traffic starts surging or overloading your server.
- Identify the most active agents and which pages they’re accessing: Understand which agents visit your website the most, and which pages they’re most interested in.
- Export reports to CSV: Download agent activity reports for custom analysis.
2. LLM Referral Tracking
Measure human traffic coming from AI chat and search platforms like ChatGPT, Perplexity, Claude, Gemini, and Copilot.
- Find out which AI platforms are mentioning you: See which LLMs are including or recommending your website in their responses.
- Export reports to CSV: Download LLM referral reports for custom analysis.
3. Automatic Robots.txt
Protect IP, reduce server cost, and save time by serving a robots.txt that updates continuously.
- Never make manual edits for individual bots again: Block entire categories of bots by serving a robots.txt that continuously updates as new bots are discovered.
- Block agents who try to break your rules: Prevent misbehaving bots from accessing your content.
Demos
Demos can be found on the home page.
Further Details
This plugin connects your website to Dark Visitors. It uses the Dark Visitors API to connect to your account and provide functionality.
By signing up, you agree to the Terms of Service and Privacy Policy.
Are you finding this plugin useful? Please leave us a ★★★★★ review! Otherwise, please ask us for help.
Schermafbeeldingen
Insights into crawler and scraper activity 
Insights into AI agent activity 
The realtime timeline of all agent visits to the website 
Insights into AI chat and search LLM referrals 
Insights into blocked agents who tried to ignore robots.txt rules
Installatie
- Install and activate the Dark Visitors plugin from the WordPress Plugin Directory
- Sign up for Dark Visitors and create a new project for your website.
- Copy your access token from the project’s settings page, then paste it into the access token field on the plugin’s configuration page.
Your website is now connected to Dark Visitors.
FAQ
Do I need a Dark Visitors account to use this plugin?
Yes. Creating an account is free and only takes a few seconds. This is where you’ll be able to see dashboards and insights into agent activity on your website.
Is Dark Visitors free?
Dark Visitors is a freemium service. You can choose to upgrade if you want to unlock premium features or need events beyond the free tier. More details can be found on the pricing page.
What are some examples of agents (bots)?
Examples include Operator, GPTBot, CCBot, Claudebot, PerplexityBot, Googlebot, Bytespider, etc. See the full agent list for more.
Why should I care about visits from agents?
There are many reasons to care. Their activity affects:
- Whether your content is used in AI model training
- The success rate of autonomous AI agents executing tasks for human users (e.g. making purchases)
- If potential users can use AI assistants to analyze and ask questions about your website
- How your pages appear in search engine results
- Server resource usage
- Etc.
With ongoing advancements in AI, their activity is becoming more meaningful every day.
Is my website really being visited by agents?
Almost certainly. In fact, about half of your traffic is likely coming from them right now. This has been observed across websites of all categories and sizes.
Beoordelingen
Bijdragers & ontwikkelaars
“Dark Visitors – Bot & AI Agent Analytics, Robots.txt Generator & Blocker, LLM Referral Tracker” is open source software. De volgende personen hebben bijgedragen aan deze plugin.
Bijdragers
Interesse in ontwikkeling?
Bekijk de code, haal de SVN repository op, of abonneer je op het ontwikkellog via RSS.
Changelog
1.26.0
- Code updates
1.25.0
- Code updates
1.24.0
- Code updates
1.23.0
- Code updates
1.22.0
- Code updates
1.21.0
- Added new agent types
1.20.0
- Screenshot and copy updates
1.19.0
- Code, design, screenshot, and copy updates
1.18.0
- Code updates
1.17.0
- Code updates
1.16.0
- Code updates
1.15.0
- Code updates
1.14.0
- Code updates
1.13.0
- Code updates
1.12.0
- Code updates
1.11.0
- Code updates
1.10.0
- Code updates
1.9.0
- Code updates
1.8.0
- Copy changes
1.7.0
- Design updates
1.6.0
- Code cleanup
1.5.0
- Simplified the analytics code
1.4.0
- Added the option to block agents
1.3.0
- Added a small edge case fix
1.2.0
- Updated copy
1.1.0
- Added the ability to disable analytics
1.0.0
- Initial release
