KeenEthics Labs Logo

How to view LLM bot usage statistics

SimilarWeb AI Chatbot referrals feature
💡

AI platforms interact with websites in two distinct ways:

  1. Automated crawlers generate bot requests that do not execute JavaScript and are only reliably visible in network-level tools. Only Cloudflare can show you insights about them.
  1. Human users querying a site through AI chat interfaces generate referral sessions, which are visible in analytics platforms but are not classified as bots.

Before analysing the data, identify who in your company uses a traffic analytics platform and which platform they use (this may be someone in the tech team, sales or marketing). Then follow the steps below that match your setup.

Cloudflare (AI Crawlers)

💡

Cloudflare AI Crawl Control shows only automated AI crawlers (network-level requests, no JavaScript, classified as bots)

  1. Open the Cloudflare dashboard and select your account and domain. Confirm the domain status is Active.
  1. In the sidebar, click AI Crawl Control.
  1. In the Overview tab, review total AI crawler requests, request trends, common response status codes, most crawled paths, and top crawler providers.
  1. Switch to the Crawlers tab to view request volume per AI crawler provider and manage access rules if needed.
  1. Open the Metrics tab to analyze successful requests over time, status code distribution (2xx, 3xx, 4xx, 5xx), most crawled content paths, referrer discovery patterns (paid plans), and grouping options by crawler, operator, host, or category.

Google Analytics

💡

GA4 shows only human traffic from LLMs. Reports reflect real human visits that originated from AI chat interfaces, not automated crawlers.

  1. Open Google Analytics 4 dashboard and select your account and property.
  1. Open Reports → Acquisition → Traffic or User acquisition.
  1. Set the table dimension to Session source or Session source/medium.
  1. Filter the table by searching AI referral domains: chatgpt.com, claude.ai, gemini.google.com, perplexity.ai, copilot.microsoft.com, etc.

Semrush

💡

Semrush shows only human traffic from LLMs. Reports reflect real human visits that originated from AI chat interfaces, not automated crawlers.

  1. Open AI Visibility Toolkit in Semrush.
  1. Select Visibility Overview. Enter your domain and run analysis.
  1. Check metrics: AI Visibility Score, Monthly Audience, Mentions, Cited Pages.
  1. Open Topic Opportunities and Source Opportunities to find competitor gaps.
  1. Use Prompt Tracking to monitor visibility change over time (if available in your plan)

Ahrefs

💡

Ahrefs shows only human traffic from LLMs. Reports reflect real human visits that originated from AI chat interfaces, not automated crawlers.

  1. Open Ahrefs Web Analytics → Overview.
  1. In Traffic sources, switch to Channels and select LLM (AI).
  1. Click View more to compare AI traffic with other channels.
  1. Go to Traffic sources → Sources to see which AI tools drive traffic.
  1. Review engagement metrics and traffic trends for AI visits.
  1. Export or share the AI traffic report if needed.

SimilarWeb

💡

SimilarWeb shows only human traffic from LLMs. Reports reflect real human visits that originated from AI chat interfaces, not automated crawlers.

  1. Open Similarweb and enter your website domain.
  1. Go to Website Performance → Referrals.
  1. Apply the Traffic Source Group filter.
  1. Select AI Chatbot Referrals.
  1. Review traffic volume, engagement metrics, and trends from AI chatbots.
  1. Open Top Landing Pages from Chatbots to see which pages receive AI-driven visits.