Digital Marketing

How to Track Whether AI Engines Are Citing Your Website

How to Track Whether AI Engines Are Citing Your Website
AI VISIBILITY Is ChatGPT Citing Your Website? How to Measure It blogshog.com

You can track AI citations in three ways: read your server logs for AI crawler visits, filter your analytics for referrals from AI hosts, and prompt the AI engines directly to see whether your pages come back. No single method is complete, and none of them is as tidy as Search Console. Together they give you a usable picture of whether AI systems read your site, quote it and send people to it.

This has become a real gap in most reporting setups. A visitor who asks ChatGPT a question, reads the answer, and clicks a cited source arrives at your site through a path your standard dashboards were never designed to describe. Worse, a visitor who reads the answer and does not click has consumed your content without producing a single line in any report you own. If your organic traffic is flat but your content is being used, you would currently have no way of knowing.

What follows is a measurement setup you can build this week, mostly with tools you already have, plus an honest account of what it cannot tell you.

What are the three layers of AI visibility?

Being useful to an AI engine happens in stages, and each stage has its own measurement. Conflating them is the main reason people conclude their AI data is meaningless.

Three layers, three different questions 1. CRAWLED Did a bot fetch the page? Measured in: server logs Look for: GPTBot, OAI- SearchBot, ClaudeBot, PerplexityBot, Google- Extended 2. CITED Does it appear in answers? Measured in: direct prompt testing, or an AI visibility tracking tool Hardest layer to automate and the most valuable 3. CLICKED Did anyone come through? Measured in: analytics referral reports Look for: chatgpt.com, perplexity.ai, copilot, gemini.google.com

Notice the funnel is leaky in an unusual way. A page can be crawled heavily and never cited. It can be cited constantly and clicked rarely, because the answer satisfied the user. And it can produce clicks you cannot attribute at all, because some AI interfaces strip the referrer. Treat the three numbers as three separate health checks, not as a conversion funnel.

How do you check which AI crawlers visit your site?

Server logs are the only honest record of who fetched what. Every AI company that crawls the open web identifies itself with a user agent string, and those strings are published. If you have access to raw access logs through cPanel, your host’s control panel or a CDN dashboard, you can count visits per bot in a few minutes.

# Count AI crawler hits in an Apache or Nginx access log
grep -Eoi "GPTBot|OAI-SearchBot|ChatGPT-User|ClaudeBot|Claude-Web|
PerplexityBot|Perplexity-User|Google-Extended|Applebot-Extended|
CCBot|Bytespider|Amazonbot|meta-externalagent" access.log 
  | sort | uniq -c | sort -rn

# Which URLs is GPTBot actually fetching?
grep "GPTBot" access.log | awk '{print $7}' | sort | uniq -c | sort -rn | head -20
The AI crawlers worth knowing by name User agent Operator What it is doing GPTBotOpenAICollecting pages for model training OAI-SearchBotOpenAIBuilding the ChatGPT search index ChatGPT-UserOpenAIFetching a page live, during a chat ClaudeBotAnthropicCrawling for training and retrieval PerplexityBotPerplexityIndexing for its answer engine Google-ExtendedGooglePermission token for Gemini training CCBotCommon CrawlOpen dataset many models are built on

Two notes on that table. Google-Extended is not a crawler at all — it is a control token you use in robots.txt to allow or block Gemini training, so it will not appear in logs as a fetch. And ChatGPT-User is the most interesting line to watch: it means a real person, mid-conversation, caused your page to be fetched. A rising count there is closer to a traffic signal than anything else in your logs.

Before you measure any of this, confirm you are not blocking the bots you want. A robots.txt that disallows GPTBot guarantees zero citations from ChatGPT’s index, and plenty of sites carry such a rule without realising, inherited from a security plugin or a template. Check your own file first.

Measuring brand visibility across ChatGPT, Gemini and Perplexity.

How do you see AI referral traffic in analytics?

AI referrals already appear in your analytics — they are just scattered across the referral report under hostnames you are not looking for. The fix is to group them into one named channel so you can watch the trend instead of hunting for rows.

  1. Open your referral or source report and sort by sessions. Scan for any host containing chatgpt, openai, perplexity, copilot, gemini, claude, bing with a chat path, or you.com.
  2. Create a custom channel group. In GA4 this is Admin → Data display → Channel groups. Add a channel named “AI assistants” with a rule matching source contains any of those strings.
  3. Apply it going forward. GA4 custom channel groups are not retroactive beyond a limited window, so create this before you need the history, not after.
  4. Add a landing-page breakdown. Which pages AI engines send people to tells you which of your pages they consider authoritative — a far more actionable signal than the total.
  5. Watch engagement separately. AI-referred visitors arrive with a question already half-answered. Their behaviour usually differs sharply from search visitors, and judging them by the same benchmarks will mislead you.
Group the scattered hostnames into one channel chatgpt.com perplexity.ai copilot.microsoft.com gemini.google.com claude.ai Custom channel “AI assistants” One trend line you can actually report Break it down by landing page to see which pages AI engines trust

One caveat that matters more than it sounds. Some AI interfaces, particularly inside mobile apps, pass no referrer at all, so those visits land in your Direct bucket and are indistinguishable from someone typing your URL. If your Direct traffic has grown without explanation, a portion of it may be AI referrals you cannot see. There is no clean workaround; the practical response is to treat Direct growth as a weak corroborating signal rather than a mystery.

How do you test whether AI engines actually cite you?

This is the layer that matters most and the one no dashboard gives you. The method is unglamorous: build a list of the questions your customers really ask, put each one to each engine, and record what comes back. Done consistently, it becomes a rank-tracking equivalent for AI answers.

A prompt set you re-run every month 1 Write 20 to 30 real questions Mix problem questions, comparison questions and brand questions 2 Ask each engine, in a fresh session Memory and chat history will skew the answer, so start clean each time 3 Record three things per prompt Were you cited? Were you named without a link? Who was cited instead? 4 Repeat monthly and compare A single reading is noise. The month-on-month change is the signal.

Record the competitors who get cited in your place. That list is the most useful output of the whole exercise, because it tells you which sources the engines currently treat as authoritative on your topic — and those sources are where your own citations and mentions need to appear.

Several commercial tools now automate this prompt-and-score loop across engines. They save time and nothing more; the underlying method is the one above, and running it by hand for a month teaches you more about your market than a dashboard will. If you do buy a tool, check that it runs fresh sessions, covers the engines your audience actually uses, and reports who was cited instead of you.

A walkthrough of checking whether a brand appears in ChatGPT, Perplexity and Google’s AI results.

Does Search Console show AI Overview data?

Partially, and not in a way you can isolate. Google has said that impressions and clicks from AI Overviews are included in Search Console’s Performance report, but they are blended into the overall Search totals with no separate dimension to filter by. There is no “AI Overviews” row to click.

What you can do is read the pattern. The signature of a page being summarised rather than clicked is impressions holding steady or rising while clicks fall, which shows up as a declining click-through rate on queries that have not changed position. That is suggestive, not conclusive — seasonality and layout changes produce the same shape — so look for it across a group of related queries before drawing a conclusion.

The shape to look for in Search Console Impressions: flat Clicks: falling Position unchanged. People are reading the answer instead of the page. high low

If you see that pattern, the response is not to fight it. The page is doing its job as a source; what it needs is a reason to click that the summary cannot replace — a calculator, a template, current prices, a download, your own data. Pages whose entire value is a definition will keep losing clicks, and no amount of measurement changes that.

What should you actually report each month?

A six-line monthly AI visibility report Metric Where it comes from AI crawler hits, by botServer or CDN logs Pages most fetched by AI crawlersServer or CDN logs Sessions from the AI assistants channelAnalytics custom channel group Landing pages receiving AI referralsAnalytics landing page report Citation rate across your prompt setManual testing or a tracking tool Competitors cited in your placeManual testing or a tracking tool

Six lines is enough. The temptation with a new measurement area is to build something elaborate, and elaborate reports on noisy data produce confident wrong conclusions. Keep it small, keep it monthly, and look at the direction rather than the absolute numbers.

What do you change once you have the data?

The measurement is only worth the hour if it changes what you publish. Three findings come up repeatedly, with three fairly clear responses.

  • Crawled heavily, never cited. The engines can read you but do not find you quotable. Usually a structure problem: the answer is buried three paragraphs in, the heading is a slogan rather than a question, the key fact is inside an image. Rewrite answer-first.
  • Cited but never clicked. Normal and not always a problem. Add something to the page the summary cannot carry, and make sure your brand name sits inside the sentence likely to be quoted, so you get the mention even without the link.
  • Competitors cited consistently in your place. Look at what those pages have that yours does not. Frequently it is first-hand data, a named expert author, a clear publication date, or simply more specific numbers.

All three fixes are content work, not technical work — which is the quiet lesson of AI visibility measurement. The levers are the ones covered in our guide to appearing in Google AI Overviews and the broader piece on ranking factors in the GEO and AEO era. On the technical side, make sure the pages you want cited are indexable in the first place — see crawled but not indexed — that their facts are machine-readable via schema markup, and that crawlers can reach them through sound internal linking. If you are weighing whether to publish an llms.txt file, that piece sets out what it does and does not do.

Start this month, even roughly. The value of AI visibility tracking is almost entirely in the comparison between readings, which means the single most useful thing you can do today is take the first one. More practical guides sit in our technology and digital marketing section.

Can I see AI Overview clicks separately in Search Console?

No. Google includes AI Overview impressions and clicks in the overall Search performance figures but provides no dimension to filter them out. The closest available signal is a declining click-through rate on queries whose average position has not changed, which suggests answers are being read instead of pages being clicked.

Which AI crawler should I look for first in my logs?

ChatGPT-User, because it indicates a live fetch caused by a real person mid-conversation rather than a bulk training crawl. GPTBot and OAI-SearchBot tell you OpenAI has collected your pages; ChatGPT-User tells you someone is actually using them in a conversation right now.

Why does my AI referral traffic look so low?

Partly because it genuinely is still small for most sites, and partly because several AI interfaces, especially mobile apps, send no referrer. Those sessions land in your Direct bucket and cannot be distinguished from someone typing your URL, so your true AI referral figure is higher than the reported one by an unknown margin.

How many prompts should my tracking set contain?

Twenty to thirty is enough to see a trend without the exercise becoming a chore you abandon. Mix three kinds: problem questions your customers ask, comparison questions between you and alternatives, and direct brand questions. Keep the wording identical every month so the readings are comparable.

Should I block AI crawlers to protect my content?

That is a business decision with a clear trade-off: blocking GPTBot or PerplexityBot removes your content from training and indexing, and also removes you from the citations and referral traffic those systems produce. Many publishers block training crawlers while allowing search and live-fetch agents, which keeps citation visibility without feeding model training.

Do AI visibility tracking tools do anything I cannot do by hand?

They automate the prompt-and-score loop across several engines and store the history, which saves real time at scale. The method itself is identical to running the prompts yourself. Running it manually for a month first is worthwhile, because it teaches you what the answers look like before you start reading a dashboard about them.

How often should I re-check AI citations?

Monthly for most sites. AI answers vary between sessions even for identical prompts, so weekly readings mostly capture that noise. A monthly cadence with a fixed prompt set gives you a trend you can act on without over-interpreting normal variation.