How I measure AI search visibility without confusing mentions with results

1. Decide which outcome you are measuring

When someone says their business is visible in AI search, I ask what they saw. Was the company named? Was its website cited? Was the recommendation accurate? Did anyone visit or enquire? Each observation can be useful, but combining them into one score can hide the work the business actually needs.

I also record inaccurate descriptions. Being mentioned for a service you do not offer can create the wrong enquiries. An AI visibility audit should examine the quality of the representation, not just whether the name appears.

2. Build a question set around the buying decision

I start with the services, products and markets the business can genuinely serve. Then I collect the questions buyers ask while discovering options, comparing suppliers and checking fit. A branded question belongs in its own group because it is a different test from a question that never names the business.

For a specialist software provider, I might test the problem the software solves, the integrations a buyer needs and the implementation concerns raised before a demonstration. I would not fill the list with dozens of slight rewrites of “best software company” just to create a larger report.

I keep a fixed core set for comparison and a separate exploratory list for new questions. Otherwise, changing the questions every month can make a result look like progress when the test itself has changed. The question set is a research sample, not a claim about the number of people searching.

3. Make the observation repeatable

For each test, I record the exact question, platform, date, language, market setting where available and whether a fresh conversation was used. I retain the visible answer and source URLs. If a follow-up question was involved, I keep that context too.

• Keep the conditions clear: compare the same question groups under documented conditions.
• Inspect the source: check whether the citation points to the intended page and supports the statement.
• Repeat observations: distinguish an isolated appearance from a recurring pattern.
• Record absence: a test without a mention belongs in the denominator.
• Separate platforms: do not treat different answer systems as one identical ranking list.

Here is an illustrative calculation: if a brand appears in 6 of 20 recorded answers, that is a 30% mention rate within that sample. It is not 30% of all AI searches, and it says nothing about clicks. I would report the dates and question group beside the number.

4. Connect observations with analytics carefully

I review identifiable AI referral traffic in analytics, then examine landing pages, engagement and agreed conversion events. Some journeys will not carry a clear source. I do not relabel unexplained direct traffic as AI traffic just because visibility observations improved during the same period.

Google’s AI features guidance explains that AI Overviews and AI Mode appearances are included in Search Console’s overall Web performance reporting. That is not a separate, complete AI attribution report. I keep that distinction when discussing organic search changes with clients.

For enquiries, a short optional “How did you hear about us?” question can add context, but I label it as self-reported information. It can complement the tracked journey rather than replace it. My analytics work focuses on a defensible connection between discovery and useful action, including the gaps we cannot resolve.

5. Turn the report into a useful next step

If the business is repeatedly described incorrectly, I review its service information and the sources contributing to that description. If an answer cites a weak or outdated page, I inspect the page’s accuracy, usefulness and links. If visits arrive but do not convert, the next task may be the offer or enquiry experience rather than more visibility tests.

Google says there is no special AI schema required for its Search AI features. I therefore prioritise accessible, accurate content and consistent business information over selling an extra markup file as a shortcut. That guidance is specific to Google’s Search features; I do not turn it into a claim about every AI product.

My AI citation work and ongoing monitoring serve different purposes. One addresses how information can be supported and discovered; the other checks what is actually observed over time. The monthly discussion should end with a decision, an owner and a way to assess the change.

Common questions