You track AI search visibility by asking AI assistants the same set of real customer questions on a regular schedule, recording whether your business is named, cited, or linked, and comparing those results against referral traffic in your own analytics. AI search visibility means how often, and how accurately, tools like ChatGPT, Gemini, Perplexity, Copilot and Google AI Overviews mention your business when someone asks a question you could answer. There is no single public score for it, so the practical method is a small, repeatable test: a fixed list of five to ten questions, the same assistants each time, and a simple log. Run it monthly at minimum. Then check Google Analytics 4 for visits referred by AI tools and Google Search Console for changes in impressions and queries. Improvement looks like your name appearing in more answers, being described correctly, and sending more measurable visits over several months, not a sudden jump after one week.
What does AI search visibility actually mean?
It is the share of relevant AI answers that include your business, and the quality of those mentions. Being visible is not just a yes or no. There are a few levels worth separating:
- Named: the assistant mentions your business by name.
- Described accurately: your services, location and specialties are correct.
- Cited or linked: the answer points to your website or a page about you as a source.
- Recommended: you appear as an option the assistant suggests, not just a passing reference.
A plumber who is named but described as serving the wrong town has a different problem than one who is never named at all. Tracking these levels separately tells you what to fix.
Which questions should you track?
Track the questions your customers actually ask before they hire someone, phrased the way a person would type or speak them. Good sources for these questions are your phone and email inquiries, the questions your front desk answers every week, and the search terms already showing in Google Search Console.
Aim for a mix:
- Discovery questions: "Who installs pools near [your town]?" or "Which estate planning attorneys work in [your county]?"
- Problem questions: "Why is my AC blowing warm air?" or "What should I do after a minor car accident?"
- Comparison questions: "Should I repair or replace a 15-year-old roof?"
- Brand questions: "What do people say about [your business name]?"
Keep the list fixed once you start. If you change the wording every month, you lose the ability to compare one month to the next. Add new questions as a separate group rather than swapping out old ones.
How do you check AI answers by hand?
Manual checks are slow but reliable, and they cost nothing beyond your time.
Use consistent conditions
Where you can, use a private browser window or a logged-out session so your past conversations do not shape the answer. Include your location in the question itself, because many assistants otherwise guess where you are. Use the same assistants each time.
Run each question more than once
AI answers vary from one run to the next, even with identical wording. Asking each question two or three times in a session gives you a fairer picture than a single attempt. If you appear in one run out of three, record that, rather than rounding it to yes or no.
Save the evidence
Take a screenshot or copy the full answer, including any sources listed. When something changes months later, you will want to see exactly what the assistant said before.
What should you record each time?
A simple spreadsheet works. For each question and assistant, log:
- The date of the check
- The assistant and, if shown, the model name
- The exact question
- Whether your business was named, and in how many runs
- Where in the answer you appeared (first option, one of several, a footnote)
- Whether the description was accurate
- Which sources were cited, and whether any were your own pages
- Which competitors were named instead
That last column matters more than most owners expect. If the same two competitors show up every time, look at what they publish: the topics they cover, how directly their pages answer questions, and where else they are mentioned online. That gives you a concrete content gap to close.
Which AI search metrics can you see in your own analytics?
Your manual log shows what assistants say. Your analytics show whether any of it turns into visits.
Google Analytics 4
In the traffic acquisition report, look at session source. Visits from AI tools often appear with sources such as chatgpt.com, perplexity.ai, gemini.google.com or copilot.microsoft.com. Many owners create a custom channel group that bundles these sources into one "AI assistants" line so the trend is easy to read over time.
Be aware that some visits from AI tools arrive with no referrer and are counted as direct traffic. Your AI referral numbers are therefore a floor, not a full count.
Google Search Console
At the time of writing, Search Console does not offer a separate report for AI Overviews; that activity is counted within your overall Search performance data. Watch for growth in impressions on longer, question-style queries, and for new pages earning impressions on topics you recently published. Those are reasonable signs your content is being surfaced for the kinds of questions AI features answer.
What other signals point to improvement?
Some of the most useful evidence never shows up in a dashboard.
- Ask new customers. Add "an AI assistant like ChatGPT" as an option on your intake form or "how did you hear about us" question.
- Listen to how leads phrase things. Customers who arrive from an AI answer often repeat its wording, or mention that it recommended you.
- Check brand questions for accuracy. If an assistant used to get your service area wrong and now gets it right, that is real progress even if traffic has not moved yet.
How often should you check, and when should you expect change?
Monthly checks are a sensible minimum for most local businesses; weekly is better if you are publishing regularly and want to connect new posts to new mentions. Checking daily mostly measures the natural randomness in AI answers rather than real movement.
Expect change to be gradual. Assistants draw on what is published and indexed across the web, and new pages take time to be found and trusted. Judge progress across a quarter or more, looking at the trend in your log rather than any single result. No one can promise a specific ranking in Google or a specific placement in an AI answer, and you should be wary of anyone who does.
What tracking cannot tell you
Even a careful process has limits, and it helps to know them going in:
- Answers are personalized and variable. What you see may differ from what a customer in another neighborhood sees.
- Models change. An assistant can update its underlying model and shift results overnight, for reasons that have nothing to do with your website.
- Attribution is incomplete. Some people read an AI answer, then search your name on Google or call directly, and that path is hard to trace.
- Visibility is not the same as revenue. Being named matters most for the questions that lead to hiring decisions, so weight those questions more heavily.
Treat your tracking as a directional signal that guides what you publish next, not as a precise scoreboard.
How SEO Web Boss approaches tracking
At SEO Web Boss, we write blog posts for your business that open with a direct answer, link their sources and carry structured data, so they are easier for both Google and AI assistants to quote. Each week we ask the assistants the questions your customers ask and show you who was named, including when it was someone else. Reporting comes from your own Google Analytics 4 and Search Console, so the numbers are yours to check.
If you want a starting baseline before building your own log, our free AI visibility check lets you see what AI assistants say about your business today, with no card required. We ask ChatGPT's model, Claude, Gemini and Perplexity up to five customer questions and email you the report. If you decide to go further, you can get started from $75 a month with no setup fee and no minimum term; all four plans are listed on our pricing page.