How to Track Your AI Search Visibility: A Simple Monthly Method
A plain-English way for local businesses and agencies to track whether ChatGPT, Perplexity and Google's AI answers name you, month after month, without paying for a tool. ·
Why tracking matters more than a one-time check
A single check tells you where you stand today. It doesn't tell you whether your fixes are working, whether a competitor is pulling ahead, or whether the answer you saw last week was a fluke. AI answers change from day to day and even from one try to the next, so the only way to see real progress is to ask the same questions the same way on a regular schedule and watch the trend.
Our opinion is that a lot of SEO spend is being wasted as AI search grows, partly because businesses keep measuring Google rankings while their customers are asking ChatGPT. AEO is the new SEO, and like SEO it needs a scoreboard. The good news is that you can build one with a spreadsheet and about an hour a month.
Step 1: Pick a fixed set of questions
Write down 10 to 20 questions a real customer would ask, and keep them the same every month. Changing the questions makes it impossible to compare one month to the next.
- Two or three "best [service] in [city]" questions, such as "best roofer in Tampa."
- Two or three urgent questions, such as "emergency plumber near Brandon open now."
- A few specific job questions, such as "who installs heat pumps in Riverview."
- One or two price or comparison questions, such as "how much does a roof inspection cost in Tampa."
- One question with your business name in it, such as "is [your business] any good," to see what AI tools say about you.
Step 2: Ask the same AI tools the same way
Choose the assistants your customers are most likely to use. For most local businesses that means ChatGPT, Perplexity and Google's AI Overviews, plus Gemini or Copilot if you want a wider view.
Ask each question in a fresh chat so earlier questions don't steer the answer. Because answers vary, ask each question two or three times and count it as a mention only if your business shows up in most of the tries. Note the date, the tool and roughly where you were when you asked, since answers can differ by location.
Step 3: Record what you see in a simple sheet
You don't need special software. A spreadsheet with one row per question per tool is enough. For each row, record a few things.
- Were you named? Yes or no.
- Where in the answer? First, in the list, or only mentioned in passing.
- Which competitors were named instead of or alongside you.
- Which sources the tool linked or cited, such as your website, Google, Yelp, Bing Places, Angi, a news story or a Reddit thread.
- Anything wrong it said about you, like old hours, the wrong phone number or a service you don't offer.
Step 4: Turn the sheet into a few numbers you can watch
Once you have a month or two of rows, a few simple numbers tell you most of what you need to know. These are your own counts, not industry benchmarks, so compare them only to your own past months and to the competitors in your sheet.
- Mention rate: the share of questions where you were named, for each tool and overall.
- Top spot rate: how often you were the first business named.
- Competitor share: which competitors show up most, and whether that's changing.
- Source gaps: sites that keep getting cited for competitors but don't list you yet.
- Errors: how many answers had wrong facts about your business.
Step 5: Connect changes to what you fixed
Keep a short log next to your sheet of what you changed and when, such as "claimed Bing Places on the 3rd" or "added an AC repair page on the 10th." When your mention rate moves, you can look back and see what likely helped.
Be patient and honest with yourself about the results. Some fixes, like correcting a listing, can show up in search-connected AI answers within weeks. Others, like building up reviews that name the job and the town, take longer. One good or bad month is noise. Three months in the same direction is a trend.
Common tracking mistakes
- Changing the questions every month, so nothing can be compared.
- Asking once and treating a single answer as the truth.
- Only checking ChatGPT and ignoring Google's AI Overviews and Perplexity.
- Tracking whether you're named but not which sources the tool cited, which is where the fixes usually come from.
- Checking from a logged-in account full of past chats about your own business, which can make the results look better than they are for a stranger.
For agencies: make it a monthly report
If you manage local clients, the same sheet becomes a simple monthly report: the fixed question list, mention rate by tool, the competitors who show up most, the source gaps you're working on and the fixes you made that month. Clients understand "ChatGPT named you in more of these questions than last month" far more easily than a technical audit. Our AEO Deep Dive track covers how to package and report this work.
Next step
Start with a baseline. Run a free AEO check to see whether ChatGPT names your business today, then set a reminder to repeat your question list on the same day each month. If you're new to AEO, start with AEO for Beginners. If you're a marketer or agency, the AEO Deep Dive goes further.
FAQ
What is AI search visibility?
It's how often AI tools like ChatGPT, Perplexity and Google's AI Overviews name or recommend your business when people ask questions you'd want to show up for.
How often should I track my AI search visibility?
Once a month is enough for most local businesses. Use the same questions, the same tools and the same method each time so the months are comparable.
Why do I get a different answer each time I ask ChatGPT?
AI answers vary from one try to the next and can change as the tool finds new information. That's why you should ask each question a few times and look at trends over several months, not single answers.
Do I need a paid tool to track AI visibility?
No. A spreadsheet and a fixed list of questions will do the job. Paid tools can save time if you track many businesses, but the method is the same.
What should I fix first if I'm not being named?
Look at the sources the AI tools cite for your competitors. Listings like Bing Places and your Google Business Profile, matching business details everywhere, and reviews that name the job and town are usually the first gaps to close.