If your AI visibility score dropped, check one thing first: did your tracker start asking new questions? New, harder questions pull the average down even when AI tools mention you just as often as before. We now score every business on a fixed set of questions, averaged over four weeks, with a plus-or-minus range.
This is part of our guide to ChatGPT SEO digital marketing. Want it done for you? See our local SEO services.
Key moments (19)
1:03 Who this is for
1:25 One Weekend, Two Opposite Stories
1:58 What Actually Happened That Weekend
2:26 What did the score look like on fixed questions only?
3:02 AI Answers Are Rewritten Every Time
3:47 The Batting Average Problem in AI Tracking
4:22 How Other Tools Handle This Problem
4:49 What exactly goes into an AI visibility score?
5:44 Three Rules for a Trustworthy Score
6:39 What the Method Switch Showed Across Clients
7:17 Two Bugs We Found — and Fixed
7:59 What are Google AI Overviews actually doing right now?
8:45 Fixed Score vs. Shifting Score: Side by Side
9:24 What Rand Fishkin’s Study Confirmed
9:56 Questions to Ask Any AI Visibility Report
10:38 Your Weekly AI Visibility Routine
11:17 Quick Recap
11:34 See Exactly Where Your Business Stands
Full transcript
0:00 AI Visibility Scores: What Really Moves the Number
Our own AI visibility score dropped seven-point-seven points in a single weekend — and the business did nothing wrong. The question list changed overnight. Your AI visibility score dropped. Before you change a single thing about your marketing, check one thing first: did your tracker add new questions? In this video we show you exactly what happened to our own score on a single weekend in November — a seven-point drop that had nothing to do with how well the business was performing. We will walk through why AI scores are harder to measure than Google rankings, the two bugs we found and fixed in our own system, and what Google AI Overviews are doing right now with YouTube links. By the end you will know what a trustworthy AI visibility report looks like — and what questions to ask if yours isn’t one. In the next few minutes, why scores drop without warning, the two bugs we found and fixed, and what a trustworthy AI visibility report looks like.
1:25 One Weekend, Two Opposite Stories
On Saturday, November twenty-first, twenty twenty-six, the PushLeads AI visibility score read thirty-point-seven. Sunday morning it read twenty-three-point-zero. A drop of seven-point-seven points in under twenty-four hours. If you saw that in a client report, you would call it a terrible week. It wasn’t. The questions changed, not the business. The number moved because the question list changed overnight — and that is a problem every AI visibility tracker has to solve.
1:58 What Actually Happened That Weekend
Here is what actually happened. Over that weekend the system added thirty-nine new buyer questions — the kind a restoration company owner types when shopping for marketing help. Those questions were asked for the very first time. Claude linked to PushLeads on about twelve percent of those new answers. Perplexity linked on about thirty-eight percent. Those are low first-week numbers, and when averaged into the headline score they dragged the whole number down. Not because visibility fell. Because the question set got harder.
2:26 What did the score look like on fixed questions only?
What did the score look like on fixed questions only? Now look at the same business using only questions tracked since October twenty-sixth. Week ending October twenty-sixth: twenty-seven-point-two. November second: twenty-nine-point-six. November ninth: thirty-two-point-nine. November sixteenth: thirty-five-point-seven. November twenty-second: thirty-six-point-eight — range plus or minus seven. The score rose every single week. Same business. Same weekend. Two completely opposite stories. The only difference is which questions got counted.
3:02 AI Answers Are Rewritten Every Time
To understand why this matters, you have to understand what makes AI visibility so much harder to measure than a Google ranking. A Google ranking is a position — third or ninth. An AI answer is a paragraph rewritten fresh every time someone asks. A study published in January twenty twenty-six had six hundred volunteers run twelve recommendation questions nearly three thousand times across ChatGPT, Claude, and Google’s AI features. Result: less than a one-in-one-hundred chance ChatGPT or Google’s AI returned the same brand list twice. One answer tells you almost nothing. What matters is how often you show up across many questions and many weeks — and that rate only means something if the questions stay the same.
3:47 The Batting Average Problem in AI Tracking
Think of a batting average. If the coach adds five games against the best pitcher in the league mid-season, the average drops. The hitter did not get worse. The schedule got harder. AI visibility works exactly the same way. New questions start low by definition. When you mix a low first-week score into a mature average, the average falls even if everything else is going up. That same Sunday, the score on our fixed question set read thirty-six-point-eight. The old mixed score read twenty-three.
4:22 How Other Tools Handle This Problem
This is not a problem unique to PushLeads. Peec AI’s research team tells users to freeze the prompt set. Profound’s help center says keep prompts consistent for the reporting window if you want fair comparisons. Classic rank trackers learned this years ago — visibility scores only mean something on a stable keyword list. PushLeads now follows the same rule: two-hundred-twenty-five fixed questions, reviewed once a quarter.
4:49 What exactly goes into an AI visibility score?
What exactly goes into an AI visibility score? Here is what goes into our AI visibility score. First: was the business named in the answer? Second: did the answer link to the website or one of its videos? We count both, on every engine, every week. Third: the question set. The headline uses a fixed set, and new questions get their own line. Fourth: the time window. We pool four weeks of answers and show a range. Fifth: the engines. Google AI Overviews, Google AI Mode, ChatGPT, Perplexity and Claude behave very differently, so each one is reported on its own. Sixth: what happens when Google shows no AI Overview at all. That should not count as a miss, and in our score it does not. Get a Free AI Visibility Check for your business — the link is in the description.
5:44 Three Rules for a Trustworthy Score
As of November twenty-second, twenty twenty-six, every PushLeads client dashboard runs on three rules. Rule one: the headline score only counts questions tracked since October twenty-sixth — two-hundred-twenty-five questions. The set changes only at a scheduled quarterly review, marked on the chart. Rule two: the score pools four weeks of answers and shows a range — for example, thirty-seven plus or minus seven. The range is the honest part. If your score moves three points and the range is seven, nothing has really changed. Rule three: new questions get their own line in the report. Ours reads nineteen on one-hundred-thirty-seven new questions. After four weeks of history they can join the main set at the next quarterly review.
6:39 What the Method Switch Showed Across Clients
When we switched every client account at once, here is what we found. Thirty-six of the fifty-three businesses with enough history moved less than five points — the method change barely touched them. Six went up by five or more points. Eleven went down by five or more. For those accounts, the old mixed number had been sitting higher than the fixed-question score. Five newer accounts are showing a provisional score until they build four weeks of history. A lower number after a method change is not bad news. It is a more honest starting line, and every week after it you are comparing like with like.
7:17 Two Bugs We Found — and Fixed
Rebuilding the score meant reading raw data line by line, and we found two bugs. The first: the service we use to read Google results returned server errors on a slice of AI Overview checks, so some questions were simply missing. The fix was to re-ask any question that errored. On the first run, the system recovered one-hundred-forty-two of the one-hundred-forty-four missing checks. The second bug: one engine’s name-check could not see the business name for some accounts, so it never counted a mention there. Fixed — and we corrected historical answers where the right result was certain. We are telling you about both because a report you cannot question is not worth much.
7:59 What are Google AI Overviews actually doing right now?
What are Google AI Overviews actually doing right now? Now let’s talk about what Google AI Overviews are actually doing right now. For the questions we track for PushLeads, Google showed an AI Overview ninety-seven to ninety-nine percent of the time every single week. They are not going away. What changed is what they link to. In late October, about forty percent of those answers linked to one of our YouTube videos. By mid-November that dropped to about twenty-eight percent. The average answer listed fewer YouTube links — about two per answer at the peak, down to about one-point-four in the latest week. Links to the website stayed in the same range the whole time. If you have been making videos, keep going. Watch the number, and don’t read one month as a trend.
8:45 Fixed Score vs. Shifting Score: Side by Side
Here is a direct comparison to evaluate any AI visibility report. A score worth acting on is built on a fixed question set, shows a range instead of a single number with false precision, tracks new questions separately, reports each AI engine on its own line, excludes no-overview weeks from the miss count, and discloses every method change with before-and-after numbers. A score that is measuring the question list instead of your business does the opposite on most of those. If you go through that checklist and most answers are no, the score may be moving because the tool changed — not because your visibility did.
9:24 What Rand Fishkin’s Study Confirmed
The research backs this up. In January twenty twenty-six, Rand Fishkin of SparkToro and Patrick O’Donnell of Gumshoe-dot-ai ran six hundred volunteers through twelve recommendation questions nearly three thousand times. Finding: less than a one-in-one-hundred chance ChatGPT or Google’s AI returned the same brand list twice. That is not a measurement problem you fix by checking your score more often. It is a reason to track rates across many questions and many weeks — on a stable prompt set so the rate actually means something.
9:56 Questions to Ask Any AI Visibility Report
Three questions to ask about any AI visibility report right now. First: is the headline built on a fixed question set, or does it shift every time questions are added? Second: does it show a range, or one number with false precision? A score of thirty-seven plus-or-minus seven is honest. A score of thirty-seven with no range implies certainty that AI tools simply cannot deliver. Third: are engines reported separately? Google and ChatGPT behave very differently. A single pooled number hides where you are winning and where you are weak. If the answers to those three questions are no, the report is measuring the tool — not your business.
10:38 Your Weekly AI Visibility Routine
A simple weekly routine that takes the guesswork out of this. First, check the fixed-question score — ignore the headline if new questions were recently added. Second, compare four-week trends, not single weeks. Single-week moves under about five points are mostly noise. Third, watch the video-link percentage if your visibility leans on YouTube — that twenty-eight percent share is the number to track. Fourth, review new questions on their own line to find weak areas without letting them rewrite history. Fifth, look at engine-level breakdowns monthly. Sixth, flag any method change immediately and ask for the before and after shown side by side.
11:17 Quick Recap
Quick recap. First, freeze your question set — mixing in new questions drags the score down even when visibility is rising. Second, demand a range, not a single number. Third, check each AI engine on its own line so you can see where you are winning and where you are weak.
11:34 See Exactly Where Your Business Stands
A good AI visibility report shows you the same questions over time, a range instead of false precision, and every AI engine on its own line. That is what we track for every client. See exactly how your business shows up in Google and AI search — find the link in the description, or call eight two eight, three four eight, seven six eight six.
Key Takeaways
- A score built on a growing list of questions can fall while your real visibility rises. Ours did, on the same weekend.
- AI tools rarely give the same answer twice. One study found less than a 1 in 100 chance of getting the same list of brands twice from ChatGPT or Google’s AI.
- Read the trend over four weeks, not one. For a single business, moves under about 5 points are mostly noise.
- New questions belong on their own line. They show where you are weakest, which is useful, but they should not rewrite your history.
- Google AI Overviews are linking to fewer YouTube videos per answer this month. If your AI visibility leans on video, that is the number to watch.
What happened to our own score
We track AI visibility for PushLeads the same way we track it for every client. Every week, our system asks Google AI Overviews, Google AI Mode, ChatGPT, Perplexity and Claude the questions a buyer would ask. For each answer it records two things. Did the answer name the business? Did it link to the business’s website or videos?
In this video
- 0:00 PushLeads Dashboard Reports Overview
- 0:28 Downloading Reports Separately or Combined
- 1:12 Position Tracking and Keyword Rankings
- 1:43 SEO Landscape and Visibility Metrics
- 2:01 AI Search Visibility and Citation Data
- 3:00 Backlinks Authority and Competitor Footprint
- 3:26 Google Analytics Engagement Report
- 4:01 GSC Google Ads and Technical Site Health
- 4:46 SEO Silos Internal Links and Date Ranges
Full transcript: How to Generate SEO Reports in the PushLeads Dashboard
On Saturday, November 21, 2026, our score read 30.7. On Sunday morning it read 23.0. That looks like a terrible week. It wasn’t.
Over that weekend the system added 39 new buyer questions, the kind a restoration company owner types when shopping for marketing help. They were asked for the first time, and we were new on them. Claude linked to us on about 12% of those answers and Perplexity on about 38%. Averaging those first-week results into the score dragged the whole number down.
On the questions we have tracked since October 26, nothing fell. That score went up every single week:
| Week ending | Score on the same questions |
|---|---|
| October 26, 2026 | 27.2 |
| November 2, 2026 | 29.6 |
| November 9, 2026 | 32.9 |
| November 16, 2026 | 35.7 |
| November 22, 2026 | 36.8 (range plus or minus 7) |
Same business, same weekend, two opposite stories. The only difference is which questions got counted.
Want more customers from Google & AI search?
Get a free SEO audit of your site — see exactly what to fix first.
Why AI visibility is harder to measure than Google rankings
A Google ranking is a position. You are third, or you are ninth. An AI answer is a paragraph that gets written fresh every time someone asks. That changes how you have to measure it.
Does ChatGPT give everyone the same answer?
No. In a study published in January 2026, Rand Fishkin of SparkToro and Patrick O’Donnell of Gumshoe.ai had 600 volunteers run the same 12 recommendation questions nearly 3,000 times across ChatGPT, Claude and Google’s AI features. There was less than a 1 in 100 chance that ChatGPT or Google’s AI returned the same list of brands twice.
So one answer tells you very little. What matters is how often you show up across many questions and many weeks. That is a rate, and a rate only means something if the questions behind it stay the same.
Why does adding questions change the score?
Think of a batting average. If the coach adds five games against the best pitcher in the league, the average drops. The hitter did not get worse. AI visibility works the same way. New questions usually come from looking for gaps, so they start low.
Is this how other AI tracking tools handle it?
Yes. Peec AI’s research team tells its users to freeze the prompt set. Profound’s help center says to keep prompts consistent for the reporting window if you want fair comparisons. Classic rank trackers learned this years ago. Their visibility scores only mean something on a stable list of keywords.
How we score AI visibility now
As of November 22, 2026, every client dashboard and report at PushLeads follows three rules.
1. The headline uses a fixed set of questions
The headline score only counts questions we have tracked since October 26, 2026. For PushLeads that is 225 questions. The set changes only at a scheduled review once a quarter, and when it does, we mark the change on the chart.
2. Four weeks of answers, with a range
The score pools every answer from the last four weeks and shows a range, for example 37 plus or minus 7. The range is the honest part. If your score moves 3 points and the range is 7, nothing has really changed yet. Give it another few weeks.
3. New questions get their own score
New questions show up on their own line, right under the headline. Ours reads 19 on 137 new questions. After at least four weeks of history, they can join the main set at the next quarterly review. That way the headline only moves when your visibility moves.
What the switch changed for other businesses
We switched every client account at once. For 36 of the 53 businesses with enough history, the score moved less than 5 points. Six went up by 5 or more, and 11 went down by 5 or more. In those accounts, the old number had been lifted or dragged by newer questions mixed into the average. Five newer accounts show a provisional score until they have four weeks of their own history.
A lower number after a change in method is not bad news. It is a more honest starting line, and every week after it compares like with like.
Two tracking problems we found and fixed
Rebuilding the score meant reading the raw data line by line. We found two problems.
First, the service we use to read Google results returned server errors on a slice of AI Overview checks, so some questions were simply missing that week. The system now re-asks any question that errored. On the first run it recovered 142 of the 144 missing checks.
Second, one engine’s name check could not see the business name for some accounts, so it never counted a mention there. That is fixed too, and we corrected the past answers where the right result was certain.
We are telling you about both because a report you cannot question is not worth much. When our measurement changes, you should hear it from us, with the before and the after.
What Google AI Overviews are doing right now
For the questions we track for PushLeads, Google showed an AI Overview about 97% to 99% of the time, every week. They are not going away. What changed is what they link to.
In late October, about 40% of our AI Overview answers linked to one of our YouTube videos. By mid-November it was about 28%. Over the same weeks, the average answer listed fewer YouTube links overall, about 2 per answer at the peak and about 1.4 in the latest week. Links to our website stayed in the same range the whole time.
If you have been making videos, keep going. More than a quarter of those answers still link to one of our videos. Just watch this number, and don’t read one month as a trend. We covered the earlier side of this story in our four weeks of YouTube and AI visibility data and in what Google’s AI Mode tests mean for local businesses.
Questions to ask about any AI visibility report
Whether you use us or someone else, these questions tell you if a score is worth acting on:
- Is the headline built on a fixed set of questions, or does it shift every time questions are added?
- Does it show a range, or one number with false precision?
- Are new questions tracked separately?
- Can you see each AI engine on its own? Google and ChatGPT behave very differently.
- When Google shows no AI Overview at all, does that count as a miss? It shouldn’t.
- When the method changes, do they tell you and show the before and after?
If most of the answers are no, the score may be measuring the question list more than your business.
The technical details
Want the formula, the error-range math and the research behind it? We published the full technical write-up on Incredible Roots: measuring AI visibility on a growing prompt set.
Frequently Asked Questions
What is an AI visibility score?
An AI visibility score measures how often AI tools like ChatGPT, Perplexity, Claude and Google’s AI Overviews mention or link to your business when someone asks a buying question. In our tracking it blends how often you are named and how often your site or videos are linked, with the most weight on questions from people ready to hire.
Why did my AI visibility score drop?
Check whether the question list changed first. If new, harder questions were added, the average drops even when nothing about your business changed. Compare the score on the same questions over the same weeks. If that number fell too, the drop is real and worth digging into.
In this video
- 0:00 Intro to PushLeads and Client Work
- 1:10 Why Jeremy Built the Dashboard
- 1:35 AI Visibility Snapshot Explained
- 2:48 Regular SEO Visibility and Rankings
- 3:13 Landscape Tab and Keyword Overview
- 3:43 AI Visibility by Engine and Prompts
- 4:22 Analytics Traffic and Google Ads Data
- 4:56 Website Silos Internal Links Site Report
- 5:31 How Clients Access and Use Dashboard
How much does an AI visibility score change from week to week?
For a single business, moves under about 5 points are mostly noise, because AI tools rarely give the same answer twice. That is why we show a four-week average with a range. Treat a change as real when it holds for several weeks and clears the range.
How often should I check my AI visibility?
Weekly tracking with a monthly review works well for most local businesses. Weekly data catches problems early. A monthly look at the four-week average keeps you from reacting to noise.
Does YouTube help with AI visibility?
Yes. In our own tracking, Google AI Overviews linked to one of our YouTube videos on roughly 25% to 40% of answers in each of the past four weeks. That share dipped in November as Google listed fewer YouTube links per answer, so it is worth watching, but video is still one of the most cited formats we track.
Why is my score different from another tool’s score?
Every tool asks different questions, checks different AI engines and weighs mentions and links differently. Scores from two tools are not comparable. Compare a tool only with itself, on the same questions, over time.
See where your business stands
A good AI visibility report shows you the same questions over time, a range instead of false precision, and every AI engine on its own. That is what we track for every client.
See exactly how your business shows up in Google and AI search with a free AI Visibility Check at pushleads.com/check or call 828-348-7686.
Keep Reading
Want more customers from Google & AI search?
Get a free SEO audit of your site — see exactly what to fix first.
Your path · What Is SEO? The Complete Guide to Search Engine Optimization for Businesses
Keep going: read these next
You’re hereWhy Your AI Visibility Score Jumps Around, and How to Read ItUp nextSEO Analytics and Reporting Research Report: Measuring Success That Actually Drives Business Results
AI-SEO: How Artificial Intelligence is Revolutionizing Search Rankings in 2026
Visual and Video SEO: The definitive guide to optimizing for image and video search in 2026
What Is SEO? The Complete Guide to Search Engine Optimization for Businesses
Want this done for you?
Scan your site. See the gaps. Decide with numbers.
- Rankings, Google Business Profile and site-speed teardown
- Report lands in your inbox in about a minute
- No obligation · 4.9 from 67 Google reviews



