Key moments (12)
1:02 Who Jeremy Ashburn and PushLeads Are
1:57 Why the Question List Changed Overnight
2:26 Fixed Questions Tell the Real Story
3:01 Why AI Is Harder to Measure Than Google
4:45 How PushLeads Builds Its Visibility Score
6:43 What Happened When We Audited All Clients
7:16 Two Bugs We Found and Fixed
7:59 What Google AI Overviews Are Doing Now
8:45 Checklist for a Trustworthy AI Report
9:56 Three Questions to Ask Your Tracker
10:38 Weekly Routine to Read Your Score Right
Our own AI visibility score dropped 7. 7 points in a single weekend, and the business did nothing wrong.
Read the full written guide: Why Your AI Visibility Score Jumps Around, and How to Read It
Full transcript
0:00 AI Visibility Score Dropped 7.7 Points
Our own AI visibility score dropped 7.7 points in a single weekend, and the business did nothing wrong. The question list changed overnight. Your AI visibility score dropped. Before you change a single thing about your marketing, check one thing first. Did your tracker add new questions? In this video, we show you exactly what happened to our own score on a single weekend in November. A 7 -point drop that had nothing to do with how well the business was performing. We will walk through why AI scores are harder to measure than Google rankings, the two bugs we found and fixed in our own system, and what Google AI overviews are doing right now with YouTube links. By the end, you will know what a trustworthy AI visibility report looks like, and what questions to ask if yours isn’t one. In the next few minutes, why scores drop without warning, the two bugs we found and fixed, and what a trustworthy AI visibility report looks like.
This is part of our guide to ChatGPT SEO digital marketing.
1:02 Who Jeremy Ashburn and PushLeads Are
Real quick, who am I to say this? I’m Jeremy Ashburn, and PushLeads is my agency. We work with owners of local service businesses who get an AI visibility report every single day. I’ve been doing this for over 20 years long before AI made it fashionable. What we’re doing in this video is why a falling AI visibility score is often a measurement change, not a real drop. On Saturday, November 21, 2026, the PushLeads AI visibility score read 30.7. Sunday morning it read 23.0, a drop of 7 .7 points in under 24 hours. If you saw that in a client report, you would call it a terrible week. It wasn’t. The questions changed, not the business. The number moved because the question list changed overnight, and that is a problem every AI visibility tracker has to solve.
1:57 Why the Question List Changed Overnight
Here is what actually happened. Over that weekend, the system added 39 new buyer questions, the kind of restoration company owner types when shopping for marketing help. Those questions were asked for the very first time. Clawed link to PushLeads on about 12% of those new answers. Perplexity linked on about 38%. Those are low first week numbers, and when averaged into the headline score, they dragged the whole number down. Not because visibility fell, because the question set got harder.
2:26 Fixed Questions Tell the Real Story
What did the score look like on fixed questions only? Now look at the same business using only questions tracked since October 26, week ending October 26, 27.2, November 2, 29.6, November 9, 32.9, November 16, 35.7, November 22, 36.8, range plus or minus seven. The score rose every single week. Same business, same weekend. Two completely opposite stories. The only difference is which questions got counted.
3:01 Why AI Is Harder to Measure Than Google
To understand why this matters, you have to understand what makes AI visibility so much harder to measure than a Google ranking. A Google ranking is a position, third or ninth. An AI answer is a paragraph rewritten fresh every time someone asks. A study published in January 2026 had 600 volunteers run 12 recommendation questions nearly 3 ,000 times across ChatGPT, Clawed and Google’s AI features. Result, less than a 1 in 100 chance ChatGPT or Google’s AI return the same brand list twice. One answer tells you almost nothing. What matters is how often you show up across many questions and many weeks. And that rate only means something if the questions stay the same. Think of a batting average. If the coach adds five games against the best picture in the league mid -season, the average drops. The hitter did not get worse. The schedule got harder. AI visibility works exactly the same way. New questions start low by definition. When you mix a low first week score into a mature average, the average falls even if everything else is going up. That same Sunday the score on our fixed question set read 36 .8, the old mixed score read 23. This is not a problem unique to PushLeads. Peace AI’s research team tells users to freeze the prompts set. Profounds Help Center says keep prompts consistent for the reporting window if you want fair comparisons. Classic ranked trackers learn this years ago. Visibility scores only mean something on a stable keyword list. PushLeads now follows the same rule.
4:45 How PushLeads Builds Its Visibility Score
225 fixed questions reviewed once a quarter. What exactly goes into an AI visibility score? Here’s what goes into our AI visibility score. First was the business named in the answer. Second, did the answer link to the website or one of its videos? We count both on every engine every week. Third, the question set. The headline uses a fixed set and new questions get their own line. Fourth, the time window. We pool four weeks of answers and show a range. Fifth, the engines. Google AI overviews, Google AI mode, ChatGPT, Perplexity and claud, behave very differently. So each one is reported on its own. Sixth, what happens when Google shows no AI overview at all? That should not count as a miss and in our score it does not. Get a free AI visibility check for your business. The link is in the description. As of November 22, 2026, every PushLeads client dashboard runs on three rules. Rule one, the headline score only counts questions tracked since October 26, 225 questions. The set changes only at a scheduled quarterly review marked on the chart. Rule two, the score pools four weeks of answers and shows a range. For example, 37 plus or minus seven. The range is the honest part. If your score moves three points and the range is seven, nothing has really changed. Rule three, new questions get their own line in the report. Ours reads 19 on 137 new questions. After four weeks of history, they can join the main set at the next quarterly review. When we switched every client account at once, here is what we found.
6:43 What Happened When We Audited All Clients
36 of the 53 businesses with enough history moved less than five points. The method change barely touched them. Six went up by five or more points. 11 went down by five or more. For those accounts, the old mixed number had been sitting higher than the fixed question score. Five newer accounts are showing a provisional score until they build four weeks of history. A lower number after a method change is not bad news. It is a more honest starting line and every week after it, you are comparing like with like.
7:16 Two Bugs We Found and Fixed
Rebuilding the score meant reading raw data line by line and we found two bugs. The first, the service we used to read Google results returned server errors on a slice of AI overview checks. So some questions were simply missing. The fix was to re -ask any question that aired. On the first run, the system recovered 142 of the 144 missing checks. The second bug, one engine’s name check could not see the business name for some accounts. So it never counted a mention there. Fixed and we corrected historical answers where the right result was certain. We
7:59 What Google AI Overviews Are Doing Now
what are Google AI overviews actually doing right now? Now let’s talk about what Google AI overviews are actually doing right now. For the questions we track for PushLeads, Google showed an AI overview 97 to 99% of the time every single week. They are not going away. What changed is what they linked to. In late October, about 40% of those answers linked to one of our YouTube videos. Mid -November that dropped to about 28%. The average answer listed fewer YouTube links about two per answer at the peak down to about 1.4 in the latest week. Links to the website stayed in the same range the whole time. If you have been making videos, keep going. Watch the number and don’t read one month as a trend.
8:45 Checklist for a Trustworthy AI Report
Here is a direct comparison to evaluate any AI visibility report. A score worth acting on is built on a fixed question set, shows a range instead of a single number with false precision, tracks new questions separately, reports each AI engine on its own line, excludes no overview weeks from the miscount, and discloses every method change with before and after numbers. A score that is measuring the question list instead of your business does the opposite on most of those. If you go through that checklist and most answers are no, the score may be moving because the tool changed, not because your visibility did. The research backs this up. In January 2026, Ran Fishkin of SparkToro and Patrick O ‘Donnell of Gumshoe Dade ran 600 volunteers through 12 recommendation questions nearly 3,000 times, finding less than a 1 in 100 chance, ChatGPT or Google’s AI returned the same brand list twice. That is not a measurement problem you fix by checking your score more often. It is a reason to track rates across many questions in many weeks, on a stable prompt set so the rate actually means something.
9:56 Three Questions to Ask Your Tracker
Three questions to ask about any AI visibility report right now. First, is the headline built on a fixed question set or does it shift every time questions are added? Second, does it show a range or one number with false precision? A score of 37 plus or minus 7 is honest. A score of 37 with no range implies certainty that AI tools simply cannot deliver. Third, are engines reported separately. Google and ChatGPT behave very differently. A single pooled number hides where you are winning and where you are weak. If the answers to those three questions are no, the report is measuring the tool, not your business.
10:38 Weekly Routine to Read Your Score Right
A simple weekly routine that takes the guesswork out of this. First, check the fixed question score. Ignore the headline if new questions were recently added. Second, compare four -week trends, not single weeks. Single week moves under about five points are mostly noise. Third, watch the video link Fourth, review new questions on their own line to find weak areas without letting them rewrite history. Fifth, look at engine level breakdowns monthly. Sixth, flag any method change immediately and ask for the before and after shown side by side. Quick recap. First, freeze your question set. Mixing in new questions drags a score down even when visibility is rising. Second, its own line so you can see where you are winning and where you are weak. A good AI visibility report shows you the same questions over time, a range and set of false precision and every AI engine on its own line. That is what we track for every client. See exactly how your business shows up in Google and AI search. Find the link in the description or call 828 -348 -7686.
Up next
6:31Is Google Removing AI Mode and AI Overviews? What Local Businesses Should Know
10:19Why does ChatGPT recommend Angi instead of your remodeling company?
11:20Is anyone actually getting phone calls from ChatGPT?
10:37Is Your Vacation Rental Website Blocking ChatGPT?
12:10Does ChatGPT Only Recommend Airbnb? What 1,407 AI Answers Showed
8:41Do AI Bots Help You Get Cited? What the Research Actually SaysKeep Reading
Want more customers from Google & AI search?
Get a free SEO audit of your site — see exactly what to fix first.
