Key moments (10)
0:28 Why ChatGPT Is Now Sending Booking Traffic
1:31 The robots.txt File Explained in Plain Terms
2:19 How to Run the Five-Minute Check
3:11 What a Blocking Configuration Looks Like
4:30 Why This Hits Vacation Rental Managers Harder
6:50 What to Do If You’re Blocked
7:44 While You’re In There: Check for GPTBot Too
8:21 Beyond robots.txt: AI Visibility as a Strategy
9:13 What to Do Right Now
There’s a five minute check that tells you the answer and if you’re blocking it you’re invisible to ChatGPT search results right now That’s not a maybe book with Haven confirmed it blocking OAI search bot removes your site from ChatGPT’s answers entirely Let’s walk through exactly what’s happening Why it matters for yo
Read the full written guide: Vacation Rental Management SEO: Rank Above Airbnb
Full transcript
0:00 Intro
There’s a five minute check that tells you the answer and if you’re blocking it you’re invisible to ChatGPT search results right now That’s not a maybe book with Haven confirmed it blocking OAI search bot removes your site from ChatGPT’s answers entirely Let’s walk through exactly what’s happening Why it matters for your home service business and how to fix it in about five minutes?
0:28 Why ChatGPT Is Now Sending Booking Traffic
Travelers have changed how they search a lot of them aren’t typing into Google first anymore They’re opening ChatGPT and asking questions like Best vacation rentals near Asheville or direct booking cabin rentals in the Smokies ChatGPT pulls answers from websites It can crawl if it can crawl yours. You can show up in those answers if it can’t you don’t exist in that conversation That’s new. It’s real and most vacation rental managers haven’t looked at this yet OpenAI sends a crawler to index websites for ChatGPT search That crawler is called OAI search bot. It works a lot like Google bot It visits your site reads your content and decides whether your pages are relevant to what someone just asked chat GPT’s If it can get in you’re in the pool if it hits a wall You’re out the wall is usually a file in your server called robots dot text Most property managers have never looked at that file Some of them are blocking OAI search bot and don’t know it
1:31 The robots.txt File Explained in Plain Terms
Your robots dot txt file is a short text document that lives at your domain slash robots dot txt yes You can see it by typing your URL into a browser and adding slash robots dot txt at the end For example your website dot com slash robots txt that file tells crawlers what they’re allowed to access Lines that start with user agent name the crawler Lines that say disallow tell it what to avoid Here’s the problem some website platforms and security plugins default to blocking all unknown crawlers OAI search bot is new enough that some of those defaults block it step one Open your browser and go to your domain slash robots dot txt
2:19 How to Run the Five-Minute Check
step two Read through the file look for any line that says user agent OAI search bot Followed by disallow go that combination means you’re blocking it step three Also look for user agent Followed by disallow That star means all crawlers including OAI search bot step fours If you’re on WordPress check your SEO plugin settings Yoast rank math and similar plugins control your robots dot txt from the dashboard Step five if you use cloud flare or a firewall plug -in check the bot management settings there, too Firewall sometimes block crawlers at the network level before robots dot txt even comes into play
3:11 What a Blocking Configuration Looks Like
Here’s an example of what blocks OAI search bot user agent OAI search bot disallow that’s it two lines completely invisible to ChatGPT Here’s another version that blocks everything user agent disallow and if your robots dot txt looks like either of those Fix it before you do anything else with your SEO a healthy robots dot txt allows OAI search bot in It either says nothing about OAI search bot at all Which means allow by default or it explicitly says user agent OAI search bot above that with an explicit allow the order in the file matters specific rules above general ones This isn’t a theory Book with Haven documented it clearly blocking OAI search bot removes your site from ChatGPT search answers That means travelers asking ChatGPT questions like best vacation rental managers in Asheville Or direct booking beach house north carolina will not see your property in those results if your site blocks that crawler This is a direct booking opportunity that you’re leaving closed off
4:30 Why This Hits Vacation Rental Managers Harder
Here’s the context that makes this urgent platforms like Airbnb and VRBO dominate Google You probably already know that Competing with them on traditional search takes significant SEO work over a long time But ChatGPT answers are still forming The authority isn’t locked in yet the way it is on Google A manager in Asheville or Boone or the outer banks who is indexed by OAI search bot right now is in a better position than one who waits This is an early window Most of your competitors haven’t checked their robots dot txt for OAI search bot Security plugins are a very common cause of accidental blocks Tools like word fence or IE themes security can be aggressive They sometimes add crawler blocks during a hardening scan Catching and performance plugins are another frequent culprit Some of them modify your robots dot txt file automatically This happens as part of their optimization settings Developer mode is a third cause worth checking A developer may have put the site into maintenance mode That setting can disallow all crawlers from visiting It can persist long after the developer forgot about it Cloudflare bot protection is the fourth common cause Superbot fight mode blocks crawlers not on a known list OAI search bot may not appear on that list by default Your hosting platform defaults are the fifth cause Some vacation rental website builders set conservative crawler rules These restrictions are applied right out of the box Picture a vacation rental company running 15 properties near Asheville They built their website on a popular platform installed a security plugin during setup and the plugin defaulted to blocking all unknown bots They’ve been doing fine on Google so nobody looked at robots dot txt again Meanwhile travelers are asking ChatGPT who manages vacation rentals near Asheville and allows direct booking Their site doesn’t come up A competitor who checked their robots dot txt and allowed oai search bot is showing up instead The fix for the first company Two lines in a text file Five minutes That’s the whole gap
6:50 What to Do If You’re Blocked
If you find oai search bot in a disallow rule, here’s the fix On wordpress with yost or rank math go into the SEO plugin settings Find the robots dot txt editor and add these two lines at the top user agent oai search bot Allow town save it Done If your robots dot txt is a static file on the server Have your developer it and add those same two lines above any wild card rules If the block is at the cloud flare level log into cloud flare go to security and then bots And check whether oai search bot is being challenged or blocked You may need to create a custom rule to allow it through After you make any change verify it by going back to your robots dot text url and checking that the new rules are there You can also use Google’s robots dot txt tester in search console as a secondary check
7:44 While You’re In There: Check for GPTBot Too
oai search bot handles ChatGPT search results But OpenAI also has a training crawler called gpt bot They are separate bots with separate rules You can block gpt bot if you want to protect your content from being used in model training That’s a separate business decision But blocking oai search bot and blocking gpt bot have different effects blocking gpt bot keeps your content out of training data blocking oai search bot keeps you out of ChatGPT answers Don’t confuse them Make sure you’re allowing oai search bot even if you decide to block gpt
8:21 Beyond robots.txt: AI Visibility as a Strategy
bot Fixing robots dot txt is the floor not the ceiling Once you’re accessible to oai search bot The next question is whether your content is actually worth surfacing in ChatGPT answers That means clear specific location based content Who you are where you operate what you manage? direct booking information local area pages ChatGPT tends to surface pages that answer questions directly If your home page is vague and doesn’t say you manage rentals near Asheville or along the blue ridge parkway It has nothing to match to a traveler’s question This is the broader SEO and AI visibility work But none of it matters if you’re blocked at the door Start with the check Here’s your action list
9:13 What to Do Right Now
one Go to your domain slash robots dot txt right now two Search the page for oai search bot three If you see disallow fix it four Check for a wildcard disallow that catches everything Five If you’re on cloud flare check bot rules separately six Verify the fix by reloading the file seven Get a full AI visibility picture That last step is where we come in If you want to know exactly where your site stands for ChatGPT Perplexity and traditional search together Get your free AI visibility check Go to PushLeads dot com slash check or call eight two eight three four eight seven six eight six This is a free check It takes us a few minutes and you’ll know exactly what’s blocking your visibility and what to fix first Go check your robots dot txt right now It’s five minutes that could change whether ChatGPT recommends your properties or your competitors
Up next
12:10Does ChatGPT Only Recommend Airbnb? What 1,407 AI Answers Showed
8:41Do AI Bots Help You Get Cited? What the Research Actually Says
9:12How to Track ChatGPT and Gemini Bookings in Google Analytics
9:56How do contractors get reviews that AI and homeowners both trust?
6:22Do YouTube Videos Help AI Visibility? 4 Weeks of Real Data
9:36Do Customer Reviews Influence What AI Search Recommends?Keep Reading
Want more customers from Google & AI search?
Get a free SEO audit of your site — see exactly what to fix first.
