One line in your robots.txt can hide you from a billion people. Here is how to check.

There is a line you can put in your robots.txt file that takes you out of a product with a billion monthly users. It does not touch your Google rankings. It does not throw a warning in Search Console. Nothing breaks. You just quietly stop existing inside the assistant that a billion people now ask questions to every month.

Most business owners have never heard of it. A lot of the ones who have heard of it added it on purpose in 2024, because someone on LinkedIn told them to "block the AI scrapers", and they have never gone back to look.

That line is Disallow: / under User-agent: Google-Extended. This guide is about what it actually does, and about the wider game: how to get named by Gemini in 2026 when ranking on page one no longer guarantees you anything.

Gemini SEO is not AI Overviews SEO. Stop treating them as the same thing

Nearly every "Gemini SEO" guide you will find is actually an AI Overviews guide with the word Gemini pasted over the top. That is lazy, and it will cost you.

Google has two different surfaces here and they behave differently:

• Google Search AI surfaces. AI Overviews and AI Mode, sitting inside google.com. Built off the Search index. Governed by Googlebot and the normal snippet controls you already know.
• Gemini Apps. The Gemini app on your phone, gemini.google.com, and Gemini pulled into Workspace. When Gemini needs live web information, it uses Grounding with Google Search. That grounding respects a separate token called Google-Extended.

Same company. Same underlying model family. Two different permission systems. You can be everywhere in AI Overviews and completely absent from the Gemini app, and no dashboard on earth will tell you.

That is the gap. That is why this post exists.

The billion person surface most SEOs are not measuring

On 11 August 2026 Sundar Pichai announced the Gemini app had passed one billion monthly active users, calling it the fastest growing product in Google's history and the company's fourteenth to cross a billion. The growth curve is brutal: 400 million in May 2025, over 650 million by the October 2025 earnings call, above 900 million at I/O in May 2026, 950 million in the Q2 2026 filing, then a billion.

Google also says 63% of those users now talk to Gemini directly by voice, and the app handles actions across more than 40 Android apps.

Read that again, but as a business owner rather than a marketer. Someone in your town is standing in their kitchen saying "who should I call about a leaking flat roof" out loud into their phone. A name comes back. It is either yours or it is your competitor's. There is no page two of that answer. There is no "we came a close fourth". You are said out loud or you are nothing.

We hammer this point in the Dojo because it changes how you write everything. Google hands out links. Gemini hands out a verdict.

The Google-Extended trap, explained properly

Google-Extended is not a crawler. That is the first thing almost everyone gets wrong. Nothing on the internet has ever been visited by a bot called Google-Extended. It is a token you put in robots.txt that tells Google what it may do with content Googlebot has already fetched.

Google introduced it on 28 September 2023, back when the product was still called Bard, and updated the documentation after the Bard to Gemini rename to make clear it covers Gemini Apps and Vertex AI generative APIs.

Here is what actually controls what:

Google's own Gemini Enterprise grounding documentation says it plainly: Grounding with Google Search does not use web pages that have disallowed Google-Extended. That is not a rumour from an SEO forum. That is Google telling you the rule in its developer docs.

So the trade is real, and it is a trade, not a trick. If you genuinely do not want your work used to train Gemini models, blocking Google-Extended is the correct lever. Just go in with your eyes open: you are also switching off the app's ability to ground an answer in your site.

The people who get burned are the ones who never made that decision. They pasted a "block the AI bots" snippet off a blog in 2024, or a plugin or a CDN preset did it for them, and they have been invisible in a billion user product ever since while wondering why the AI never mentions them.

How to check yours in 60 seconds

1. Open yourdomain.com/robots.txt in a browser. Yes, just type it.
2. Search the page for Google-Extended. If it is not there at all, you are fine. Absence means allowed.
3. If it is there with Disallow: /, you are out of Gemini App grounding. Decide on purpose whether you want that.
4. While you are in there, check for GPTBot, OAI-SearchBot, PerplexityBot and ClaudeBot. Same logic, different front doors.
5. Check your CDN too. We covered the Cloudflare default block properly in this piece on AI crawler blocking, and it is the single most common way sites get walled out without anyone touching robots.txt.

That is a five minute job. Agencies have charged four figures for that audit. Do it yourself tonight.

How Gemini actually decides who gets named

Once you are eligible, eligibility is not the same as being chosen. Here is the mechanism.

1. Query fan-out means your keyword is not the query anymore

Ask Gemini one question and it does not run one search. It splits your question into a spread of sub-questions, runs those, and assembles an answer from the results. You are no longer competing for "best accountant Newcastle". You are competing for a dozen sub-queries you never saw, about fees, qualifications, response times, reviews and specialisms.

The practical read: a page that answers one keyword well loses to a page that answers the whole cluster of adjacent questions clearly.

2. Ranking top ten is no longer the price of entry

This is the number that should reset your strategy. Ahrefs analysed 863,000 keywords and roughly 4 million AI Overview URLs and found that only 38% of cited pages also rank in Google's top ten for that query. In their July 2025 study that figure was 76%. Just over 30% of citations now come from pages ranking 11 to 100, and a similar share from pages that do not rank in the top 100 at all.

A separate Moz analysis of 40,000 AI Mode queries put the overlap with the organic top ten at around 12%.

Two things follow from that, and they point in opposite directions to what most people assume:

• Bad news for the smug. Your page one ranking is not a moat. Sixty percent of the answer is being built from pages that are not beating you in the SERP.
• Very good news for the small. You do not need to outrank a national brand to get named next to it. You need to be the clearest, most extractable answer to one of those sub-questions.

That second point is the entire opportunity, and the window is open right now.

3. Gemini stacks a lot of sources, and it likes other people's opinions of you

Orbit Media's study of 13,184 citations across four AI tools found Gemini averages around 8.1 sources per answer and leans heavily on Reddit and listicle roundups. Broader data on Google's AI surfaces shows a heavy skew to Google owned properties, with YouTube alone taking a large share of citations.

Translate that into moves. Getting into one "best plumbers in Leeds" roundup that Gemini already trusts does more than your next four blog posts. A genuinely useful Reddit answer in the right subreddit does more than a press release. A YouTube video answering the exact question gets you into a citation pool your website cannot reach.

Your own site saying you are the best is worth close to nothing. The machine reads what other people say about you. That is the whole game, and it is covered end to end in our entity SEO guide.

The seven moves, in the order that actually works

Do these in order. Skipping to move six because it sounds fun is why most people get nowhere.

Move 1: Clear the blockers

robots.txt, CDN bot rules, WAF settings, any "AI protection" toggle your host added. Confirm Googlebot is unrestricted and decide deliberately on Google-Extended. Nothing else matters until this is done.

Move 2: Make one page answer-first

Pick your money page. Put the exact question as an h2. Put a clean 40 to 60 word answer directly underneath it, in plain language, no throat clearing, no "in today's fast paced world". That block is what gets lifted. Everything below it is for humans.

Move 3: Chunk the rest of the page

Gemini does not read your page. It reads a chunk of it. Each h2 section should stand alone and make sense with zero context from the section above. One idea, one heading, one self contained answer. We break this down with real before and after examples in the chunking guide.

Move 4: Fix your entity signals

One business name, spelled identically everywhere. One category description. Same address, same phone, same founder name. Organization and LocalBusiness schema on the site. A real About page with a real human on it. Machines learn you exist through consistency, and inconsistency is the most common reason a small business is simply not in the model's world.

Move 5: Answer the fan-out, not the keyword

List the twelve questions a buyer asks before they hire you. Price, timeline, guarantees, what goes wrong, how you compare to the alternative, who you are not right for. Answer each one in its own chunk. That is how one page covers a fan-out instead of one keyword.

This is the part agencies bill $2,000 a month for. It is one focused afternoon once someone shows you the order to do it in.

Move 6: Get into other people's sources

Roundups, comparison posts, directories, industry lists, Reddit threads, YouTube. Not spam. Real contribution, real usefulness, real disclosure where it matters. Getting into three lists that Gemini already cites beats writing your four hundredth blog post. If you want that done for you at pace, that is what our link building work exists for.

Move 7: Measure it like an adult

Pick ten prompts a real customer would say out loud. Run them in the Gemini app, in AI Mode and in ChatGPT once a fortnight. Log whether you are named, who else is, and which URL got cited. That log is worth more than any dashboard, because it is your actual market, not a vendor's sample.

How long it takes

Anyone promising you a Gemini citation by a specific date is guessing. We will not do that, and neither should anyone taking your money.

What it costs

Who this suits, and who it does not

Do this now if: you sell something people ask an assistant about before buying. Trades, local services, professional services, software, anything with a "best X for Y" search behind it. Also do it if you already rank well and traffic is sliding anyway. That gap between ranking and being cited is exactly what is eating you.

Do not bother yet if: your site is not indexed at all, you have no business name consistency, or you have never had a customer from search. Fix the foundations first. Our SEO service page covers what those foundations are, and local SEO if you serve an area rather than the world.

Tools worth using

• Google Search Console. Free, and it now reports AI surface data. Start here before you buy anything.
• Your own browser. Running the ten prompts by hand costs nothing and is more honest than most paid tools.
• A crawler such as Screaming Frog to confirm nothing is blocked or noindexed by accident.
• Schema validators to confirm your Organization and LocalBusiness markup is actually parsing.
• Paid AI visibility platforms if you need board level reporting. Useful, not magic, and not the first thing you should buy.

We keep the current shortlist and the prompt templates in The Armory.

The mistakes that keep you out of the answer

• Blocking Google-Extended by accident and never checking. The single most expensive line in SEO right now.
• Burying the answer. Four paragraphs of scene setting before you answer the question. The machine takes the clearest block, not the most heartfelt one.
• Treating Gemini and AI Overviews as one target. Different permission model, different behaviour, different fix.
• Writing more instead of writing clearer. Your four hundredth post is not the problem. Your unextractable page is.
• Only optimising your own site. The model trusts everyone except you. Third party mentions are the lever.
• Chasing rankings as the only KPI. Thirty eight percent overlap. Your rank report is now describing a different competition to the one you are in.
• Quitting at week six. Everyone does. That is why the window is still open.

The alternatives, honestly

You do not have to play this game. The alternatives are real, and each has a cost.

Paid ads. Instant, controllable, and you stop existing the moment you stop paying. Fine as a floor, terrible as a foundation.

Ignore AI search entirely. Defensible if your buyers are all referral or offline. Reckless if any part of your pipeline starts with a question typed or spoken into a device.

Pay someone to run it. Perfectly sensible if you would rather buy back the time. That is what Done For You is.

What could change, and what to watch

This moves fast, so hold your plan loosely and your fundamentals tightly.

Gemini 3 became the default model behind AI Overviews on 27 January 2026, and analysis suggests it replaced a very large share of the domains that had previously been cited. Model swaps reshuffle the citation deck. If you dropped out of answers in late January, that is very likely why, and it was not a penalty.

Expect more of that. Expect the crawler and permission landscape to keep splintering as more publishers and CDNs put up walls. Expect measurement to keep improving inside Search Console.

What will not change: clear answers, consistent identity, and other people vouching for you. Those three have survived every algorithm shift of the last twenty years and they will survive this one. Everything in this guide is just a 2026 shaped version of them.

Do this today

Open your robots.txt. Search for Google-Extended. Then open the Gemini app and ask it the question your best customer would ask. Whatever comes back is your real starting position, and it takes four minutes to find out.

If you want the whole system rather than a to do list, the checklists, the prompt bank, the schema templates and the tracker all live in one place. Join The Dojo. $67/mo.