ChatGPT Does Not Search for What You Typed: What a Study of 4,200 Runs Shows
When ChatGPT searches the web, it does not search for your exact question. A 2026 study of about 4,200 runs found it rewrites the question into its own queries, retrieves a different set of pages almost every time, and cites a small group that keeps turning up.
A business owner types a question into ChatGPT and assumes ChatGPT searches for those words. A study published in October 2026 watched what happens instead. We sell an AI visibility audit and a tool, so weigh our reading as a seller's account. The study and OpenAI's own documents are linked so you can check them.
What did the study do?
Researchers at Xi'an Jiaotong University and the National University of Singapore took 80 real questions and sent each one repeatedly to four versions of ChatGPT between late March and late July 2026, about 4,200 runs in all. They recorded three things a user never sees: the searches ChatGPT ran, the pages it retrieved, and the pages it then chose to cite. Read the author's summary.
Does ChatGPT search for the words you type?
Usually not. The two newest fast versions mostly turned a question into a single search query of their own, in English, even when the question was written in Chinese. The slower "thinking" version ran nearly 12 searches per question across about three rounds, and its later searches grew narrower. OpenAI confirms the general behaviour: its help page says ChatGPT search "typically rewrites your query into one or more targeted queries". OpenAI help page.
Does it find the same pages each time?
No. The same question run twenty times produced twenty noticeably different sets of pages.
| What was measured | Result |
|---|---|
| Pages that appeared in one run out of twenty | Roughly 40% |
| Pages that appeared in most runs | Under 10% |
| Pages ranked below fifteenth in ChatGPT's own results that were still cited | About one in five |
| Pages ChatGPT cited that Google's results also contained | Under 10% |
| Sites ChatGPT cited that Google and OpenAI's developer tool found together | About half |
Which pages get cited?
The ones that keep turning up. A page retrieved often across runs was more likely to be cited in any single run. Where a page sat in ChatGPT's results mattered without deciding the outcome. How recent the page was barely registered.
The authors add a caution we repeat here: this does not mean publishing more pages earns more citations. They observed a pattern. They did not test a method.
What does this mean for a small business?
Three things follow from the study. They are our reading, not the authors' advice.
- One answer tells you little. If you check ChatGPT once and see your name, or do not, you have seen one run out of many. Check several times on different days.
- Think about your site, not one page. The sites ChatGPT cited were steadier between runs than the exact pages. The authors caution that their results do not support separate conclusions for brands.
- Your Google position is a weak guide. Google's results contained under 10% of the pages ChatGPT cited.
What we saw in our own small test
On 19 November 2026 we asked ChatGPT two buyer questions without using our name. It named us in one. A third-party tracker, Mentionbird, recorded a ChatGPT answer on 13 November 2026 that listed us among four names. Six days later a different AI tool, asked a similar question, left us out. That fits the study: answers move. Read our full record.
On 20 November 2026 we asked ChatGPT one more buyer question, again without our name. This is the answer it gave.
ChatGPT, 20 November 2026. The wording in the screenshot is ChatGPT's, not ours. It is one answer on one day.
What can this study not tell you?
- It covers 80 questions, half in English and half in Chinese. They were sampled from a public dataset of AI search conversations.
- It ended in July 2026. The authors say results should be checked again whenever the ChatGPT version changes.
- It is observation, not experiment. Nothing in it shows that a given change causes a citation.
- We read the author's summary, the abstract and parts of the full paper, not every page of it. The author's page lists it as accepted for the WSDM 2027 conference.
How to check this yourself
- Pick one question a buyer would ask about a business like yours.
- Ask it in ChatGPT, in a private window, without your business name.
- Write down the businesses named and the sources cited.
- Repeat on four more days.
- Count how many of the five answers named you, and which sources came up more than once.
The sources that repeat are the ones worth reading. They show where ChatGPT keeps looking for your kind of business.
Why we mention our own tools
We built AISearch Pulse to keep dated records of AI answers, because one answer is not enough to go on. It is optimised for Australian businesses. You can do the five steps above with a notebook and no tool at all.
Frequently asked questions
Does ChatGPT search Google?
The study does not say which search providers ChatGPT uses. It found that Google's results contained under 10% of the pages ChatGPT cited for the same questions.
How many times should I check ChatGPT for my business?
More than once. In the study, roughly 40% of retrieved pages appeared in one run out of twenty, so a single answer is a poor sample. Five checks on different days is a reasonable start.
Does newer content get cited more by ChatGPT?
In this study, how recent a page was barely registered as a signal. Pages that were retrieved repeatedly were the ones more likely to be cited.
Who carried out the study?
Researchers at Xi'an Jiaotong University, the SGIT AI Lab and the National University of Singapore. It was posted in October 2026 and the author's page lists it as accepted for the WSDM 2027 conference.
Next step
- Run the Free Check. Nine free checks on your own URL. Open the Free Check.
- Or get the Founder Audit. $1,500 AUD, with 50 dated observations across 5 AI surfaces, targeted fixes and AI prompts to get your AI to help you make them. See the Founder Audit.