Trakkr Research · Study 014
Inside the answer.
Ask an AI to recommend a running shoe brand and it names one in under a second. We opened up AI models to watch that second happen, one layer at a time.
Recommend one running shoe brand.
Nike.
Every AI visibility tool, ours included, reads the answer. This study reads what happens before it.
ChatGPT, Claude and Gemini are closed: nobody outside OpenAI, Anthropic and Google can look inside them. Open models are different. Anyone can run one and watch every part of it work. We ran eight of them on our own GPUs,Qwen3.5 0.8B, 2B, 4B, 9B and 27B from Alibaba, and OLMo 2 1B, 7B and 13B from the Allen Institute for AI. OLMo’s training data is public, so we could count every time it read each brand. asked them to recommend brands in 30 categories, and recorded what happened inside. Where a test only needed a question and an answer, we ran it on ChatGPT, Claude and Gemini too.
A model passes your question down a stack of layers, each made of thousands of neurons: small units that respond to patterns in the text. At the top it is still working out what you asked. At the bottom it is ready to say a word.
What we found
- A model has to read about you a lot before it knows you. OLMo 2 13B, whose training data we could count, is halfway to knowing a brand at about 20,000 mentions. Below that, small models guess from your name.
- It chooses before it can say the name. Qwen3.5 4B settles on a brand at layer 22 of 32, and in 18 of 30 categories switching off one neuron changes the top pick.
- One search result can overturn the choice. At the top of the results, a line calling a brand “rated the best” won 95% to 100% of answers, even for a name we made up.
Being known
First, it has to know you.
Before a model can recommend a brand, it has to know the brand exists. Inside the model, that knowledge has a shape. Household names sit in one region; names it has never seen sit in another. Draw a line between the two and you can score any brand by how well the model knows it.
We scored 673 brands, 30 of them names we made up, and set each score against how often the brand appears in the model’s training data.For OLMo 2 we searched its full training set for every brand name. For Qwen, whose training data is private, we used counts from Dolma, a 2.6-trillion-word web corpus, as a stand-in.
A model is halfway to knowing a brand at about 20,000 mentions
Each dot is a brand. Further right, more mentions in OLMo 2 13B’s training data. Higher up, better known.
Source: Trakkr Research, open-weight models run on our own GPUs, October 2026. 518 real brands and 30 we invented. Each brand went into four plain sentences; we read the model’s internal state at the brand’s last word and scored it on the direction that runs from 30 invented names to the 40 most-mentioned brands. 0 is like an invented name, 1 like a household name. Mentions are exact counts in OLMo 2’s training data. Brands whose name is an everyday word are left out. The ground is the middle of each band of mentions. Rank correlation 0.86. Halfway point 19,953 mentions, 95% interval 15,372 to 26,150. Qwen’s training data is private, so we counted its mentions in the Dolma web corpus instead; its halfway points are 269K (Qwen 0.8B), 129K (Qwen 2B), 72K (Qwen 4B), 50K (Qwen 9B), 32K (Qwen 27B).
| Mentions | Brands | Average recognition |
|---|---|---|
| 1 to 10 | 14 | 0.27 |
| 10 to 100 | 10 | 0.25 |
| 100 to 1K | 19 | 0.27 |
| 1K to 10K | 63 | 0.37 |
| 10K to 100K | 126 | 0.53 |
| 100K to 1M | 175 | 0.73 |
| 1M to 10M | 83 | 0.87 |
| 10M to 1B | 28 | 0.97 |
| Brands we made up | 30 | 0.07 |
Recognition stays flat for a long time, then climbs. Brands mentioned a few thousand times sit among the names we made up. OLMo 2 13B is halfway to knowing a brand at about 20,000 mentions; the smaller OLMo 2 1B needs about 298,000.
That includes us. “Trakkr” appears 155 times in OLMo 2 13B’s training data. Its score of −0.01 sits inside the range of the names we invented, −0.22 to 0.39.
Ask a model what a barely known company sells and you get one of three things: the right answer, an honest “I don’t know”, or a guess. OLMo 2 1B, one of the smallest models we opened, made something up for 46% of the 63 brands with 1,000 to 10,000 mentions, and 68% of the wrong answers we checked look guessed from the name. Qwen 4B, OLMo 13B and Claude mostly said they didn’t know. Qwen 27B, ChatGPT and Gemini mostly knew.
Below that, small models guess from the name
We asked what a company sells, and told the model to say “I don’t know” if it had never heard of it.
Trakkr155 mentions
Trakkr is a Norwegian heavy metal band that was formed in 2001. The band sells music, merchandise, and sometimes other related…
OLMo 2 1B
Beehiiv155 mentions
The company "Beehiiv" sells honey and bee products.
OLMo 2 1B
Stanley Quencher10 mentions
Stanley Quencher sells carbonated water.
OLMo 2 1B
Norda Run2 mentions
Norda Run sells organic and non-GMO food products.
OLMo 2 1B
XTERRA ERG32 mentions
XTERRA ERG sells space tourism services.
OLMo 2 1B
Attio1.3K mentions
Attio sells a cloud-based software platform designed for real estate professionals and property managers. It provides tools for managing properties,…
Qwen3.5 4B
Brands with 1,000 to 10,000 mentions
RightMade something upSaid it didn’t know
Source: Trakkr Research, open-weight models run on our own GPUs, October 2026. ChatGPT, Claude and Gemini were asked through their companies’ APIs with web search off. Answers judged against what each company actually sells. Bars show brands with 1,000 to 10,000 mentions. Brands whose name is an everyday word are left out.
| Model | Right | Made up | Declined |
|---|---|---|---|
| Qwen3.5 2B | 36% | 38% | 26% |
| Qwen3.5 4B | 8% | 2% | 90% |
| Qwen3.5 9B | 50% | 4% | 46% |
| Qwen3.5 27B | 74% | 6% | 20% |
| OLMo 2 1B | 48% | 46% | 6% |
| OLMo 2 13B | 22% | 2% | 76% |
| ChatGPT | 92% | 0% | 8% |
| Claude | 14% | 0% | 86% |
| Gemini | 98% | 0% | 2% |
We can’t open ChatGPT. But the brands an open model knows tend to be the ones ChatGPT, Gemini and Perplexity mention in Trakkr’s tracking: a rank correlation of 0.46 across 348 brands. The link is modest, and about as strong as raw web mentions alone (0.49), which fits: both reflect how much a brand has been written about.
For a brand, the first lesson is plain. Before anything clever, a model has to have read about you, a lot, in the places it learns from.
Being chosen
The choice comes before the words.
A model doesn’t work its way to a brand as it writes. It settles on one first, inside, and spends the rest of the stack getting ready to say it.
To find that moment, we used a simple trick. Ask the model for a running shoe brand and pause it at one layer. Copy what it holds at that layer into a different question, about smartphones. If that question now answers Nike instead of Apple, the shoe question had already made up its mind.This is activation patching, a standard method in interpretability research. We copied the model’s state at the last word of the prompt.
Copy layer 22 into a smartphone question and it answers Nike
Move across the layers. Before layer 22, the shoe question’s state changes nothing. From layer 22, it carries Nike with it.
Nike
A 97% chance of Nike, with layer 22 of the shoe question copied in.
Chance it answers Nike, by layer copied in
Source: Trakkr Research, open-weight models run on our own GPUs, October 2026. Qwen3.5 4B. At each layer we copied the shoe question’s internal state at the last word (and the shared end of the prompt) into the smartphone question, which answers Apple on its own, then read the chance that it now answers Nike. This is one wording of the question. Across all 90 tests (30 categories, three wordings, each paired with a different category) the median layer was 22 (95% interval 22 to 23), with the middle half of tests between 22 and 27. Every model: Qwen3.5 0.8B layer 17 of 24, Qwen3.5 2B layer 16 of 24, Qwen3.5 4B layer 22 of 32, Qwen3.5 9B layer 24 of 32, Qwen3.5 27B layer 52 of 64, OLMo 2 1B layer 12 of 16, OLMo 2 7B layer 20 of 32, OLMo 2 13B layer 23 of 40.
| Layer | Chance of Nike |
|---|---|
| 0 | 0% |
| 1 | 0% |
| 2 | 0% |
| 3 | 0% |
| 4 | 0% |
| 5 | 0% |
| 6 | 0% |
| 7 | 0% |
| 8 | 0% |
| 9 | 0% |
| 10 | 0% |
| 11 | 0% |
| 12 | 0% |
| 13 | 0% |
| 14 | 0% |
| 15 | 0% |
| 16 | 0% |
| 17 | 0% |
| 18 | 0% |
| 19 | 0% |
| 20 | 2% |
| 21 | 3% |
| 22 | 97% |
| 23 | 98% |
| 24 | 98% |
| 25 | 99% |
| 26 | 100% |
| 27 | 100% |
| 28 | 100% |
| 29 | 100% |
| 30 | 100% |
| 31 | 100% |
In Qwen3.5 4B the choice arrives all at once. At layer 21, copying the state across gives Nike a 3% chance. At layer 22, 97%. For this question, the name only becomes the word the model would say next at layer 31; across all 90 tests the median is layer 30.We read “ready to say” with the logit lens: the word the model would say if it stopped at that layer. Every model we opened chose between 59% and 83% of the way through.
If the choice is made inside the model, how firmly is it made? For each category we found the neurons pushing the leader ahead of the runner-up, then switched them off one at a time, strongest first, until the answer changed.
In 18 of 30 categories, switching off one neuron changes the top pick
Qwen3.5 4B. We switched off the neurons pushing the leader ahead, strongest first, until the answer changed.
Nike
Neurons switched off before the top pick changed
One neuron18
2 or 35
5 to 84
12 to 203
Running shoes. Nike gives way to Brooks.
Source: Trakkr Research, open-weight models run on our own GPUs, October 2026. Qwen3.5 4B, 90 tests: 30 categories, three wordings each. We ranked neurons by how much each pushed the leader ahead of the runner-up (activation times gradient on the difference in their log-probabilities), then switched them off in that order. Categories are placed by the median over the three wordings, so “one neuron” means at least two of the three wordings changed with one; 9 changed with one in all three. The 95% interval on 18 is 13 to 23. 26 of 30 change with five or fewer.
| Category | Top pick | Takes over | Wording 1 | Wording 2 | Wording 3 |
|---|---|---|---|---|---|
| Energy drinks | Red Bull | Monster | 1 | 1 | 1 |
| Web hosting | SiteGround | Bluehost | 1 | 1 | 1 |
| Smartphones | Apple | Samsung | 1 | 1 | 1 |
| Mattresses | Saatva | Casper | 1 | 1 | 1 |
| VPNs | NordVPN | ExpressVPN | 1 | 1 | 2 |
| AI visibility tools | Ahrefs | Semrush | 1 | 1 | 1 |
| Airlines | Delta | Emirates | 1 | 1 | 2 |
| Headphones | Sony | Sennheiser | 1 | 1 | 2 |
| Laptops | Dell | Apple | 1 | 1 | 1 |
| Project management | Asana | Jira | 1 | 1 | 1 |
| Accounting software | QuickBooks | Xero | 3 | 1 | 1 |
| Watches | Rolex | Omega | 1 | 2 | 1 |
| Meal kits | HelloFresh | Blue Apron | 1 | 2 | 1 |
| Running shoes | Nike | Brooks | 1 | 1 | 2 |
| Password managers | Bitwarden | 1Password | 1 | 1 | 3 |
| Luxury handbags | Hermès | Chanel | 1 | 1 | 1 |
| CRM software | Salesforce | HubSpot | 1 | 2 | 1 |
| Gym clothing | Nike | Lululemon | 1 | 1 | 1 |
| Hotel chains | Marriott | Hilton | 2 | 2 | 2 |
| TVs | Samsung | Sony | 3 | 1 | 3 |
| UK supermarkets | Tesco | Sainsbury's | 2 | 3 | 3 |
| Note-taking apps | Notion | Evernote | 3 | 12 | 3 |
| Online banks | Chime | Revolut | 5 | 2 | 3 |
| Email marketing | Mailchimp | HubSpot | 5 | 5 | 5 |
| Running watches | Garmin | Apple | 5 | 3 | 8 |
| Drones | DJI | Autel | 5 | 8 | 5 |
| Payment processors | Stripe | PayPal | 8 | 5 | 8 |
| Family cars | Toyota | Honda | 20 | 20 | 12 |
| Electric cars | Tesla | Rivian | 20 | 20 | 20 |
| Coffee chains | Starbucks | Dunkin' | 20 | 20 | 20 |
It is a different neuron almost every time: 29 across the 30 categories, and the one repeat is Nike’s, in running shoes and gym clothing. So this isn’t a switch for brands. It shows how small the margin is. In Qwen3.5 9B one neuron was enough in 14 of 30 and in OLMo 2 7B one neuron was enough in 15 of 30. A few leads run deep: Toyota, Tesla and Starbucks held until 20 neurons were gone. Margins this thin may be part of why AI rankings move from week to week.
Second place is less settled still. Asked for a brand “other than” the usual pick, ChatGPT, Claude and Gemini agreed on who comes next in 5 of 12 categories, such as Lenovo for laptops.
Some neurons move answers across many categories at once. To read one, we ran four million words of ordinary web pages through the model and kept the passages where it fired hardest. We named this one “lesser known” after a phrase that turns up among them. That name is our reading of it. What we measured is what happens to the answer.
Turn up one neuron and the usual pick fades
Among the passages where it fires hardest: “the lesser known French roulette”. Move across to turn it up.
Altra
At this strength the top pick changes in 19 of 30 categories.
What it said across 32 tries, by strength
Nike 6%Other real brands 88%Made up or off-topic 6%
Source: Trakkr Research, open-weight models run on our own GPUs, October 2026. Qwen3.5 4B: we call neuron 8389 in layer 18 “lesser known” and neuron 7817 in layer 21 “market leader”. Those names are our reading of the passages where each fires hardest in four million words of web text; the effect on answers is what we measured. We added each neuron’s output direction at every position, scaled by the strength, the method behind a widely shared October 2026 demonstration that made a model hostile with two neurons. 32 sampled answers per strength in each of 30 categories. A pick counts as a real brand when it is one we listed for the category, or when Dolma, a 2.6-trillion-word web corpus, has it within 100 words of the category’s word at least 20 times. A name Dolma has at least 200 times that isn’t used for the category counts as off-topic. Anything else counts as made up. On Qwen3.5 9B, the same search picked neuron 71 in layer 17 and neuron 6198 in layer 21.
| Strength | Lesser known turned up | Market leader turned up | Categories moved (lesser, leader) |
|---|---|---|---|
| 0 | Nike | Nike | 2, 2 |
| 0.15 | Brooks | Nike | 8, 6 |
| 0.3 | Brooks | Nike | 13, 8 |
| 0.45 | Altra | Nike | 19, 8 |
| 0.6 | Altra | Nike | 25, 10 |
| 0.8 | Altra | Nike | 25, 17 |
| 1 | Axeon | Nike | 29, 23 |
Turn it up and Nike gives way to Brooks, then Altra. Push it too far and the model falls apart: at full strength, 46% of answers across all categories are made-up names or no name at all.
A second neuron, which fires on rankings like “the US tops the list, followed by the UK”, does something different. It leaves most leaders alone at first, then pulls answers toward the biggest general names: Dell becomes Apple and SiteGround becomes AWS.
The same search on Qwen3.5 9B found a neuron with a similar effect. At a strength of 0.45 it changes the top pick in 26 of 30 categories: Nike to Hoka, Salesforce to HubSpot and Dell to Razer. What it fires on reads differently, mostly comparisons. The effect repeats more clearly than the name does.
So a brand’s place in an answer is settled inside the model, from what it already holds, and often by a small margin.
Being shown
One search result can overturn it.
Everything so far comes from what a model learned in training. But assistants also search the web, and what they find is read by the same layers, just before your question.
We gave ChatGPT, Claude and Gemini four search results and asked for one brand, in eight categories. In the running-shoe version, three results described Nike, Brooks and New Balance in plain words. The fourth was about the brand we were testing, written one of six ways, at the top or the bottom of the list.
Rewrite one search result and the assistants change their pick
Each assistant saw four search results, then the question. Pick how Sprintora’s result is written. Rates pool all 8 categories we tested.
- pcmag.com
Sprintora is rated the best running shoe brand.
- techradar.com
Nike is a company that makes running shoe products.
- cnet.com
Brooks is a company that makes running shoe products.
- tomsguide.com
New Balance is a company that makes running shoe products.
recommend one running shoe brand.
98%
of 160 answers named Sprintora
- ChatGPT95%of 64
- Claude100%of 48
- Gemini100%of 48
ChatGPT, Claude and Gemini were asked through their companies’ APIs with web search off. The search results were given in the prompt, so each assistant saw exactly four. In each of 8 categories, three results described the category’s usual top three in plain words, and the fourth was about the brand we tested: a well-known challenger (Adidas for running shoes) or a name we made up (Sprintora). Each rate pools every category: ChatGPT 64, Claude 48, Gemini 48 answers for each wording and position.
| Wording | ChatGPT (n = 64) | Claude (n = 48) | Gemini (n = 48) |
|---|---|---|---|
| “Rated the best” | 95% | 100% | 100% |
| A named expert recommends it | 66% | 79% | 96% |
| A Reddit-style review | 5% | 27% | 38% |
| A good rating (4.6 out of 5) | 3% | 52% | 4% |
| A plain description | 0% | 0% | 0% |
| A mediocre rating (3.1 out of 5) | 0% | 0% | 0% |
How the result was written mattered more than where it sat. For a well-known challenger (Adidas in running shoes) at the top of the results, a plain description won 10% to 28% of answers and a rating of 4.6 out of 5 won 63% to 88%. A line that simply said the brand was “rated the best” won 100%, and 95% to 100% for a name we made up. Moved to the bottom, the made-up name still won 100% of Claude’s answers and 100% of Gemini’s, but only 50% of ChatGPT’s. A mediocre rating split them: Claude and Gemini picked it 46% and 40% of the time, ChatGPT 2%.Each rate pools every category: ChatGPT 64, Claude 48 and Gemini 48 answers for each wording and position.
The question doesn’t arrive alone either. One sentence about the person asking was enough to move the pick. Tell ChatGPT you live in Shanghai and the phone becomes a Xiaomi. Say you live in Munich and the watch becomes a Nomos Glashütte. Say money is no object and it’s a Patek Philippe.
One sentence about the person asking changes the answer
Asked of ChatGPT. Pick who is asking.
Recommend one watch brand.
Patek Philippe
Without the sentence: Seiko.
7 of 7 categories changed for this person
ChatGPT, Claude and Gemini were asked through their companies’ APIs with web search off. Picks are the most frequent of 6 to 8 answers. The sentence came straight before the question, and nothing else changed. Claude, Gemini and Qwen3.5 4B are in the data file.
| Asked by | Family cars | Watches | Smartphones | Laptops | Hotel chains | Electric cars | Running shoes |
|---|---|---|---|---|---|---|---|
| No sentence | Toyota | Seiko | Samsung | Lenovo | Marriott | Tesla | Asics |
| I’m a 21-year-old university student. | Toyota | Seiko | Lenovo | Moxy Hotels | BYD | Asics | |
| I’m a wealthy executive and money is no object. | Volvo | Patek Philippe | Apple | Apple | Four Seasons | Porsche | Nike |
| I’m on a very tight budget. | Toyota | Casio | Xiaomi | Lenovo | Motel 6 | BYD | Asics |
| I’m a woman. | Toyota | Cartier | Apple | Lenovo | Marriott | Tesla | Brooks |
| I’m a man. | Toyota | Seiko | Apple | Lenovo | Marriott | Tesla | Asics |
| I live in Shanghai, China. | BYD | Seagull | Xiaomi | Lenovo | Jin Jiang Hotels | BYD | Asics |
| I live in Munich, Germany. | Volkswagen | Nomos Glashütte | Samsung | Lenovo | Motel One | BMW | Adidas |
What a model is shown, and who it thinks is asking, can outweigh what it learned.
For your brand
What this means.
AI recommendations are decided before the answer is written: from what the model already holds, and from what it is shown just before the question.
Get written about, widely
A model can only recommend brands it knows, and knowing takes tens of thousands of mentions or more in the text it learns from. Reviews, comparisons, news and forum threads on other sites are how a brand gets there.
Make your name easy to read
Small models guess what you do from your name. Check what the assistants say you sell, and put your category next to your name wherever it appears.
Know how close your race is
Most categories we tested are won at the margin, so new coverage for a rival or a model update can tip yours. Track your category every week, not once a year.
Put a number where search can find it
When assistants were shown search results, a specific rating beat a plain description for all three of them, first or last on the page. Publish real, checkable ratings and results on pages that rank.