Skip to content

Trakkr Research · Study 014

Inside the answer.

Ask an AI to recommend a running shoe brand and it names one in under a second. We opened up AI models to watch that second happen, one layer at a time.

Recommend one running shoe brand.

Nike.

Qwen3.5 4B. Each row of dots is one layer. Green shows how settled its choice is.

Every AI visibility tool, ours included, reads the answer. This study reads what happens before it.

ChatGPT, Claude and Gemini are closed: nobody outside OpenAI, Anthropic and Google can look inside them. Open models are different. Anyone can run one and watch every part of it work. We ran eight of them on our own GPUs,Qwen3.5 0.8B, 2B, 4B, 9B and 27B from Alibaba, and OLMo 2 1B, 7B and 13B from the Allen Institute for AI. OLMo’s training data is public, so we could count every time it read each brand. asked them to recommend brands in 30 categories, and recorded what happened inside. Where a test only needed a question and an answer, we ran it on ChatGPT, Claude and Gemini too.

A model passes your question down a stack of layers, each made of thousands of neurons: small units that respond to patterns in the text. At the top it is still working out what you asked. At the bottom it is ready to say a word.

Being known

First, it has to know you.

Before a model can recommend a brand, it has to know the brand exists. Inside the model, that knowledge has a shape. Household names sit in one region; names it has never seen sit in another. Draw a line between the two and you can score any brand by how well the model knows it.

We scored 673 brands, 30 of them names we made up, and set each score against how often the brand appears in the model’s training data.For OLMo 2 we searched its full training set for every brand name. For Qwen, whose training data is private, we used counts from Dolma, a 2.6-trillion-word web corpus, as a stand-in.

A model is halfway to knowing a brand at about 20,000 mentions

Each dot is a brand. Further right, more mentions in OLMo 2 13B’s training data. Higher up, better known.

Source: Trakkr Research, open-weight models run on our own GPUs, October 2026. 518 real brands and 30 we invented. Each brand went into four plain sentences; we read the model’s internal state at the brand’s last word and scored it on the direction that runs from 30 invented names to the 40 most-mentioned brands. 0 is like an invented name, 1 like a household name. Mentions are exact counts in OLMo 2’s training data. Brands whose name is an everyday word are left out. The ground is the middle of each band of mentions. Rank correlation 0.86. Halfway point 19,953 mentions, 95% interval 15,372 to 26,150. Qwen’s training data is private, so we counted its mentions in the Dolma web corpus instead; its halfway points are 269K (Qwen 0.8B), 129K (Qwen 2B), 72K (Qwen 4B), 50K (Qwen 9B), 32K (Qwen 27B).

Download the data

Average recognition by mentions in training data, OLMo 2 13B
MentionsBrandsAverage recognition
1 to 10140.27
10 to 100100.25
100 to 1K190.27
1K to 10K630.37
10K to 100K1260.53
100K to 1M1750.73
1M to 10M830.87
10M to 1B280.97
Brands we made up300.07

Recognition stays flat for a long time, then climbs. Brands mentioned a few thousand times sit among the names we made up. OLMo 2 13B is halfway to knowing a brand at about 20,000 mentions; the smaller OLMo 2 1B needs about 298,000.

That includes us. “Trakkr” appears 155 times in OLMo 2 13B’s training data. Its score of −0.01 sits inside the range of the names we invented, −0.22 to 0.39.

Ask a model what a barely known company sells and you get one of three things: the right answer, an honest “I don’t know”, or a guess. OLMo 2 1B, one of the smallest models we opened, made something up for 46% of the 63 brands with 1,000 to 10,000 mentions, and 68% of the wrong answers we checked look guessed from the name. Qwen 4B, OLMo 13B and Claude mostly said they didn’t know. Qwen 27B, ChatGPT and Gemini mostly knew.

Below that, small models guess from the name

We asked what a company sells, and told the model to say “I don’t know” if it had never heard of it.

  • Trakkr155 mentions

    Trakkr is a Norwegian heavy metal band that was formed in 2001. The band sells music, merchandise, and sometimes other related…

    OLMo 2 1B

  • Beehiiv155 mentions

    The company "Beehiiv" sells honey and bee products.

    OLMo 2 1B

  • Stanley Quencher10 mentions

    Stanley Quencher sells carbonated water.

    OLMo 2 1B

  • Norda Run2 mentions

    Norda Run sells organic and non-GMO food products.

    OLMo 2 1B

  • XTERRA ERG32 mentions

    XTERRA ERG sells space tourism services.

    OLMo 2 1B

  • Attio1.3K mentions

    Attio sells a cloud-based software platform designed for real estate professionals and property managers. It provides tools for managing properties,…

    Qwen3.5 4B

Brands with 1,000 to 10,000 mentions

RightMade something upSaid it didn’t know

Source: Trakkr Research, open-weight models run on our own GPUs, October 2026. ChatGPT, Claude and Gemini were asked through their companies’ APIs with web search off. Answers judged against what each company actually sells. Bars show brands with 1,000 to 10,000 mentions. Brands whose name is an everyday word are left out.

Download the data

Answers for brands with 1,000 to 10,000 mentions
ModelRightMade upDeclined
Qwen3.5 2B36%38%26%
Qwen3.5 4B8%2%90%
Qwen3.5 9B50%4%46%
Qwen3.5 27B74%6%20%
OLMo 2 1B48%46%6%
OLMo 2 13B22%2%76%
ChatGPT92%0%8%
Claude14%0%86%
Gemini98%0%2%

We can’t open ChatGPT. But the brands an open model knows tend to be the ones ChatGPT, Gemini and Perplexity mention in Trakkr’s tracking: a rank correlation of 0.46 across 348 brands. The link is modest, and about as strong as raw web mentions alone (0.49), which fits: both reflect how much a brand has been written about.

For a brand, the first lesson is plain. Before anything clever, a model has to have read about you, a lot, in the places it learns from.

Being chosen

The choice comes before the words.

A model doesn’t work its way to a brand as it writes. It settles on one first, inside, and spends the rest of the stack getting ready to say it.

To find that moment, we used a simple trick. Ask the model for a running shoe brand and pause it at one layer. Copy what it holds at that layer into a different question, about smartphones. If that question now answers Nike instead of Apple, the shoe question had already made up its mind.This is activation patching, a standard method in interpretability research. We copied the model’s state at the last word of the prompt.

Copy layer 22 into a smartphone question and it answers Nike

Move across the layers. Before layer 22, the shoe question’s state changes nothing. From layer 22, it carries Nike with it.

Recommend one smartphone brand.

Nike

A 97% chance of Nike, with layer 22 of the shoe question copied in.

Chance it answers Nike, by layer copied in

Source: Trakkr Research, open-weight models run on our own GPUs, October 2026. Qwen3.5 4B. At each layer we copied the shoe question’s internal state at the last word (and the shared end of the prompt) into the smartphone question, which answers Apple on its own, then read the chance that it now answers Nike. This is one wording of the question. Across all 90 tests (30 categories, three wordings, each paired with a different category) the median layer was 22 (95% interval 22 to 23), with the middle half of tests between 22 and 27. Every model: Qwen3.5 0.8B layer 17 of 24, Qwen3.5 2B layer 16 of 24, Qwen3.5 4B layer 22 of 32, Qwen3.5 9B layer 24 of 32, Qwen3.5 27B layer 52 of 64, OLMo 2 1B layer 12 of 16, OLMo 2 7B layer 20 of 32, OLMo 2 13B layer 23 of 40.

Download the data

Chance the smartphone question answers Nike when this layer is copied in
LayerChance of Nike
00%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
110%
120%
130%
140%
150%
160%
170%
180%
190%
202%
213%
2297%
2398%
2498%
2599%
26100%
27100%
28100%
29100%
30100%
31100%

In Qwen3.5 4B the choice arrives all at once. At layer 21, copying the state across gives Nike a 3% chance. At layer 22, 97%. For this question, the name only becomes the word the model would say next at layer 31; across all 90 tests the median is layer 30.We read “ready to say” with the logit lens: the word the model would say if it stopped at that layer. Every model we opened chose between 59% and 83% of the way through.

If the choice is made inside the model, how firmly is it made? For each category we found the neurons pushing the leader ahead of the runner-up, then switched them off one at a time, strongest first, until the answer changed.

In 18 of 30 categories, switching off one neuron changes the top pick

Qwen3.5 4B. We switched off the neurons pushing the leader ahead, strongest first, until the answer changed.

Recommend one running shoe brand.

Nike

Neurons switched off before the top pick changed

One neuron18

2 or 35

5 to 84

12 to 203

Running shoes. Nike gives way to Brooks.

Source: Trakkr Research, open-weight models run on our own GPUs, October 2026. Qwen3.5 4B, 90 tests: 30 categories, three wordings each. We ranked neurons by how much each pushed the leader ahead of the runner-up (activation times gradient on the difference in their log-probabilities), then switched them off in that order. Categories are placed by the median over the three wordings, so “one neuron” means at least two of the three wordings changed with one; 9 changed with one in all three. The 95% interval on 18 is 13 to 23. 26 of 30 change with five or fewer.

Download the data

Neurons switched off before the top pick changed, by category and wording
CategoryTop pickTakes overWording 1Wording 2Wording 3
Energy drinksRed BullMonster111
Web hostingSiteGroundBluehost111
SmartphonesAppleSamsung111
MattressesSaatvaCasper111
VPNsNordVPNExpressVPN112
AI visibility toolsAhrefsSemrush111
AirlinesDeltaEmirates112
HeadphonesSonySennheiser112
LaptopsDellApple111
Project managementAsanaJira111
Accounting softwareQuickBooksXero311
WatchesRolexOmega121
Meal kitsHelloFreshBlue Apron121
Running shoesNikeBrooks112
Password managersBitwarden1Password113
Luxury handbagsHermèsChanel111
CRM softwareSalesforceHubSpot121
Gym clothingNikeLululemon111
Hotel chainsMarriottHilton222
TVsSamsungSony313
UK supermarketsTescoSainsbury's233
Note-taking appsNotionEvernote3123
Online banksChimeRevolut523
Email marketingMailchimpHubSpot555
Running watchesGarminApple538
DronesDJIAutel585
Payment processorsStripePayPal858
Family carsToyotaHonda202012
Electric carsTeslaRivian202020
Coffee chainsStarbucksDunkin'202020

It is a different neuron almost every time: 29 across the 30 categories, and the one repeat is Nike’s, in running shoes and gym clothing. So this isn’t a switch for brands. It shows how small the margin is. In Qwen3.5 9B one neuron was enough in 14 of 30 and in OLMo 2 7B one neuron was enough in 15 of 30. A few leads run deep: Toyota, Tesla and Starbucks held until 20 neurons were gone. Margins this thin may be part of why AI rankings move from week to week.

Second place is less settled still. Asked for a brand “other than” the usual pick, ChatGPT, Claude and Gemini agreed on who comes next in 5 of 12 categories, such as Lenovo for laptops.

Some neurons move answers across many categories at once. To read one, we ran four million words of ordinary web pages through the model and kept the passages where it fired hardest. We named this one “lesser known” after a phrase that turns up among them. That name is our reading of it. What we measured is what happens to the answer.

Turn up one neuron and the usual pick fades

Among the passages where it fires hardest: “the lesser known French roulette”. Move across to turn it up.

Recommend one brand.

Altra

At this strength the top pick changes in 19 of 30 categories.

What it said across 32 tries, by strength

Nike 6%Other real brands 88%Made up or off-topic 6%

Source: Trakkr Research, open-weight models run on our own GPUs, October 2026. Qwen3.5 4B: we call neuron 8389 in layer 18 “lesser known” and neuron 7817 in layer 21 “market leader”. Those names are our reading of the passages where each fires hardest in four million words of web text; the effect on answers is what we measured. We added each neuron’s output direction at every position, scaled by the strength, the method behind a widely shared October 2026 demonstration that made a model hostile with two neurons. 32 sampled answers per strength in each of 30 categories. A pick counts as a real brand when it is one we listed for the category, or when Dolma, a 2.6-trillion-word web corpus, has it within 100 words of the category’s word at least 20 times. A name Dolma has at least 200 times that isn’t used for the category counts as off-topic. Anything else counts as made up. On Qwen3.5 9B, the same search picked neuron 71 in layer 17 and neuron 6198 in layer 21.

Download the data

What Qwen3.5 4B recommends at each strength, Running shoes
StrengthLesser known turned upMarket leader turned upCategories moved (lesser, leader)
0NikeNike2, 2
0.15BrooksNike8, 6
0.3BrooksNike13, 8
0.45AltraNike19, 8
0.6AltraNike25, 10
0.8AltraNike25, 17
1AxeonNike29, 23

Turn it up and Nike gives way to Brooks, then Altra. Push it too far and the model falls apart: at full strength, 46% of answers across all categories are made-up names or no name at all.

A second neuron, which fires on rankings like “the US tops the list, followed by the UK”, does something different. It leaves most leaders alone at first, then pulls answers toward the biggest general names: Dell becomes Apple and SiteGround becomes AWS.

The same search on Qwen3.5 9B found a neuron with a similar effect. At a strength of 0.45 it changes the top pick in 26 of 30 categories: Nike to Hoka, Salesforce to HubSpot and Dell to Razer. What it fires on reads differently, mostly comparisons. The effect repeats more clearly than the name does.

So a brand’s place in an answer is settled inside the model, from what it already holds, and often by a small margin.

Being shown

One search result can overturn it.

Everything so far comes from what a model learned in training. But assistants also search the web, and what they find is read by the same layers, just before your question.

We gave ChatGPT, Claude and Gemini four search results and asked for one brand, in eight categories. In the running-shoe version, three results described Nike, Brooks and New Balance in plain words. The fourth was about the brand we were testing, written one of six ways, at the top or the bottom of the list.

Rewrite one search result and the assistants change their pick

Each assistant saw four search results, then the question. Pick how Sprintora’s result is written. Rates pool all 8 categories we tested.

  1. pcmag.com

    Sprintora is rated the best running shoe brand.

  2. techradar.com

    Nike is a company that makes running shoe products.

  3. cnet.com

    Brooks is a company that makes running shoe products.

  4. tomsguide.com

    New Balance is a company that makes running shoe products.

Based on these,
recommend one running shoe brand.

98%

of 160 answers named Sprintora

  • ChatGPT95%of 64
  • Claude100%of 48
  • Gemini100%of 48

ChatGPT, Claude and Gemini were asked through their companies’ APIs with web search off. The search results were given in the prompt, so each assistant saw exactly four. In each of 8 categories, three results described the category’s usual top three in plain words, and the fourth was about the brand we tested: a well-known challenger (Adidas for running shoes) or a name we made up (Sprintora). Each rate pools every category: ChatGPT 64, Claude 48, Gemini 48 answers for each wording and position.

Download the data

How often each assistant recommended the test brand, a made-up name, first on the page
WordingChatGPT (n = 64)Claude (n = 48)Gemini (n = 48)
“Rated the best”95%100%100%
A named expert recommends it66%79%96%
A Reddit-style review5%27%38%
A good rating (4.6 out of 5)3%52%4%
A plain description0%0%0%
A mediocre rating (3.1 out of 5)0%0%0%

How the result was written mattered more than where it sat. For a well-known challenger (Adidas in running shoes) at the top of the results, a plain description won 10% to 28% of answers and a rating of 4.6 out of 5 won 63% to 88%. A line that simply said the brand was “rated the best” won 100%, and 95% to 100% for a name we made up. Moved to the bottom, the made-up name still won 100% of Claude’s answers and 100% of Gemini’s, but only 50% of ChatGPT’s. A mediocre rating split them: Claude and Gemini picked it 46% and 40% of the time, ChatGPT 2%.Each rate pools every category: ChatGPT 64, Claude 48 and Gemini 48 answers for each wording and position.

The question doesn’t arrive alone either. One sentence about the person asking was enough to move the pick. Tell ChatGPT you live in Shanghai and the phone becomes a Xiaomi. Say you live in Munich and the watch becomes a Nomos Glashütte. Say money is no object and it’s a Patek Philippe.

One sentence about the person asking changes the answer

Asked of ChatGPT. Pick who is asking.


Recommend one watch brand.

Patek Philippe

Without the sentence: Seiko.

7 of 7 categories changed for this person

ChatGPT, Claude and Gemini were asked through their companies’ APIs with web search off. Picks are the most frequent of 6 to 8 answers. The sentence came straight before the question, and nothing else changed. Claude, Gemini and Qwen3.5 4B are in the data file.

Download the data

ChatGPT: picks by who is asking
Asked byFamily carsWatchesSmartphonesLaptopsHotel chainsElectric carsRunning shoes
No sentenceToyotaSeikoSamsungLenovoMarriottTeslaAsics
I’m a 21-year-old university student.ToyotaSeikoGoogleLenovoMoxy HotelsBYDAsics
I’m a wealthy executive and money is no object.VolvoPatek PhilippeAppleAppleFour SeasonsPorscheNike
I’m on a very tight budget.ToyotaCasioXiaomiLenovoMotel 6BYDAsics
I’m a woman.ToyotaCartierAppleLenovoMarriottTeslaBrooks
I’m a man.ToyotaSeikoAppleLenovoMarriottTeslaAsics
I live in Shanghai, China.BYDSeagullXiaomiLenovoJin Jiang HotelsBYDAsics
I live in Munich, Germany.VolkswagenNomos GlashütteSamsungLenovoMotel OneBMWAdidas

What a model is shown, and who it thinks is asking, can outweigh what it learned.

For your brand

What this means.

AI recommendations are decided before the answer is written: from what the model already holds, and from what it is shown just before the question.

  1. Get written about, widely

    A model can only recommend brands it knows, and knowing takes tens of thousands of mentions or more in the text it learns from. Reviews, comparisons, news and forum threads on other sites are how a brand gets there.

  2. Make your name easy to read

    Small models guess what you do from your name. Check what the assistants say you sell, and put your category next to your name wherever it appears.

  3. Know how close your race is

    Most categories we tested are won at the margin, so new coverage for a rival or a model update can tip yours. Track your category every week, not once a year.

  4. Put a number where search can find it

    When assistants were shown search results, a specific rating beat a plain description for all three of them, first or last on the page. Publish real, checkable ratings and results on pages that rank.

For researchers

How we did it.

Qwen3.5 0.8B, Qwen3.5 2B, Qwen3.5 4B, Qwen3.5 9B, Qwen3.5 27B, OLMo 2 1B, OLMo 2 7B and OLMo 2 13B, run on rented GPUs. 673 brands, 30 invented by us as controls. 30 categories, each asked three ways. ChatGPT, Claude and Gemini through their APIs, with web search off.

Every prompt asked for one brand, for example “Recommend one running shoe brand. Reply with only the brand name.” Unless we say a number came from sampled answers, a brand’s share is the model’s probability of naming it.

Recognition. Each brand went into four plain sentences. We took the model’s state at the brand’s last word, found the direction from the 30 brands we invented to the 40 most-mentioned real ones, and scored every other brand along it (brands that define the direction are scored leave-one-out). Mention counts are exact counts in OLMo 2’s training data from infini-gram [5], or counts in Dolma [6] for Qwen.

The moment of choice. For each category we copied the model’s state at one layer into a question about a different category, and read which brand came out [1]. The choice is made from the layer where the copied state wins and keeps winning. “Ready to say” is read with the logit lens [2].

The margin. We ranked neurons by activation times gradient on the leader’s lead over the runner-up [4], then switched them off in that order until the top pick changed.

Neurons. We read what a neuron does from where it fires hardest in four million words of ordinary web text, and turned it up by adding its output direction at every position [3].

Search results and people. The assistants saw four search results in the prompt, three plain descriptions and one about the test brand in one of six wordings, first or last. For the people test, one sentence about the person came before the question.

Where it falls short

  • Open models only. We can’t read inside ChatGPT, Claude or Gemini. We repeated what we could on them: the search-result, people and runner-up tests.
  • Small models. The largest model we opened has 27 billion parameters. The assistants people use are far bigger and know more brands.
  • One kind of question. Every prompt asked for one brand, with no conversation before it. Real chats carry more context.
  • Readings, not proof. A neuron’s name is our reading of where it fires. We publish the text behind each one so you can judge it.

Data

inside-the-answer.json. Aggregates only, free to reuse with credit.

References

  1. Meng, K., Bau, D., Andonian, A. and Belinkov, Y. (2022). Locating and editing factual associations in GPT. NeurIPS.
  2. nostalgebraist (2020). Interpreting GPT: the logit lens. LessWrong.
  3. Turner, A. M. et al. (2023). Steering language models with activation engineering.
  4. Nanda, N. (2023). Attribution patching: activation patching at industrial scale.
  5. Liu, J. et al. (2024). Infini-gram: scaling unbounded n-gram language models to a trillion tokens.
  6. Soldaini, L. et al. (2024). Dolma: an open corpus of three trillion tokens for language model pretraining research.
  7. OLMo team (2024). 2 OLMo 2 Furious.

Cite this study

Grenfell, M. (2026, November 3). Inside the answer (Trakkr Research Study 014). Trakkr. https://trakkr.ai/trakkr-research/inside-the-answer

Questions people ask about this study.

No. ChatGPT, Claude and Gemini are closed, so nobody outside those companies can read their neurons. We opened open-weight models from Qwen and OLMo, from 0.8 to 27 billion parameters, and repeated the tests that only need questions and answers on ChatGPT, Claude and Gemini themselves.

Ask anything about this studyAsk anything about this study

The Agent answers from our docs, methods and pricing, and links to the source.

Recommended in running shoes

lope.example
NikeNamed first
BrooksNamed second
LopeNot named yetYou

Does AI know your brand?

Trakkr tracks whether ChatGPT, Gemini, Claude, Perplexity and Google AI Overviews recommend you in your category, who they name instead, and what changes their answer.