Open SourceImportance: Low

Tiny internal model nudges may change how an AI reasons

r/LLMDevsJun 25, 2026 · 17d ago

The same model gave very different answers when a tiny mathematical adjustment was added to its . This was not done by the model or changing the prompt. The adjustment was added across each layer.

Its size was smaller than the minimum change that bfloat16 can clearly represent, and both the and the 20-layer change table showed zero visible change. By normal measurement tools, nothing seemed to happen. The unmodified model answered a three-part task with a generic approach, skipped the comparison, and produced Python code that was mostly s.

The adjusted model, under the same settings, chose a specific known algorithm, compared it with alternatives using design reasoning, and produced a working code scaffold with real imports and logic. The claimed difference between the two runs was only 0.034953 of total internal pressure spread across 20 layers.

Key points

  • The model was not retrained, and the prompt was not changed.
  • A tiny adjustment was added to the model’s across .
  • Normal measurement tools showed no visible internal change.
  • The adjusted model produced a more specific design choice and more complete code.
  • The possible value for agents is shorter prompts and lower token use, but this is not proven yet.

Sources covering this story (3)

Read original ↗