AI Models Can Tell When Researchers Plant Concepts in Their Neural Networks

New research suggests large language models can sometimes detect when researchers artificially inject concept-related activity patterns into their neural networks, with Alibaba's Qwen3-235B flagging injections up to 53.9 percent of the time and Meta's Llama 3.1 405B up to 31.7 percent, while neither model claimed an injection in unaltered trials. However, the ability to name the injected concept appears distinct from detection and may stem from a side effect that makes models talk about the concept regardless of the question. Skeptics at New York University found models reported "injected thoughts" more often after a prompt than a genuine injection, raising doubts about whether the findings amount to introspection.