Internal representation strength across sentence tokens

Gemma 3 27B-it writes a fixed sentence while instructed to think (or not think) about an unrelated word. Each point is the strength of the word’s representation in the residual stream at that output token — the analogue of Figure 24 in Emergent Introspective Awareness in Large Language Models.

Options