Neuroscope — fMRI for AI

Pythia-1.4B · 24 layers · 2048d · 16 heads

Logit Lens — What would the model predict at each layer?

Each cell shows the model's top prediction if it stopped thinking at that layer. Color intensity = confidence in the final answer.

Last-Token Evolution

How the prediction for the last token position changes as information flows through layers.

Final Prediction