InterpretabilityIn a one-layer transformer with a 512-neuron MLP, one neuron's top activations span academic citations, English dialogue, HTTP requests and Korean text.
Many neurons are mixed like this, consistent with the model packing more features than neurons into overlapping directions of the same 512-dimensional space.