Menu

The Transformers Architecture Hub

Master the concepts from routing to heavy caching algorithms.

Hand-Coding Weights for Sequence Memorization: A Mechanistic Interpretability Challenge

AI

Bayesian Wind Tunnels: Tiny Transformers Match Bayesian Inference

AI