Attention Is All You Need
The 2017 paper that killed sequential AI and sparked the LLM era.
In 2017, Vaswani et al. published "Attention Is All You Need" — replacing recurrence with a parallel architecture that could finally scale across GPU farms. This bundle unpacks how Transformers work, why the "bank" disambiguation example matters, and why this single paper is responsible for GPT, Claude, and every modern LLM.
Related Reads
Inside OpenAI Astra: The looped transformer
Frontier labs are trading parameter bloat for recurrent depth. The model gets deeper by running the same layers again, and the reasoning stops being readable.
Claude's Mind: J-Space
Anthropic found a small, organized workspace inside Claude where silent reasoning happens before a single word gets typed.
SkillOpt: Self-Evolving Agent Skills
Microsoft's new system lets AI agents rewrite their own tools when the world changes.