Language Models are Few-Shot Learners

Language Models are Few-Shot Learners

5 MIN READ

The 2020 paper that made prompting the new programming.

In 2020, OpenAI scaled a language model to 175 billion parameters and discovered something unexpected: at that size, the model no longer needed retraining to learn new tasks. You could just show it a few examples in the prompt — and it figured the rest out on its own. This bundle unpacks how GPT-3 shattered the fine-tuning paradigm and turned "prompt engineering" into a discipline.

Related Reads

SkillOpt: Self-Evolving Agent Skills

Microsoft's new system lets AI agents rewrite their own tools when the world changes.

Attention Is All You Need

The 2017 paper that killed sequential AI and sparked the LLM era.

BERT & GPT-1: The Fork

The 2018 split that divided AI into readers and writers.