Timeline milestone
GPT-3 demonstrates learning from prompts at scale
-
Research
GPT-3 demonstrates learning from prompts at scale
A 175-billion-parameter language model performed many tasks from instructions and examples without conventional task-specific fine-tuning.
GPT-3 made few-shot and zero-shot prompting a central interface for large language models. Its fluent output attracted broad attention, but the research also documented unreliable answers, bias and substantial computing requirements. Scale improved capability without solving factual reliability.Sources & references 1 source