The ARC dataset deliberately avoids interpolative structure and provides only few examples, making it unsuitable for deep learning; many people have tried deep learning and GPT-3 on ARC with no success, but program synthesis is very effective on ARC.
factualpending
Speaker
François CholletEvidence Quote
“lots of people have tried using deep learning on ARC, uh including using very large pre-trained models like GPT-3... no one has uh managed to achieve anything with it because ARC problems are not interpolative in nature.”
Source
Francois Chollet | Why abstraction is the key to intelligence, and what we’re still missing— Harvard CMSACreated: 8/12/2026, 6:07:58 PM
My Notes
Loading notes...