factual
Ads team bottlenecked by test compute not ideas
When Meta automated ad ranking experiment generation, they found they were bottlenecked not on hypotheses but on compute and on cohorts of people large enough to make tests statistically significant — even with 3.5 billion users, AI is only useful once its average hypothesis quality exceeds the best human-generated ones already above the testing line.
factualpending
Speaker
Mark ZuckerbergEvidence Quote
“We need to get to the point where the average quality of the hypotheses that the AI is generating is better than all the things above the line that we’re actually able to test that the best humans on the team have been able to do, before it will even be marginally useful for it.”
Created: 6/13/2026, 3:33:00 AM
My Notes
Loading notes...