factual
High-information value of individual model conversations
In language models, each interaction is high-information and predictive of other interactions, so talking with a model hundreds or thousands of times in well-selected ways yields more insight into its behavior than many similar, mildly-augmented low-quality conversations or purely quantitative evaluations.
factualpending
Speaker
Amanda AskellEvidence Quote
“if you talk with a model hundreds or thousands of times, this is almost like a huge number of really high quality data points about what the model is like”
Created: 6/13/2026, 3:36:36 AM
My Notes
Loading notes...