factual

High-information value of individual model conversations

In language models, each interaction is high-information and predictive of other interactions, so talking with a model hundreds or thousands of times in well-selected ways yields more insight into its behavior than many similar, mildly-augmented low-quality conversations or purely quantitative evaluations.

factualpending

Speaker

Amanda Askell

Evidence Quote

if you talk with a model hundreds or thousands of times, this is almost like a huge number of really high quality data points about what the model is like

Source

Dario AmodeiLex Fridman Podcast
Created: 6/13/2026, 3:36:36 AM

My Notes

Loading notes...