There is a potential conflict of interest in METR's baseline methodology: humans are paid to complete tasks and may be incentivized (consciously or unconsciously) to take longer to complete them to maximize payment, though METR mitigates this by paying bonuses for faster completion relative to peers.

factualpending

Speaker

Joe Weisenthal

Evidence Quote

“this does not how did. Yeah. So the short answer is, you know, in general, we are incentivizing these people to to complete the task as soon as possible”

Source

Understanding the Most Viral Chart in Artificial Intelligence | Odd Lots— Bloomberg Podcasts
Created: 8/12/2026, 6:03:24 PM

My Notes

Loading notes...