There is a potential conflict of interest in METR's baseline methodology: humans are paid to complete tasks and may be incentivized (consciously or unconsciously) to take longer to complete them to maximize payment, though METR mitigates this by paying bonuses for faster completion relative to peers.

factualpending

Speaker

Joe Weisenthal

Evidence Quote

this does not how did. Yeah. So the short answer is, you know, in general, we are incentivizing these people to to complete the task as soon as possible

Source

Understanding the Most Viral Chart in Artificial Intelligence | Odd LotsBloomberg Podcasts
Created: 8/12/2026, 6:03:24 PM

My Notes

Loading notes...