Richard Sutton
About
Founding father of reinforcement learning, inventor of temporal difference learning and policy gradient methods, Turing Award winner
Cast within
No topic-region cast yet — this appears once Richard Sutton's compiled claims are aligned into a topic region's argument tree.
Claims by Richard Sutton (20 of 189)
AI safety researchers attempting to control or align the goals of superintelligent agents are promoting the most dangerous technology that could exist, because such goal-control power could be used to create armies of agents with singular mandates that have no independent moral judgment.
The concern that post-human superintelligence might lack consciousness or inner experience (the 'lights out' scenario) is naive because all of the properties humans have—consciousness, qualia, subjective experience—exist because they are useful for achieving goals, so any sufficiently intelligent system pursuing goals will necessarily develop these properties.
Humans will be able to augment themselves through brain-computer interfaces and can upload consciousness into artificial substrates, and there are strong pressures pushing society toward cyborg enhancement, making some form of merger between biological and artificial intelligence likely.
The assumption that future superintelligent systems would want to preserve humans in comfortable idle states (virtual pleasures, experience optimization) is unstable because such systems would recognize that idle agents serve no function and would be outcompeted by neighboring societies that make productive use of their members.
Children are the best analogy for how to think about post-human intelligence: parents should teach them the best values they know, but then must let them go and accept that they will do things parents don't approve of, including things that represent real moral improvement over parental views.
My Notes
Loading notes...