Humanity Will Likely Bungle Unprecedented Technology

Humanity normally reaches semi-adequate results only through trial and error—iterating through every wrong approach and slowly converging through hard knocks—but unprecedented and vastly more powerful technology like superintelligence presents a different order of challenge where this iterative method may not be available, making a big mess a real possibility.