Recursive Self-Improvement Leads To Intelligence Explosion

Once machines become a bit smarter than us, they will be a bit better at designing machines, which will design machines smarter still, and this process continues recursively until fairly soon you have machines vastly smarter than we are—an informal argument that can be made fairly rigorous, making such a singularity pretty likely unless fairly strong conditions hold to prevent it.