Breakthroughs are obvious only in hindsight

Major advances in deep learning often consist of realizing something had a desirable property all along, so they straddle the line between breakthrough and mere implementation; the deepest advance — that a big neural network trained with backpropagation can do a lot — was a giant conceptual breakthrough precisely because for the longest time people didn't see it, even though in hindsight everyone calls it obvious.