Deep learning rested on an 'irrefutable argument': if a neural network is deep AND large, it can be configured to solve a hard task—yet at the time people were not looking at large neural networks.