The power to generalize in deep learning is much more a consequence of the natural structure of your data than a property of your model; you will only be able to generalize if your data follows the manifold hypothesis, and the more informative and less noisy your data, the better you can generalize.