Why bigger networks learn more: one-over-f noise analogy

Bigger networks are better because language (like physical processes) has a long-tail, one-over-f distribution of patterns at many scales; small networks capture only common simple patterns, while larger networks progressively capture rarer, more complex patterns up the hierarchy from grammar to sentences to paragraphs to themes.