Simplicity generates complexity, the beauty of neural nets

The beauty of neural networks is that simple rules generate enormous complexity and structure inside themselves, just as evolution's simple rules give rise to all of biology; this rich internal structure is there to be discovered if we take the time to understand it, and the existence of artifacts that do things we don't know how to program is the question calling out to be answered.