Humans Invent Their Own Objectives

Current AI excels at optimizing a specified objective function given examples of input and output, but human beings continually invent their own novel objectives and goals that no one set before, with some unexplained sense of progress toward better goals, and this capacity is not merely a matter of more compute power but a fundamentally different category of behavior.