LLMs Summarize World Models Rather Than Discover Them

LLMs do not learn world models directly from raw data; instead they take as input the interpretations of data authored by humans who already possess world models (e.g. doctors interpreting hospital treatment data) and produce a mysterious summary of those human-authored models rather than discovering the underlying models themselves.