GPT-4 was trained on massive internet data including World Bank reports, HBR articles, newspaper articles from Kenya, and other global sources. This training data means the model has surprisingly good knowledge of emerging market contexts like Kenya, knowing terms like 'matatu terminus' (bus terminus) and being able to answer questions about Kenyan dairy prices, though with some data drift since training.