The hard part was realizing that training neural networks to predict the next token is a worthwhile goal at all; this realization greatly influenced subsequent thinking and approaches in the field.