Continual learning requires going back to update the weights; AIs cannot simply keep building up a larger and larger KV cache as they learn from more users, because that is not scalable and is not how humans learn—humans have no clean separation between parameters and activations, and the brain doesn't expand as we learn.