Memory champions and people using explicit memory systems don't lose other normal human knowledge—there's no resource management constraint; they simply know more. This is supported by experimental literature and the fact that multilingual people have absurdly high numbers of memorized things.