The relative probabilities of wrong answers often contain more information than the correct answer. For example, a car classification system saying a BMW has 0.8 probability, Audi 0.1, garbage truck 1-in-a-million, and carrot 1-in-a-billion reveals classification structure: the ratio between garbage truck and carrot tells you that vehicles get much higher probabilities than vegetables.