GPUs were originally created for video graphics but accidentally proved excellent for matrix multiplication, leading to their dominance in AI despite not being designed from first principles for that purpose; this co-evolution between algorithms and hardware is suboptimal.