Transformers must add positional encoding information to input embeddings because unlike recurrent neural networks, transformers have no recurrence and therefore need explicit position information to understand word order.
causalpending
Speaker
Unidentified Speaker — Illustrated Guide to Transformers Neural Network: A step by… [4Bdc55j80l8]Evidence Quote
“because a transformer encoder has no recurrence like recurrent known networks we must add information about the positions into the input embeddings”
Created: 8/13/2026, 9:51:15 AM
My Notes
Loading notes...