The encoder in a transformer maps an input sequence into an abstract continuous representation that holds all the learned information of that input, while the decoder takes this representation and step-by-step generates a single output while also being fed previous outputs.

definitionpending

Speaker

Unidentified Speaker — Illustrated Guide to Transformers Neural Network: A step by… [4Bdc55j80l8]

Evidence Quote

the encoder Maps an input sequence into an abstract continuous representation that holds all the learned information of that input to decoder then takes our continuous representation and step by step generates a single output

Source

Illustrated Guide to Transformers Neural Network: A step by step explanationThe AI Hacker
Created: 8/13/2026, 9:51:15 AM

My Notes

Loading notes...