原书出处
Foundations of Computer Vision (Antonio Torralba, Phillip Isola etc.)
where Tout,self is regular self-attention on the input text token Tt, and wcross and wself are optional learnable weights. The text decoder is an autoregressive model (section 32.7) that uses causal attention (section 26.10) to predict the next word in the sentence given the previous words generated so far. In this strategy, the input to the text decoder is the tokens representing the previous words
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Foundations of Computer Vision (Antonio Torralba, Phillip Isola etc.)/_epub-src/OPS/xhtml/c051.xhtml
EPUB SHA-256:60a7eebc43f5d9a675d776fed3736fbdaa791e55877023f2f8cba016a9b384f8