原书出处
Natural Language Processing in Action, Second Edition
Unlike RNNs, where there is recurrence and shared weights, in self-attention, all of the vectors used in the query, key, and value matrices come from the input sequences’ embedding vectors. The entire mechanism can be implemented with highly optimized matrix multiplication operations. And the Q × K product forms a square matrix that can be understood as the connection between words in the input sequence.
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Natural Language Processing in Action, Second Edition/_epub-src/OEBPS/Text/chapter-9.html
EPUB SHA-256:0e9a35e49ca446e322e5524e53f39fb6bee5b2b23d9cda10ef052aca770b0b36