原书出处
Natural Language Processing in Action, Second Edition
Multi-head self-attention Multi-head self-attention is an expansion of the self-attention approach to creating multiple attention heads that each attend to different aspects of the words in a text. So if a token has multiple meanings that are all relevant to the interpretation of the input text, they can each be accounted for in the separate attention heads. You can think of each attention head as
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Natural Language Processing in Action, Second Edition/_epub-src/OEBPS/Text/chapter-9.html
EPUB SHA-256:0e9a35e49ca446e322e5524e53f39fb6bee5b2b23d9cda10ef052aca770b0b36