原书出处
Designing Large Language Model Applications
additional decoding heads are added to the model. These decoding heads represent subsequent tokens to be generated. For example, the standard decoding head is predicting the next (n + 1st) token in the sequence, and the additional decoding heads are predicting the n + 2nd, n + 3rd, and so on, tokens, respectively. Refer to the Medusa paper for more details on how this is
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Designing Large Language Model Applications/_epub-src/OEBPS/ch09.html
EPUB SHA-256:1b4d2347fec2f949fcddfbaf4fad597a1ae20887a096cfae64c59a619b4781bf