原书出处
Natural Language Processing in Action, Second Edition
Listing 9.11 TranslationTransformer.forward() >>> def forward(self, src, tgt): ... src, src_key_padding_mask = self.prepare_src( ... src, self.src_pad_idx) ... tgt, tgt_key_padding_mask, tgt_mask = self.prepare_tgt( ... tgt, self.tgt_pad_idx) ... memory_key_padding_mask = src_key_padding_mask.clone() ... output = super().forward( ... src, tgt, tgt_mask=tgt_mask, ... src_key_padding_mask=src_key_padding_mask, ... tgt_key_padding_mask=tgt_key_padding_mask, ... memory_key_padding_mask=memory_key_padding_mask) ... output = rearrange(output, 'T N E -> N T E') ... return self.linear(output) Also, define an init_weights() method that can be
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Natural Language Processing in Action, Second Edition/_epub-src/OEBPS/Text/chapter-9.html
EPUB SHA-256:0e9a35e49ca446e322e5524e53f39fb6bee5b2b23d9cda10ef052aca770b0b36