原书出处
Natural Language Processing in Action, Second Edition
Also, define an init_weights() method that can be called to initialize the weights of all submodules of the transformer, as shown in listing 9.12. Xavier initialization is commonly used for transformers, so use it here. The PyTorch nn.Module documentation23 describes the apply(fn) method that recursively applies fn to every submodule of the caller.
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Natural Language Processing in Action, Second Edition/_epub-src/OEBPS/Text/chapter-9.html
EPUB SHA-256:0e9a35e49ca446e322e5524e53f39fb6bee5b2b23d9cda10ef052aca770b0b36