原书出处
Designing Large Language Model Applications
Averaging The simplest way to combine multiple models is to average their parameters. Simple averaging has been shown to be quite effective. Weighted averaging During averaging, certain models or even certain layers in models can be weighted more. Interpolation Each model can be weighted by a factor w1, w2,…wn, with: w1 + w2 + w3 +...wn = 1 w1p1 + w2p2 + w3p3 +...wnpn where
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Designing Large Language Model Applications/_epub-src/OEBPS/ch07.html
EPUB SHA-256:1b4d2347fec2f949fcddfbaf4fad597a1ae20887a096cfae64c59a619b4781bf