原书出处
Designing Large Language Model Applications
Symmetric Quantization In this setting, the 0 value in the original format is mapped to the 0 value in the integer representation. This means that when you quantize 0 represented in fp32 to int8, the value remains 0. The remaining values can be mapped using various techniques, the most common being absmax quantization. In this method, if we know or can estimate the range of
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Designing Large Language Model Applications/_epub-src/OEBPS/ch09.html
EPUB SHA-256:1b4d2347fec2f949fcddfbaf4fad597a1ae20887a096cfae64c59a619b4781bf