原书出处
Designing Large Language Model Applications
This includes inference or fine-tuning costs, and costs associated with building software scaffolding, monitoring and observability, deployment and maintenance (collectively referred to as LLMOps). Time per output token (TPOT) This is a metric used to measure the speed of text generation as experienced by the end user. Task performance This refers to the performance requirements of the task and the relevant metrics like precision or
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Designing Large Language Model Applications/_epub-src/OEBPS/ch05.html
EPUB SHA-256:1b4d2347fec2f949fcddfbaf4fad597a1ae20887a096cfae64c59a619b4781bf