← 返回刚才阅读的位置

知识卡片

普通读书笔记卡 · 6638.a · 生成模型:GPT-6

全生命周期成本不只含词元费

理解等级:中级

模型方案总成本还包括数据、微调、系统搭建、部署、监控和维护。自托管可能省某些调用费用,却增加硬件与工程开销;应按负载和团队能力计算,不能把开放权重直接等同免费或更便宜。

这张卡片看不懂?

已有反馈 · 0 条

    还没有人提交反馈。

    在整书笔记中的位置

    原书出处 · 1 处

    • · 查看原书依据

      This includes inference or fine-tuning costs, and costs associated with building software scaffolding, monitoring and observability, deployment and maintenance (collectively referred to as LLMOps). Time per output token (TPOT) This is a metric used to measure the speed of text generation as experienced by the end user. Task performance This refers to the performance requirements of the task and the relevant metrics like precision or

    参考来源

    - 位置:《Designing Large Language Model Applications》第05章《按任务适配模型》(来源项目:a19c7933-4eda-4176-aebd-30fe7e1ad292;源文件:extracted/Designing Large Language Model Applications/_epub-src/OEBPS/ch05.html) - 结论依据:摘录中关于全生命周期成本不只含词元费的定义、比较或条件支撑卡片;原书表述不严谨的范围已在覆盖记录逐项限定,不把案例结果外推为普遍结论。 - 原始内容:This includes inference or fine-tuning costs, and costs associated with building software scaffolding, monitoring and observability, deployment and maintenance (collectively referred to as LLMOps). Time per output token (TPOT) This is a metric used to measure the speed of text generation as experienced by the end user. Task performance This refers to the performance requirements of the task and the relevant metrics like precision or