← 返回卡片

原书出处

Designing Distributed Systems, 2nd Edition

15 Chapter 15. AI Inference and Serving

Second Edition · 核验版本的摘录快照 · 导入于 2026-11-14T02:48:46.784Z

the first thing to consider is the computational requirements of the model and your application. If your application is going to be used interactively by a user, the latency of the responses is critical to the quality of the application. Generally, users begin to notice latency at 250

此预览只包含定位所需的摘录和上下文。

原书定位详情

来源:a19c7933-4eda-4176-aebd-30fe7e1ad292

正文位置:extracted/Designing Distributed Systems, 2nd Edition/_epub-src/OEBPS/ch15.html

EPUB SHA-256:d6092c05a28fa00f75eb7c89905415def203cd92f0373323020ba665a9969602