← 返回卡片

原书出处

System Design Interview – An insiders guide, Second Edition

09 网络爬虫

Second Edition · 核验版本的摘录快照 · 导入于 2026-11-14T09:08:16.611Z

URL Seen? “URL Seen?” is a data structure that keeps track of URLs that are visited before or already in the Frontier. “URL Seen?” helps to avoid adding the same URL multiple times as this can increase server load and cause potential infinite loops. Bloom filter and hash table are common techniques to implement the “URL Seen?” component. We will not cover the detailed implementation

此预览只包含定位所需的摘录和上下文。

原书定位详情

来源:a19c7933-4eda-4176-aebd-30fe7e1ad292

正文位置:extracted/System Design Interview – An insiders guide, Second Edition/_epub-src/text/part0023_split_002.html

EPUB SHA-256:ffc3a97753094acb30719f26589af322724b6c17c10371f0626e61687734b345