原书出处
System Design Interview – An insiders guide, Second Edition
09 网络爬虫
URL Seen? “URL Seen?” is a data structure that keeps track of URLs that are visited before or already in the Frontier. “URL Seen?” helps to avoid adding the same URL multiple times as this can increase server load and cause potential infinite loops. Bloom filter and hash table are common techniques to implement the “URL Seen?” component. We will not cover the detailed implementation
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/System Design Interview – An insiders guide, Second Edition/_epub-src/text/part0023_split_002.html
EPUB SHA-256:ffc3a97753094acb30719f26589af322724b6c17c10371f0626e61687734b345