##基于node的爬虫
###爬取知乎页面小头像
目前实现：
- 实现基本功能，实现连接队列池，哈希表去重
- 获取小头像url，以img的形式写入test.html，实现可持久化
- 实现并发数控制,异步爬取
不足：
- 代码风格粗糙
- 数据的展示没优化
-
Notifications
You must be signed in to change notification settings - Fork 0
musclejack/spider
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
基于node的爬虫
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published