Popular repositories Loading

1. ppspider ppspider Public

   web spider built by puppeteer, support task-queue and task-scheduling by decorators，support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架，提供灵活的任务队列管理调度方案，提供便捷的数据保存方案（nedb/mongodb）…

   TypeScript 335 77

2. ppspider_example ppspider_example Public

   ppspider爬虫例子，B站视频信息及评论爬取，qq音乐信息及评论爬取，推特主题评论和用户信息爬取

   TypeScript 23 13

3. MsgCheck MsgCheck Public

   敏感信息，垃圾信息，黄赌毒信息判断

   Scala 11 5

4. HBaseManager HBaseManager Public

   对HBase API的简单封装，Java和Scala混编

   Scala 8 5

5. JSpiderCluster JSpiderCluster Public

   Java + phantomjs 实现的一个分布式爬虫。

   Java 8 7

6. IdeaPluginTypeScriptExecutor IdeaPluginTypeScriptExecutor Public

   An IDEA plugin to make .ts file executable.

   Java 6 2