Skip to content

FreedomZZQ/crawler-java

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 

Repository files navigation

这是以个非常简单的爬虫程序,实现了以下功能:

  • 可以从种子url自动进行爬取
  • 多线程(可设置最大线程数)
  • 设置搜索深度
  • 过滤文件类型和文件大小

About

A web crawler used Java.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages