Skip to content

grtfou/755-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

94 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

755-Crawler

A web crawler that visit 755 website for download photo and video.

Last Modified: 2018.11.29

Requirements

  • Python >= 3.6
  • requests >= 2.21

How to Use

[Run by source code]

$ git clone https://github.com/grtfou/755-crawler.git
$ cd 755-crawler
$ pip install -r requirements.txt

$ python crawler.py <url> <start_download_post_date>

# ex.
# 1. Only download today
$ python crawler.py https://7gogo.jp/hori-miona

# 2. Download if the post after 181101
$ python crawler.py https://7gogo.jp/kuranoo-narumi 181101

License

MIT License