Skip to content

Download the images and some relevant metadata from RSS and Atom feeds

License

Notifications You must be signed in to change notification settings

czimbortibor/rss-atom-feedscraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

34 Commits
 
 
 
 
 
 
 
 

Repository files navigation

overview

feed_list.json contains a list of RSS and Atom feeds which the script parses and downloads the found images in the tags and some relevant metadata. The metadata, list of feeds and the path to the images are then stored in MongoDB. scheduler.py schedules an automatic run of the script in the background

packages

usage

run the script in every k minutes

python3 scheduler.py k

or

nohup /usr/bin/python3 scheduler.py k &

Releases

No releases published

Packages

No packages published

Languages