Exchange Rate Scraper

Scrapes the money exchange rate from pottchange and stores the results into a postgres database.

Dependencies

python -m venv venv
. venv\Script\activate
pip install -r requirements.txt
pip install git+https://github.com/scrapy/scrapyd-client.git

docker-compose up -d

scrapy runspider .\crawl\spiders\pottchange.py

scrapyd
scrapyd-deploy local