Created a website-crawler in bash. Note, it's for a specific website and will not work unless you know the site.
You can see the code and follow it by starting with run.sh
run.sh
- get_item_links.sh
- get_skus.sh
- split_skus.sh
- loop_through_sku_files.sh
- create_query.sh
- get_pricing.sh
- create_query.sh
- check_if_lowest_price.sh