Lilly Endowment

This is for the Donations List Website: https://github.com/vipulnaik/donations

Specific issue: vipulnaik/donations#66

How to get new data and generate the SQL statements

NOTE: the months and focus areas are hard-coded into wget-commands.sh, so before you run that script you will need to determine the new months/focus areas and edit the relevant arrays.

today=$(date -Idate)

# Make new directory for data
mkdir data-retrieved-$today
cd data-retrieved-$today

# Download grants pages
../wget-commands.sh

# Go back up the directory tree
cd ..

# Use the HTML files to generate a SQL file containing insert statements
./proc.py data-retrieved-$today/* > out-$today.sql

License

CC0 for code.