Skip to content
This repository has been archived by the owner on Feb 2, 2022. It is now read-only.

ScrAPD 2 to 3 migration

Rémy Greinhofer edited this page Oct 9, 2019 · 8 revisions
#!/bin/bash
set -euo pipefail

rm -fr augmentations datasets/fatalities-*-augmented.json
mkdir -p augmentations/{2017..2019}
for YEAR in {2017..2019} ;do python tools/scrapd2to3.py -i datasets/fatalities-$YEAR-raw.json;done
jq -s add datasets/fatalities-20{17..19}-raw.json > datasets/fatalities-all-raw.json
bash tools/generate-augmentations-socrata-apd.sh
bash tools/update-raw-data-sets.sh
REGENERATE=1 bash tools/update-datasets.sh
bash tools/update-datasets.sh
Clone this wiki locally