Description

SPDP Data Scraper

Installation

$ npm install

Setup database with prisma

# spin up database
docker-compose up -d

# apply migrations
npx prisma generate
npx prisma migrate deploy

Running the app

# development
$ npm run start

# watch mode
$ npm run start:dev

# production mode
$ npm run start:prod

Running Scraper using curl

# run scraper for specific district
curl --location 'http://localhost:3000/data-scraper/scrapeDataForDistrict' \
--header 'Content-Type: application/json' \
--data '{
    "districtLGDCode": "344"
}'

# run scraper for all districts
curl --location --request POST 'http://localhost:3000/data-scraper/scrapeData'