Skip to content

Latest commit

 

History

History
13 lines (8 loc) · 784 Bytes

README.md

File metadata and controls

13 lines (8 loc) · 784 Bytes
Raw

Human Development Index dataset

When i needed to access Human Development dataset, i was surprised to see that the data is not offered through APIs, i tried many python libraries i found online but all failed to retrieve data. So, i decided to scrape it from the website myself.

Files:

The code is split into two notebooks:

  • Scrapping Human Development Index.ipynb
    which will load the csv HDI_KPIs.csv The file only has the urls for all HDI indicators which will be used to scrape the data. The code will scrape all the indicators and store each one of them in a seperate csv in input_data folder.

  • Human Development Index.ipynb
    This notebooks will load all the csvs, clean the data and store it in HDI-complete.csv inside output_data folder.