Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update to latest NAEI data #247

Open
wants to merge 5 commits into
base: develop
Choose a base branch
from
Open

Update to latest NAEI data #247

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
2b2f5ad
feat: update NAEI dataset
lgloege Nov 21, 2023
3dcae84
feat: update NAEI processing script
lgloege Nov 21, 2023
3a5f64c
feat: update processed NAEI data
lgloege Nov 21, 2023
8b33422
feat: add delete files
lgloege Nov 22, 2023
e0c41db
Merge branch 'delete_old_naei' into update_naei
lgloege Nov 22, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion harmonize/data/processed/NAEI_GB_subnational/DataSource.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
datasource_id,name,publisher,published,URL,citation
NAEI:DA_GHGI_1990_2020:v4.1,Devolved Administration GHG Inventory 1990-2020,NAEI,2022-09-15,https://naei.beis.gov.uk/reports/reports?section_id=4,"NAEI. (2022). Greenhouse Gas Inventories for England, Scotland, Wales & Northern Ireland: 1990-2020. National Atmospheric Emissions Inventory, ED11787/2020/CD10375/BR. https://naei.beis.gov.uk/reports/reports?section_id=4"
NAEI:DA_GHGI_1990_2021:v3.1,Devolved Administration GHG Inventory 1990-2021,NAEI,2023-06-20,https://naei.beis.gov.uk/reports/reports?report_id=1110,"NAEI. (2023). Greenhouse Gas Inventories for England, Scotland, Wales & Northern Ireland: 1990-2021. National Atmospheric Emissions Inventory, https://naei.beis.gov.uk/reports/reports?report_id=1110"
2 changes: 2 additions & 0 deletions harmonize/data/processed/NAEI_GB_subnational/DataSource.delete.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
datasource_id
NAEI:DA_GHGI_1990_2020:v4.1
8 changes: 4 additions & 4 deletions harmonize/data/processed/NAEI_GB_subnational/DataSourceTag.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
datasource_id,tag_id
NAEI:DA_GHGI_1990_2020:v4.1,GHGs_included_CO2_CH4_N2O_F_gases
NAEI:DA_GHGI_1990_2020:v4.1,excludes_international_shipping_aviation
NAEI:DA_GHGI_1990_2020:v4.1,excludes_LULUCF
NAEI:DA_GHGI_1990_2020:v4.1,GWP_100_AR5
NAEI:DA_GHGI_1990_2021:v3.1,GHGs_included_CO2_CH4_N2O_F_gases
NAEI:DA_GHGI_1990_2021:v3.1,excludes_international_shipping_aviation
NAEI:DA_GHGI_1990_2021:v3.1,excludes_LULUCF
NAEI:DA_GHGI_1990_2021:v3.1,GWP_100_AR5
5 changes: 5 additions & 0 deletions harmonize/data/processed/NAEI_GB_subnational/DataSourceTag.delete.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
datasource_id,tag_id
NAEI:DA_GHGI_1990_2020:v4.1,GHGs_included_CO2_CH4_N2O_F_gases
NAEI:DA_GHGI_1990_2020:v4.1,excludes_international_shipping_aviation
NAEI:DA_GHGI_1990_2020:v4.1,excludes_LULUCF
NAEI:DA_GHGI_1990_2020:v4.1,GWP_100_AR5
204 changes: 104 additions & 100 deletions harmonize/data/processed/NAEI_GB_subnational/EmissionsAgg.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,101 +1,105 @@
emissions_id,actor_id,year,total_emissions,datasource_id
NAEI_GHGI_AR5:GB-ENG:1990,GB-ENG,1990,626590455,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:1995,GB-ENG,1995,576385002,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:1998,GB-ENG,1998,566796026,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:1999,GB-ENG,1999,540695904,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2000,GB-ENG,2000,538653438,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2001,GB-ENG,2001,544403180,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2002,GB-ENG,2002,535639407,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2003,GB-ENG,2003,540289882,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2004,GB-ENG,2004,535944382,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2005,GB-ENG,2005,530139357,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2006,GB-ENG,2006,520392693,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2007,GB-ENG,2007,516203779,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2008,GB-ENG,2008,497327934,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2009,GB-ENG,2009,453043718,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2010,GB-ENG,2010,460274319,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2011,GB-ENG,2011,427664585,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2012,GB-ENG,2012,442367207,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2013,GB-ENG,2013,425442326,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2014,GB-ENG,2014,393852298,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2015,GB-ENG,2015,376355634,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2016,GB-ENG,2016,352981635,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2017,GB-ENG,2017,349823167,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2018,GB-ENG,2018,344239308,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2019,GB-ENG,2019,330427182,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:2020,GB-ENG,2020,298577376,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:1990,GB-NIR,1990,25041588,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:1995,GB-NIR,1995,26026385,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:1998,GB-NIR,1998,25446950,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:1999,GB-NIR,1999,25994718,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2000,GB-NIR,2000,25726305,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2001,GB-NIR,2001,26068069,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2002,GB-NIR,2002,23635265,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2003,GB-NIR,2003,23837851,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2004,GB-NIR,2004,23671968,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2005,GB-NIR,2005,24835549,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2006,GB-NIR,2006,24976930,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2007,GB-NIR,2007,23717369,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2008,GB-NIR,2008,23268219,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2009,GB-NIR,2009,21420114,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2010,GB-NIR,2010,22036003,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2011,GB-NIR,2011,20837137,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2012,GB-NIR,2012,20893871,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2013,GB-NIR,2013,21314335,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2014,GB-NIR,2014,20564277,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2015,GB-NIR,2015,20990339,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2016,GB-NIR,2016,21400034,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2017,GB-NIR,2017,20582637,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2018,GB-NIR,2018,20299247,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2019,GB-NIR,2019,19788464,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-NIR:2020,GB-NIR,2020,18891708,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:1990,GB-SCT,1990,75264306,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:1995,GB-SCT,1995,75719439,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:1998,GB-SCT,1998,77105742,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:1999,GB-SCT,1999,74853317,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2000,GB-SCT,2000,76905494,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2001,GB-SCT,2001,75777359,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2002,GB-SCT,2002,72217879,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2003,GB-SCT,2003,72346626,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2004,GB-SCT,2004,69916076,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2005,GB-SCT,2005,68270205,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2006,GB-SCT,2006,70580091,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2007,GB-SCT,2007,66529207,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2008,GB-SCT,2008,64169135,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2009,GB-SCT,2009,60083472,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2010,GB-SCT,2010,62984176,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2011,GB-SCT,2011,56015800,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2012,GB-SCT,2012,56415628,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2013,GB-SCT,2013,53931802,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2014,GB-SCT,2014,50418091,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2015,GB-SCT,2015,49193480,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2016,GB-SCT,2016,44783262,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2017,GB-SCT,2017,43679113,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2018,GB-SCT,2018,44321155,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2019,GB-SCT,2019,42740210,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-SCT:2020,GB-SCT,2020,38991494,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:1990,GB-WLS,1990,56014828,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:1995,GB-WLS,1995,52691707,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:1998,GB-WLS,1998,54230391,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:1999,GB-WLS,1999,55213592,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2000,GB-WLS,2000,56002785,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2001,GB-WLS,2001,53161030,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2002,GB-WLS,2002,47067239,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2003,GB-WLS,2003,49017881,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2004,GB-WLS,2004,52373315,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2005,GB-WLS,2005,50919629,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2006,GB-WLS,2006,51881397,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2007,GB-WLS,2007,49090381,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2008,GB-WLS,2008,50251638,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2009,GB-WLS,2009,43801777,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2010,GB-WLS,2010,46918552,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2011,GB-WLS,2011,44035919,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2012,GB-WLS,2012,45832319,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2013,GB-WLS,2013,50883764,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2014,GB-WLS,2014,46549894,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2015,GB-WLS,2015,46308064,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2016,GB-WLS,2016,48617364,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2017,GB-WLS,2017,42487733,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2018,GB-WLS,2018,38864476,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2019,GB-WLS,2019,38645623,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-WLS:2020,GB-WLS,2020,34336524,NAEI:DA_GHGI_1990_2020:v4.1
NAEI_GHGI_AR5:GB-ENG:1990,GB-ENG,1990,627413965,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:1995,GB-ENG,1995,577435399,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:1998,GB-ENG,1998,568180684,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:1999,GB-ENG,1999,541341637,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2000,GB-ENG,2000,539754735,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2001,GB-ENG,2001,545757214,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2002,GB-ENG,2002,537355745,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2003,GB-ENG,2003,541452299,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2004,GB-ENG,2004,537241951,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2005,GB-ENG,2005,531177274,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2006,GB-ENG,2006,521607094,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2007,GB-ENG,2007,517442988,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2008,GB-ENG,2008,498686583,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2009,GB-ENG,2009,454277529,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2010,GB-ENG,2010,461649525,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2011,GB-ENG,2011,428858488,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2012,GB-ENG,2012,443263872,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2013,GB-ENG,2013,426491732,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2014,GB-ENG,2014,394658540,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2015,GB-ENG,2015,376930550,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2016,GB-ENG,2016,353652632,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2017,GB-ENG,2017,350175950,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2018,GB-ENG,2018,344449034,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2019,GB-ENG,2019,331429735,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2020,GB-ENG,2020,298225049,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-ENG:2021,GB-ENG,2021,316165994,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:1990,GB-NIR,1990,26402488,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:1995,GB-NIR,1995,26457565,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:1998,GB-NIR,1998,25620687,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:1999,GB-NIR,1999,26107929,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2000,GB-NIR,2000,25738572,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2001,GB-NIR,2001,26190966,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2002,GB-NIR,2002,23637269,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2003,GB-NIR,2003,23969500,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2004,GB-NIR,2004,23853933,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2005,GB-NIR,2005,25165550,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2006,GB-NIR,2006,25324043,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2007,GB-NIR,2007,24068139,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2008,GB-NIR,2008,23592331,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2009,GB-NIR,2009,21758032,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2010,GB-NIR,2010,22347397,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2011,GB-NIR,2011,21120266,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2012,GB-NIR,2012,21185091,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2013,GB-NIR,2013,21460201,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2014,GB-NIR,2014,20860001,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2015,GB-NIR,2015,21394671,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2016,GB-NIR,2016,21537587,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2017,GB-NIR,2017,20841120,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2018,GB-NIR,2018,20389672,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2019,GB-NIR,2019,19918858,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2020,GB-NIR,2020,19086793,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-NIR:2021,GB-NIR,2021,20133669,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:1990,GB-SCT,1990,74566672,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:1995,GB-SCT,1995,75380866,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:1998,GB-SCT,1998,76729547,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:1999,GB-SCT,1999,74471764,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2000,GB-SCT,2000,76554298,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2001,GB-SCT,2001,75547028,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2002,GB-SCT,2002,72141554,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2003,GB-SCT,2003,72200906,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2004,GB-SCT,2004,69726813,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2005,GB-SCT,2005,68260689,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2006,GB-SCT,2006,70457617,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2007,GB-SCT,2007,66314377,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2008,GB-SCT,2008,64171738,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2009,GB-SCT,2009,60079419,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2010,GB-SCT,2010,63036251,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2011,GB-SCT,2011,56182903,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2012,GB-SCT,2012,56711787,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2013,GB-SCT,2013,54080142,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2014,GB-SCT,2014,50596829,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2015,GB-SCT,2015,49551946,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2016,GB-SCT,2016,45090526,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2017,GB-SCT,2017,43935268,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2018,GB-SCT,2018,44660911,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2019,GB-SCT,2019,43352856,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2020,GB-SCT,2020,39501000,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-SCT:2021,GB-SCT,2021,40557071,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:1990,GB-WLS,1990,55850523,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:1995,GB-WLS,1995,52723005,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:1998,GB-WLS,1998,54239289,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:1999,GB-WLS,1999,55234349,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2000,GB-WLS,2000,55929836,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2001,GB-WLS,2001,53181786,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2002,GB-WLS,2002,47066940,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2003,GB-WLS,2003,48958022,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2004,GB-WLS,2004,52433626,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2005,GB-WLS,2005,50803806,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2006,GB-WLS,2006,51861585,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2007,GB-WLS,2007,49085891,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2008,GB-WLS,2008,50322256,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2009,GB-WLS,2009,43849924,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2010,GB-WLS,2010,46941738,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2011,GB-WLS,2011,44077772,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2012,GB-WLS,2012,46000104,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2013,GB-WLS,2013,50906252,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2014,GB-WLS,2014,46501406,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2015,GB-WLS,2015,46383520,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2016,GB-WLS,2016,48508401,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2017,GB-WLS,2017,42392885,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2018,GB-WLS,2018,38844899,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2019,GB-WLS,2019,38803677,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2020,GB-WLS,2020,34389178,NAEI:DA_GHGI_1990_2021:v3.1
NAEI_GHGI_AR5:GB-WLS:2021,GB-WLS,2021,36729920,NAEI:DA_GHGI_1990_2021:v3.1
Binary file renamed ...DA_GHGI_1990-2020_Final_v4.1_AR4_AR5.xlsm → ...6200930_DA_GHGI_1990-2021_Final_v3.1.xlsx
View file
Open in desktop
Binary file not shown.
14 changes: 7 additions & 7 deletions harmonize/scripts/process_NAEIS_GB.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -95,7 +95,7 @@ def check_for_zero_emissions(df):

def process_sheet(actor_name, actor_id, GWP, SECTORS, DATASOURCE_DICT, ASTYPE_DICT):
return (
pd.read_excel(fl, sheet_name=f'{actor_name} By Source_{GWP}', header=16)
pd.read_excel(fl, sheet_name=f'{actor_name} By Source', header=15)
.loc[lambda x: x['NCFormat'].isin(SECTORS)]
.drop(columns=['Unnamed: 0', 'IPCC_name', 'BaseYear'])
.pipe(df_wide_to_long, value_name='emissions', var_name='year')
Expand All @@ -120,7 +120,7 @@ def process_sheet(actor_name, actor_id, GWP, SECTORS, DATASOURCE_DICT, ASTYPE_DI
make_dir(path=Path(outputDir).as_posix())

# NAEI dataset
fl = '../data/raw/NAEI_GB_subnational/2209201114_DA_GHGI_1990-2020_Final_v4.1_AR4_AR5.xlsm'
fl = '../data/raw/NAEI_GB_subnational/2306200930_DA_GHGI_1990-2021_Final_v3.1.xlsx'
fl = os.path.abspath(fl)

# ------------------------------------------
Expand All @@ -140,12 +140,12 @@ def process_sheet(actor_name, actor_id, GWP, SECTORS, DATASOURCE_DICT, ASTYPE_DI
# DataSource table
# ------------------------------------------
DATASOURCE_DICT = {
'datasource_id': 'NAEI:DA_GHGI_1990_2020:v4.1',
'name': 'Devolved Administration GHG Inventory 1990-2020',
'datasource_id': 'NAEI:DA_GHGI_1990_2021:v3.1',
'name': 'Devolved Administration GHG Inventory 1990-2021',
'publisher': f"{PUBLISHER_DICT['id']}",
'published': '2022-09-15',
'URL': 'https://naei.beis.gov.uk/reports/reports?section_id=4',
'citation': "NAEI. (2022). Greenhouse Gas Inventories for England, Scotland, Wales & Northern Ireland: 1990-2020. National Atmospheric Emissions Inventory, ED11787/2020/CD10375/BR. https://naei.beis.gov.uk/reports/reports?section_id=4"
'published': '2023-06-20',
'URL': 'https://naei.beis.gov.uk/reports/reports?report_id=1110',
'citation': "NAEI. (2023). Greenhouse Gas Inventories for England, Scotland, Wales & Northern Ireland: 1990-2021. National Atmospheric Emissions Inventory, https://naei.beis.gov.uk/reports/reports?report_id=1110"
}

simple_write_csv(
Expand Down
Loading