Error in rule build_shapes

[Haiping007]

Hi,
I got the Error in rule build_shapes. Do you have any idea how to fix it? It went well the last few days.

The detailed information is as follows:

Error in rule build_shapes:
jobid: 9
input: data/eez/eez_v11.gpkg
output: resources/shapes/country_shapes.geojson, resources/shapes/offshore_shapes.geojson, resources/shapes/africa_shape.geojson, resources/shapes/gadm_shapes.geojson
log: logs/build_shapes.log (check log file(s) for error details)

ERROR:snakemake.logging:Error in rule build_shapes:
jobid: 9
input: data/eez/eez_v11.gpkg
output: resources/shapes/country_shapes.geojson, resources/shapes/offshore_shapes.geojson, resources/shapes/africa_shape.geojson, resources/shapes/gadm_shapes.geojson
log: logs/build_shapes.log (check log file(s) for error details)

RuleException:
CalledProcessError in file C:\Users\haipings\pypsa\pypsa-earth_KE_new\pypsa-earth\Snakefile, line 256:
Command 'C:/Users/haipings/AppData/Local/miniconda3/envs/pypsa-earth/python.exe "C:\Users\haipings\pypsa\pypsa-earth_KE_new\pypsa-earth.snakemake\scripts\tmp6o0c2b17.build_shapes.py"' returned non-zero exit status 1.
File "C:\Users\haipings\pypsa\pypsa-earth_KE_new\pypsa-earth\Snakefile", line 256, in __rule_build_shapes
File "C:\Users\haipings\AppData\Local\miniconda3\envs\pypsa-earth\lib\concurrent\futures\thread.py", line 58, in run
ERROR:snakemake.logging:RuleException:
CalledProcessError in file C:\Users\haipings\pypsa\pypsa-earth_KE_new\pypsa-earth\Snakefile, line 256:
Command 'C:/Users/haipings/AppData/Local/miniconda3/envs/pypsa-earth/python.exe "C:\Users\haipings\pypsa\pypsa-earth_KE_new\pypsa-earth.snakemake\scripts\tmp6o0c2b17.build_shapes.py"' returned non-zero exit status 1.
File "C:\Users\haipings\pypsa\pypsa-earth_KE_new\pypsa-earth\Snakefile", line 256, in __rule_build_shapes
File "C:\Users\haipings\AppData\Local\miniconda3\envs\pypsa-earth\lib\concurrent\futures\thread.py", line 58, in run
Removing output files of failed job build_shapes since they might be corrupted:
resources/shapes/country_shapes.geojson, resources/shapes/offshore_shapes.geojson, resources/shapes/africa_shape.geojson
WARNING:snakemake.logging:Removing output files of failed job build_shapes since they might be corrupted:
resources/shapes/country_shapes.geojson, resources/shapes/offshore_shapes.geojson, resources/shapes/africa_shape.geojson
Shutting down, this might take some time.
WARNING:snakemake.logging:Shutting down, this might take some time.
Exiting because a job execution failed. Look above for error message
ERROR:snakemake.logging:Exiting because a job execution failed. Look above for error message
Complete log: .snakemake\log\2024-03-20T141458.859523.snakemake.log
WARNING:snakemake.logging:Complete log: .snakemake\log\2024-03-20T141458.859523.snakemake.log

[davide-f]

Hello @Haiping007 !
That's a pity you encountered this error.
Could you please elaborate a bit better? In particular, I'd recommend to share a longer share of the output log.
This is a synthetic output that suggests a general error to have occurred, and unfortunately doesn't give me much to suggest

[Haiping007]

@davide-f
Hi,
I updated the repo and config file. Then reran the model, but still got the error in rule build_shapes.
Are there anything else that I can do to fix it?
The output information is as follows:

(pypsa-earth) C:\Users\haipings\pypsa\pypsa-earth_KE_new\pypsa-earth>snakemake -j 1 solve_all_networks
Set parameter Username
Academic license - for non-commercial use only - expires 2024-09-10
No parameters matching '_test' found
C:\Users\haipings\AppData\Local\miniconda3\envs\pypsa-earth\lib\site-packages\pypsa\networkclustering.py:16: UserWarning: The namespace pypsa.networkclustering is deprecated and will be removed in PyPSA v0.24. Please use pypsa.clustering.spatial instead.
warnings.warn(
Building DAG of jobs...
WARNING:snakemake.logging:Building DAG of jobs...
Provided cores: 1 (use --cores to define parallelism)
WARNING:snakemake.logging:Provided cores: 1 (use --cores to define parallelism)
Rules claiming more threads will be scaled down.
WARNING:snakemake.logging:Rules claiming more threads will be scaled down.
Job stats:
job count

---

add_electricity 1
add_extra_components 1
base_network 1
build_bus_regions 1
build_demand_profiles 1
build_osm_network 1
build_powerplants 1
build_renewable_profiles 5
build_shapes 1
clean_osm_data 1
cluster_network 1
prepare_network 1
simplify_network 1
solve_all_networks 1
solve_network 1
total 19

WARNING:snakemake.logging:Job stats:
job count

---

add_electricity 1
add_extra_components 1
base_network 1
build_bus_regions 1
build_demand_profiles 1
build_osm_network 1
build_powerplants 1
build_renewable_profiles 5
build_shapes 1
clean_osm_data 1
cluster_network 1
prepare_network 1
simplify_network 1
solve_all_networks 1
solve_network 1
total 19

Select jobs to execute...
WARNING:snakemake.logging:Select jobs to execute...

INFO:snakemake.logging:
[Wed Mar 20 20:27:47 2024]
INFO:snakemake.logging:[Wed Mar 20 20:27:47 2024]
rule build_shapes:
input: data/eez/eez_v11.gpkg
output: resources/shapes/country_shapes.geojson, resources/shapes/offshore_shapes.geojson, resources/shapes/africa_shape.geojson, resources/shapes/gadm_shapes.geojson
log: logs/build_shapes.log
jobid: 9
benchmark: benchmarks/build_shapes
reason: Missing output files: resources/shapes/gadm_shapes.geojson, resources/shapes/africa_shape.geojson, resources/shapes/country_shapes.geojson, resources/shapes/offshore_shapes.geojson
resources: tmpdir=C:\Users\haipings\AppData\Local\Temp, mem_mb=500, mem_mib=477
INFO:snakemake.logging:rule build_shapes:
input: data/eez/eez_v11.gpkg
output: resources/shapes/country_shapes.geojson, resources/shapes/offshore_shapes.geojson, resources/shapes/africa_shape.geojson, resources/shapes/gadm_shapes.geojson
log: logs/build_shapes.log
jobid: 9
benchmark: benchmarks/build_shapes
reason: Missing output files: resources/shapes/gadm_shapes.geojson, resources/shapes/africa_shape.geojson, resources/shapes/country_shapes.geojson, resources/shapes/offshore_shapes.geojson
resources: tmpdir=C:\Users\haipings\AppData\Local\Temp, mem_mb=500, mem_mib=477

INFO:snakemake.logging:
This is the repository path: C:\Users\haipings\pypsa\pypsa-earth_KE_new\pypsa-earth
Had to go 0 folder(s) up.
Traceback (most recent call last):
File "C:\Users\haipings\pypsa\pypsa-earth_KE_new\pypsa-earth.snakemake\scripts\tmppicxnrq4.build_shapes.py", line 935, in
nchunks = snakemake.params.build_shape_options["nchunks"]
KeyError: 'nchunks'
[Wed Mar 20 20:27:50 2024]
INFO:snakemake.logging:[Wed Mar 20 20:27:50 2024]
Error in rule build_shapes:
jobid: 9
input: data/eez/eez_v11.gpkg
output: resources/shapes/country_shapes.geojson, resources/shapes/offshore_shapes.geojson, resources/shapes/africa_shape.geojson, resources/shapes/gadm_shapes.geojson
log: logs/build_shapes.log (check log file(s) for error details)

ERROR:snakemake.logging:Error in rule build_shapes:
jobid: 9
input: data/eez/eez_v11.gpkg
output: resources/shapes/country_shapes.geojson, resources/shapes/offshore_shapes.geojson, resources/shapes/africa_shape.geojson, resources/shapes/gadm_shapes.geojson
log: logs/build_shapes.log (check log file(s) for error details)

RuleException:
CalledProcessError in file C:\Users\haipings\pypsa\pypsa-earth_KE_new\pypsa-earth\Snakefile, line 256:
Command 'C:/Users/haipings/AppData/Local/miniconda3/envs/pypsa-earth/python.exe "C:\Users\haipings\pypsa\pypsa-earth_KE_new\pypsa-earth.snakemake\scripts\tmppicxnrq4.build_shapes.py"' returned non-zero exit status 1.
File "C:\Users\haipings\pypsa\pypsa-earth_KE_new\pypsa-earth\Snakefile", line 256, in __rule_build_shapes
File "C:\Users\haipings\AppData\Local\miniconda3\envs\pypsa-earth\lib\concurrent\futures\thread.py", line 58, in run
ERROR:snakemake.logging:RuleException:
CalledProcessError in file C:\Users\haipings\pypsa\pypsa-earth_KE_new\pypsa-earth\Snakefile, line 256:
Command 'C:/Users/haipings/AppData/Local/miniconda3/envs/pypsa-earth/python.exe "C:\Users\haipings\pypsa\pypsa-earth_KE_new\pypsa-earth.snakemake\scripts\tmppicxnrq4.build_shapes.py"' returned non-zero exit status 1.
File "C:\Users\haipings\pypsa\pypsa-earth_KE_new\pypsa-earth\Snakefile", line 256, in __rule_build_shapes
File "C:\Users\haipings\AppData\Local\miniconda3\envs\pypsa-earth\lib\concurrent\futures\thread.py", line 58, in run
Shutting down, this might take some time.
WARNING:snakemake.logging:Shutting down, this might take some time.
Exiting because a job execution failed. Look above for error message
ERROR:snakemake.logging:Exiting because a job execution failed. Look above for error message
Complete log: .snakemake\log\2024-03-20T202743.154524.snakemake.log
WARNING:snakemake.logging:Complete log: .snakemake\log\2024-03-20T202743.154524.snakemake.log

[davide-f]

Mmm it seems like the code is not yet updated.
The error message is related to this line "nchunks = snakemake.params.build_shape_options["nchunks"]",
however, in the main of the repo, we don't have this parameter anymore.

Can you verify if you are using the right folder where you cloned the repo again?

[Haiping007]

Haha, you are right, thank you!
now I have adjusted the right folder to clone the repo, and then reran the model. As it is a new first-time run. I set all 'true' in the config file:
retrieve_databundle: true
retrieve_cost_data: true
download_osm_data: true
build_natura_raster: true
build_cutout: true

But a new error came: Missing input files for rule build_demand_profiles (I thought the input files should be downloaded at first!) What shall I do to fix it? thanks again!

(pypsa-earth) C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth>snakemake -j 1 solve_all_networks
Set parameter Username
Academic license - for non-commercial use only - expires 2024-09-10
No parameters matching '_test' found
C:\Users\haipings\AppData\Local\miniconda3\envs\pypsa-earth\lib\site-packages\pypsa\networkclustering.py:16: UserWarning: The namespace pypsa.networkclustering is deprecated and will be removed in PyPSA v0.24. Please use pypsa.clustering.spatial instead.
warnings.warn(
Building DAG of jobs...
WARNING:snakemake.logging:Building DAG of jobs...
MissingInputException in rule build_demand_profiles in file C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth\Snakefile, line 415:
Missing input files for rule build_demand_profiles:
output: resources/demand_profiles.csv
affected files:
data/ssp2-2.6/2050/era5_2013/Africa.nc
ERROR:snakemake.logging:MissingInputException in rule build_demand_profiles in file C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth\Snakefile, line 415:
Missing input files for rule build_demand_profiles:
output: resources/demand_profiles.csv
affected files:
data/ssp2-2.6/2050/era5_2013/Africa.nc

[davide-f]

Ah no, please use:
retrieve_databundle: true
retrieve_cost_data: true
download_osm_data: true
build_natura_raster: false
build_cutout: false

for africa we have a pre-defined cutout and we also have a default global natura.tiff file; no need to build them.
Please, to make the run, copy the file "config.default.yaml", rename it as "config.yaml" and implement the changes.
Make sure to have "tutorial: false" on top of the file

[Haiping007]

Hi, Davide, many thanks for your support.

I did everything you reminded me, but why it still has the same error: Missing input files for rule build_demand_profiles:

(pypsa-earth) C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth>snakemake -j 1 solve_all_networks
Set parameter Username
Academic license - for non-commercial use only - expires 2024-09-10
No parameters matching '_test' found
C:\Users\haipings\AppData\Local\miniconda3\envs\pypsa-earth\lib\site-packages\pypsa\networkclustering.py:16: UserWarning: The namespace pypsa.networkclustering is deprecated and will be removed in PyPSA v0.24. Please use pypsa.clustering.spatial instead.
warnings.warn(
Building DAG of jobs...
WARNING:snakemake.logging:Building DAG of jobs...
MissingInputException in rule build_demand_profiles in file C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth\Snakefile, line 415:
Missing input files for rule build_demand_profiles:
output: resources/demand_profiles.csv
affected files:
data/ssp2-2.6/2050/era5_2013/Africa.nc
ERROR:snakemake.logging:MissingInputException in rule build_demand_profiles in file C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth\Snakefile, line 415:
Missing input files for rule build_demand_profiles:
output: resources/demand_profiles.csv
affected files:
data/ssp2-2.6/2050/era5_2013/Africa.nc

[davide-f]

Hello!
Mmm I feel like we miss the file Africa for 2050.
Maybe you can use the file for 2030 but modify the scaling factor in the demand options to multiply the time series to match the desired value.

That scaling factor multiplies identically all time steps of the selected time series

[Haiping007]

Hi, Davide

There is no folder 'ssp2-2.6' under the folder 'data', so I don't think I can use the file for 2030. I copied the folder 'ssp2-2.6' from before to this new 'pypsa-earth' (after cloning the updated repo), the error about 'miss the file Africa for 2050' was gone, but a new error came in rule download_osm_data as follows. I feel there might be something wrong with 'downloading' files. I attach the config file and let you test it on your local computer to see if anything is wrong. (I sent it you via email)

---

(pypsa-earth) C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth>snakemake -j 1 solve_all_networks
Set parameter Username
Academic license - for non-commercial use only - expires 2024-09-10
No parameters matching '_test' found
C:\Users\haipings\AppData\Local\miniconda3\envs\pypsa-earth\lib\site-packages\pypsa\networkclustering.py:16: UserWarning: The namespace pypsa.networkclustering is deprecated and will be removed in PyPSA v0.24. Please use pypsa.clustering.spatial instead.
warnings.warn(
Building DAG of jobs...
WARNING:snakemake.logging:Building DAG of jobs...
Provided cores: 1 (use --cores to define parallelism)
WARNING:snakemake.logging:Provided cores: 1 (use --cores to define parallelism)
Rules claiming more threads will be scaled down.
WARNING:snakemake.logging:Rules claiming more threads will be scaled down.
Job stats:
job count

---

add_electricity 1
add_extra_components 1
base_network 1
build_bus_regions 1
build_demand_profiles 1
build_osm_network 1
build_powerplants 1
build_renewable_profiles 5
build_shapes 1
clean_osm_data 1
cluster_network 1
copy_defaultnatura_tiff 1
download_osm_data 1
prepare_network 1
retrieve_databundle_light 1
simplify_network 1
solve_all_networks 1
solve_network 1
total 22

WARNING:snakemake.logging:Job stats:
job count

---

add_electricity 1
add_extra_components 1
base_network 1
build_bus_regions 1
build_demand_profiles 1
build_osm_network 1
build_powerplants 1
build_renewable_profiles 5
build_shapes 1
clean_osm_data 1
cluster_network 1
copy_defaultnatura_tiff 1
download_osm_data 1
prepare_network 1
retrieve_databundle_light 1
simplify_network 1
solve_all_networks 1
solve_network 1
total 22

Select jobs to execute...
WARNING:snakemake.logging:Select jobs to execute...

INFO:snakemake.logging:
[Sun Mar 24 20:23:32 2024]
INFO:snakemake.logging:[Sun Mar 24 20:23:32 2024]
rule download_osm_data:
output: resources/osm/raw/all_raw_cables.geojson, resources/osm/raw/all_raw_generators.geojson, resources/osm/raw/all_raw_generators.csv, resources/osm/raw/all_raw_lines.geojson, resources/osm/raw/all_raw_substations.geojson
log: logs/download_osm_data.log
jobid: 15
benchmark: benchmarks/download_osm_data
reason: Missing output files: resources/osm/raw/all_raw_cables.geojson, resources/osm/raw/all_raw_generators.geojson, resources/osm/raw/all_raw_substations.geojson, resources/osm/raw/all_raw_lines.geojson
resources: tmpdir=C:\Users\haipings\AppData\Local\Temp
INFO:snakemake.logging:rule download_osm_data:
output: resources/osm/raw/all_raw_cables.geojson, resources/osm/raw/all_raw_generators.geojson, resources/osm/raw/all_raw_generators.csv, resources/osm/raw/all_raw_lines.geojson, resources/osm/raw/all_raw_substations.geojson
log: logs/download_osm_data.log
jobid: 15
benchmark: benchmarks/download_osm_data
reason: Missing output files: resources/osm/raw/all_raw_cables.geojson, resources/osm/raw/all_raw_generators.geojson, resources/osm/raw/all_raw_substations.geojson, resources/osm/raw/all_raw_lines.geojson
resources: tmpdir=C:\Users\haipings\AppData\Local\Temp

INFO:snakemake.logging:
ERROR:_helpers:An error happened in module 'C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth\scripts\download_osm_data.py', function '': module 'earth_osm.eo' has no attribute 'save_osm_data'
Traceback (most recent call last):
File "C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth.snakemake\scripts\tmp7xggqgss.download_osm_data.py", line 113, in
eo.save_osm_data(
AttributeError: module 'earth_osm.eo' has no attribute 'save_osm_data'
[Sun Mar 24 20:23:34 2024]
INFO:snakemake.logging:[Sun Mar 24 20:23:34 2024]
Error in rule download_osm_data:
jobid: 15
output: resources/osm/raw/all_raw_cables.geojson, resources/osm/raw/all_raw_generators.geojson, resources/osm/raw/all_raw_generators.csv, resources/osm/raw/all_raw_lines.geojson, resources/osm/raw/all_raw_substations.geojson
log: logs/download_osm_data.log (check log file(s) for error details)

ERROR:snakemake.logging:Error in rule download_osm_data:
jobid: 15
output: resources/osm/raw/all_raw_cables.geojson, resources/osm/raw/all_raw_generators.geojson, resources/osm/raw/all_raw_generators.csv, resources/osm/raw/all_raw_lines.geojson, resources/osm/raw/all_raw_substations.geojson
log: logs/download_osm_data.log (check log file(s) for error details)

RuleException:
CalledProcessError in file C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth\Snakefile, line 181:
Command 'C:/Users/haipings/AppData/Local/miniconda3/envs/pypsa-earth/python.exe "C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth.snakemake\scripts\tmp7xggqgss.download_osm_data.py"' returned non-zero exit status 1.
File "C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth\Snakefile", line 181, in __rule_download_osm_data
File "C:\Users\haipings\AppData\Local\miniconda3\envs\pypsa-earth\lib\concurrent\futures\thread.py", line 58, in run
ERROR:snakemake.logging:RuleException:
CalledProcessError in file C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth\Snakefile, line 181:
Command 'C:/Users/haipings/AppData/Local/miniconda3/envs/pypsa-earth/python.exe "C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth.snakemake\scripts\tmp7xggqgss.download_osm_data.py"' returned non-zero exit status 1.
File "C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth\Snakefile", line 181, in __rule_download_osm_data
File "C:\Users\haipings\AppData\Local\miniconda3\envs\pypsa-earth\lib\concurrent\futures\thread.py", line 58, in run
Shutting down, this might take some time.
WARNING:snakemake.logging:Shutting down, this might take some time.
Exiting because a job execution failed. Look above for error message
ERROR:snakemake.logging:Exiting because a job execution failed. Look above for error message
Complete log: .snakemake\log\2024-03-24T202325.221345.snakemake.log
WARNING:snakemake.logging:Complete log: .snakemake\log\2024-03-24T202325.221345.snakemake.log

[davide-f]

In the latest version, earth osm package changed behavior.
You may need to create the environment again.
You may desired to create it with a different name so that you dont overwrite the previous one.

To do so, go to envs/environment.yaml and chanhe the "name:" of the environment to something like "pypsa-earth-new".
Then execute:
Conda env create -f envs/environment.yaml

That should re-enable the workflow.
Apologies for the annoying update, but that increases the functionalities

[Haiping007]

Hi David,
Thank you. I have created the environment again with a new name. Now it runs smoothly except for the last two solve steps. Do I have to use GUROBI version 11?

The output information:

(pypsa-earth-new) C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth>snakemake -j 1 solve_all_networks
Set parameter Username
C:\Users\haipings\AppData\Local\miniconda3\envs\pypsa-earth-new\lib\site-packages\pulp\apis\gurobi_api.py:170: UserWarning: GUROBI error: Version number is 11.0, license is for version 10.0.
warnings.warn("GUROBI error: {}.".format(e))
.....
.....
Error in rule solve_network:
jobid: 1
input: networks/elec_s_20_ec_lcopt_Co2L-1H.nc
output: results/networks/elec_s_20_ec_lcopt_Co2L-1H.nc
log: logs\solve_network\elec_s_20_ec_lcopt_Co2L-1H_solver.log, logs/solve_network/elec_s_20_ec_lcopt_Co2L-1H_python.log (check log file(s) for error details)

ERROR:snakemake.logging:Error in rule solve_network:
jobid: 1
input: networks/elec_s_20_ec_lcopt_Co2L-1H.nc
output: results/networks/elec_s_20_ec_lcopt_Co2L-1H.nc
log: logs\solve_network\elec_s_20_ec_lcopt_Co2L-1H_solver.log, logs/solve_network/elec_s_20_ec_lcopt_Co2L-1H_python.log (check log file(s) for error details)

RuleException:
CalledProcessError in file C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth\Snakefile, line 836:
Command 'C:/Users/haipings/AppData/Local/miniconda3/envs/pypsa-earth-new/python.exe "C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth.snakemake\shadow\tmperhezfd7.snakemake\scripts\tmpeo14x7jj.solve_network.py"' returned non-zero exit status 1.
File "C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth\Snakefile", line 836, in __rule_solve_network
File "C:\Users\haipings\AppData\Local\miniconda3\envs\pypsa-earth-new\lib\concurrent\futures\thread.py", line 58, in run
ERROR:snakemake.logging:RuleException:
CalledProcessError in file C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth\Snakefile, line 836:
Command 'C:/Users/haipings/AppData/Local/miniconda3/envs/pypsa-earth-new/python.exe "C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth.snakemake\shadow\tmperhezfd7.snakemake\scripts\tmpeo14x7jj.solve_network.py"' returned non-zero exit status 1.
File "C:\Users\haipings\pypsa\pypsa-earth_KE_2024\pypsa-earth\Snakefile", line 836, in __rule_solve_network
File "C:\Users\haipings\AppData\Local\miniconda3\envs\pypsa-earth-new\lib\concurrent\futures\thread.py", line 58, in run
Shutting down, this might take some time.
WARNING:snakemake.logging:Shutting down, this might take some time.
Exiting because a job execution failed. Look above for error message
ERROR:snakemake.logging:Exiting because a job execution failed. Look above for error message
Complete log: .snakemake\log\2024-03-25T194538.000221.snakemake.log
WARNING:snakemake.logging:Complete log: .snakemake\log\2024-03-25T194538.000221.snakemake.log

[davide-f]

Obviously no need for that.
You can simply change gurobi to meet your version:

conda install -c gurobi gurobi=10 (example for version 10)

[Haiping007]

Ha.....thank you! Davide!
Now it runs completed and successfully!

[Haiping007]

@davide-f
Hi, I got the results based on the future climate data. I found biomass taking a large share in the optimization.
However, I didn't see the biomass in the result based on the historical climate data before (I ran the model last December). Then I rerun the model based on the historical climate data again. Now biomass also takes a significant share in the results based on the historical climate data. I am wondering if the recent improvements you did affect the biomass?

[Haiping007]

@davide-f
Hi David, where does the energy demand under the path ssp2-2.6 come from in Pypsa-earth?

[davide-f]

the demand under ssp2-2.6 is obtained using GlobalEnergyGIS tool https://github.com/niclasmattsson/GlobalEnergyGIS

[davide-f]

Thank you! @davide-f Dropping "biomass" among the conventional sources in the config, will drop biomass completely from the system, right? If I need biomass in the system, can I set the limitation of the 'p_nom_max' of biomass in the config file? And if I want to limit the fossil fuel carriers to 0 capacity in the system, can I do it in the config file? or do I have to code outside of the config file?

Yes, it will drop completely in that case.
If you wish to limit them to 0, it may be better to remove them; the two effects are equivalent.

[davide-f]

On the other hand, making geothermal and biomass expandable is delicate because the model does not include their potentials, so results needs a serious crosscheck.

A large biomass capacity is likely tk be the result of having enabled their capacity expansion indeed.

[Haiping007]

I see. I will double-check. Thank you!