Tutorial: Sector-Coupled#

Note

If you have not done it yet, follow the Installation steps first.

Also, checkout the tutorial for electricity-only systems first at Tutorial: Electricity-Only.

In this tutorial, we will add further sectors to the electricity-only model from Tutorial: Electricity-Only, namely industry, transport, and buildings. This requires processing of a few more raw data sources.

The sector-coupling code can be run as an overnight / greenfield scenario or with multi-horizon investment with myopic foresight. Pathway analysis with perfect foresight is under development. See also the documentation on Foresight Options.

Overnight Scenarios#

Configuration#

The default configuration file (config/config.default.yaml) is set up for running overnight scenarios. Running a sector-coupled model unlocks many further configuration options. In the example below, we say that the gas network should be added and spatially resolved. We also say that the existing gas network may be retrofitted to transport hydrogen instead.

    resolution_sector: 24h

sector:
  gas_network: true
  H2_retrofit: true

industry:
  HVC_environment_sequestration_fraction: 0.5
  waste_to_energy: true
  waste_to_energy_cc: true

Documentation for all options will be added successively to Configuration.

Scenarios can be defined like for electricity-only studies, but with additional wildcard options.

scenario:
  ll:
  - v1.5
  clusters:
  - 5
  sector_opts:
  - ''
  planning_horizons:
  - 2030

For allowed wildcard values, refer to Wildcards.

Execution#

To run an overnight / greenfiled scenario with the specifications above, run

snakemake -call all --configfile config/test/config.overnight.yaml

which will result in the following jobs snakemake wants to run, some of which were already included in the electricity-only tutorial:

job                                                 count
------------------------------------------------  -------
add_electricity                                         1
add_extra_components                                    1
all                                                     1
base_network                                            1
build_ammonia_production                                1
build_biomass_potentials                                1
build_central_heating_temperature_profiles              1
build_clustered_population_layouts                      1
build_cop_profiles                                      1
build_daily_heat_demand                                 1
build_district_heat_share                               1
build_electricity_demand                                1
build_energy_totals                                     1
build_gas_input_locations                               1
build_gas_network                                       1
build_heat_totals                                       1
build_hourly_heat_demand                                1
build_industrial_distribution_key                       1
build_industrial_energy_demand_per_country_today        1
build_industrial_energy_demand_per_node                 1
build_industrial_energy_demand_per_node_today           1
build_industrial_production_per_country                 1
build_industrial_production_per_country_tomorrow        1
build_industrial_production_per_node                    1
build_industry_sector_ratios                            1
build_industry_sector_ratios_intermediate               1
build_population_layouts                                1
build_population_weighted_energy_totals                 2
build_powerplants                                       1
build_renewable_profiles                                6
build_salt_cavern_potentials                            1
build_shapes                                            1
build_ship_raster                                       1
build_shipping_demand                                   1
build_simplified_population_layouts                     1
build_solar_thermal_profiles                            1
build_temperature_profiles                              1
build_transmission_projects                             1
build_transport_demand                                  1
cluster_gas_network                                     1
cluster_network                                         1
make_summary                                            1
plot_gas_network                                        1
plot_hydrogen_network                                   1
plot_power_network                                      1
plot_power_network_clustered                            1
plot_summary                                            1
prepare_network                                         1
prepare_sector_network                                  1
retrieve_cost_data                                      1
retrieve_cutout                                         1
retrieve_databundle                                     1
retrieve_eez                                            1
retrieve_electricity_demand                             1
retrieve_eurostat_data                                  1
retrieve_eurostat_household_data                        1
retrieve_gas_infrastructure_data                        1
retrieve_gem_europe_gas_tracker                         1
retrieve_gem_steel_plant_tracker                        1
retrieve_jrc_idees                                      1
retrieve_naturalearth_countries                         1
retrieve_osm_prebuilt                                   1
retrieve_ship_raster                                    1
retrieve_synthetic_electricity_demand                   1
retrieve_worldbank_urban_population                     1
simplify_network                                        1
solve_sector_network                                    1
time_aggregation                                        1
total                                                  74

This covers the retrieval of additional raw data from online resources and preprocessing data about the transport, industry, and heating sectors as well as additional rules about geological storage and sequestration potentials, gas infrastructure, and biomass potentials. The collection rule all will also generate summary CSV files and plots after the network has been solved successfully.

digraph snakemake_dag {
graph[bgcolor=white, margin=0];
node[shape=box, style=rounded, fontname=sans, fontsize=10, penwidth=2];
edge[penwidth=2, color=grey];
0[label = "all", color = "0.22 0.6 0.85", style="rounded"];
1[label = "plot_summary", color = "0.11 0.6 0.85", style="rounded"];
2[label = "make_summary", color = "0.30 0.6 0.85", style="rounded"];
3[label = "solve_sector_network", color = "0.42 0.6 0.85", style="rounded"];
4[label = "prepare_sector_network\nsector_opts: ", color = "0.45 0.6 0.85", style="rounded"];
5[label = "build_renewable_profiles\ntechnology: offwind-ac", color = "0.44 0.6 0.85", style="rounded"];
6[label = "base_network", color = "0.26 0.6 0.85", style="rounded"];
7[label = "retrieve_osm_prebuilt", color = "0.01 0.6 0.85", style="rounded"];
8[label = "build_shapes", color = "0.50 0.6 0.85", style="rounded"];
9[label = "retrieve_naturalearth_countries", color = "0.09 0.6 0.85", style="rounded"];
10[label = "retrieve_eez", color = "0.52 0.6 0.85", style="rounded"];
11[label = "retrieve_databundle", color = "0.00 0.6 0.85", style="rounded"];
12[label = "build_ship_raster", color = "0.29 0.6 0.85", style="rounded"];
13[label = "retrieve_ship_raster", color = "0.13 0.6 0.85", style="rounded"];
14[label = "retrieve_cutout\ncutout: be-03-2013-era5", color = "0.06 0.6 0.85", style="rounded"];
15[label = "build_renewable_profiles\ntechnology: offwind-dc", color = "0.44 0.6 0.85", style="rounded"];
16[label = "build_renewable_profiles\ntechnology: offwind-float", color = "0.44 0.6 0.85", style="rounded"];
17[label = "cluster_gas_network", color = "0.48 0.6 0.85", style="rounded"];
18[label = "build_gas_network", color = "0.59 0.6 0.85", style="rounded"];
19[label = "retrieve_gas_infrastructure_data", color = "0.14 0.6 0.85", style="rounded"];
20[label = "cluster_network\nclusters: 5", color = "0.08 0.6 0.85", style="rounded"];
21[label = "simplify_network\nsimpl: ", color = "0.25 0.6 0.85", style="rounded"];
22[label = "add_electricity", color = "0.46 0.6 0.85", style="rounded"];
23[label = "build_renewable_profiles\ntechnology: solar", color = "0.44 0.6 0.85", style="rounded"];
24[label = "build_renewable_profiles\ntechnology: solar-hsat", color = "0.44 0.6 0.85", style="rounded"];
25[label = "build_renewable_profiles\ntechnology: onwind", color = "0.44 0.6 0.85", style="rounded"];
26[label = "build_transmission_projects", color = "0.63 0.6 0.85", style="rounded"];
27[label = "retrieve_cost_data\nyear: 2030", color = "0.05 0.6 0.85", style="rounded"];
28[label = "build_powerplants", color = "0.43 0.6 0.85", style="rounded"];
29[label = "build_electricity_demand", color = "0.39 0.6 0.85", style="rounded"];
30[label = "retrieve_electricity_demand", color = "0.62 0.6 0.85", style="rounded"];
31[label = "retrieve_synthetic_electricity_demand", color = "0.31 0.6 0.85", style="rounded"];
32[label = "build_gas_input_locations", color = "0.45 0.6 0.85", style="rounded"];
33[label = "retrieve_gem_europe_gas_tracker", color = "0.33 0.6 0.85", style="rounded"];
34[label = "time_aggregation", color = "0.60 0.6 0.85", style="rounded"];
35[label = "prepare_network\nll: v1.5\nopts: ", color = "0.23 0.6 0.85", style="rounded"];
36[label = "add_extra_components", color = "0.36 0.6 0.85", style="rounded"];
37[label = "build_hourly_heat_demand", color = "0.15 0.6 0.85", style="rounded"];
38[label = "build_daily_heat_demand", color = "0.57 0.6 0.85", style="rounded"];
39[label = "build_population_layouts", color = "0.47 0.6 0.85", style="rounded"];
40[label = "retrieve_worldbank_urban_population", color = "0.19 0.6 0.85", style="rounded"];
41[label = "build_solar_thermal_profiles", color = "0.11 0.6 0.85", style="rounded"];
42[label = "retrieve_eurostat_data", color = "0.04 0.6 0.85", style="rounded"];
43[label = "build_population_weighted_energy_totals\nkind: energy", color = "0.04 0.6 0.85", style="rounded"];
44[label = "build_energy_totals", color = "0.30 0.6 0.85", style="rounded"];
45[label = "retrieve_jrc_idees", color = "0.02 0.6 0.85", style="rounded"];
46[label = "retrieve_eurostat_household_data", color = "0.49 0.6 0.85", style="rounded"];
47[label = "build_clustered_population_layouts", color = "0.19 0.6 0.85", style="rounded"];
48[label = "build_population_weighted_energy_totals\nkind: heat", color = "0.04 0.6 0.85", style="rounded"];
49[label = "build_heat_totals", color = "0.08 0.6 0.85", style="rounded"];
50[label = "build_shipping_demand", color = "0.52 0.6 0.85", style="rounded"];
51[label = "build_transport_demand", color = "0.16 0.6 0.85", style="rounded"];
52[label = "build_temperature_profiles", color = "0.58 0.6 0.85", style="rounded"];
53[label = "build_biomass_potentials\nplanning_horizons: 2030", color = "0.55 0.6 0.85", style="rounded"];
54[label = "build_salt_cavern_potentials", color = "0.28 0.6 0.85", style="rounded"];
55[label = "build_simplified_population_layouts", color = "0.14 0.6 0.85", style="rounded"];
56[label = "build_industrial_energy_demand_per_node", color = "0.24 0.6 0.85", style="rounded"];
57[label = "build_industry_sector_ratios_intermediate\nplanning_horizons: 2030", color = "0.60 0.6 0.85", style="rounded"];
58[label = "build_industry_sector_ratios", color = "0.26 0.6 0.85", style="rounded"];
59[label = "build_ammonia_production", color = "0.16 0.6 0.85", style="rounded"];
60[label = "build_industrial_energy_demand_per_country_today", color = "0.18 0.6 0.85", style="rounded"];
61[label = "build_industrial_production_per_country", color = "0.61 0.6 0.85", style="rounded"];
62[label = "build_industrial_production_per_node", color = "0.65 0.6 0.85", style="rounded"];
63[label = "build_industrial_distribution_key", color = "0.31 0.6 0.85", style="rounded"];
64[label = "retrieve_gem_steel_plant_tracker", color = "0.27 0.6 0.85", style="rounded"];
65[label = "build_industrial_production_per_country_tomorrow\nplanning_horizons: 2030", color = "0.09 0.6 0.85", style="rounded"];
66[label = "build_industrial_energy_demand_per_node_today", color = "0.40 0.6 0.85", style="rounded"];
67[label = "build_district_heat_share\nplanning_horizons: 2030", color = "0.07 0.6 0.85", style="rounded"];
68[label = "build_cop_profiles", color = "0.38 0.6 0.85", style="rounded"];
69[label = "build_central_heating_temperature_profiles", color = "0.55 0.6 0.85", style="rounded"];
70[label = "plot_power_network_clustered", color = "0.20 0.6 0.85", style="rounded"];
71[label = "plot_power_network", color = "0.53 0.6 0.85", style="rounded"];
72[label = "plot_hydrogen_network", color = "0.64 0.6 0.85", style="rounded"];
73[label = "plot_gas_network", color = "0.28 0.6 0.85", style="rounded"];
1 -> 0
2 -> 1
42 -> 1
11 -> 1
3 -> 2
27 -> 2
70 -> 2
71 -> 2
72 -> 2
73 -> 2
4 -> 3
5 -> 4
15 -> 4
16 -> 4
17 -> 4
32 -> 4
34 -> 4
35 -> 4
42 -> 4
43 -> 4
48 -> 4
50 -> 4
51 -> 4
44 -> 4
11 -> 4
53 -> 4
27 -> 4
54 -> 4
21 -> 4
20 -> 4
47 -> 4
55 -> 4
56 -> 4
37 -> 4
67 -> 4
52 -> 4
68 -> 4
41 -> 4
6 -> 5
11 -> 5
12 -> 5
8 -> 5
14 -> 5
7 -> 6
8 -> 6
9 -> 8
10 -> 8
11 -> 8
13 -> 12
14 -> 12
6 -> 15
11 -> 15
12 -> 15
8 -> 15
14 -> 15
6 -> 16
11 -> 16
12 -> 16
8 -> 16
14 -> 16
18 -> 17
20 -> 17
19 -> 18
21 -> 20
27 -> 20
22 -> 21
27 -> 21
6 -> 21
23 -> 22
24 -> 22
25 -> 22
5 -> 22
15 -> 22
16 -> 22
6 -> 22
26 -> 22
27 -> 22
28 -> 22
29 -> 22
8 -> 22
6 -> 23
11 -> 23
8 -> 23
14 -> 23
6 -> 24
11 -> 24
8 -> 24
14 -> 24
6 -> 25
11 -> 25
8 -> 25
14 -> 25
6 -> 26
8 -> 26
6 -> 28
30 -> 29
31 -> 29
33 -> 32
19 -> 32
20 -> 32
35 -> 34
37 -> 34
41 -> 34
36 -> 35
27 -> 35
20 -> 36
27 -> 36
38 -> 37
39 -> 38
20 -> 38
14 -> 38
8 -> 39
40 -> 39
14 -> 39
39 -> 41
20 -> 41
14 -> 41
44 -> 43
47 -> 43
8 -> 44
11 -> 44
45 -> 44
42 -> 44
46 -> 44
39 -> 47
20 -> 47
14 -> 47
49 -> 48
47 -> 48
44 -> 49
8 -> 50
20 -> 50
44 -> 50
47 -> 51
43 -> 51
44 -> 51
11 -> 51
52 -> 51
39 -> 52
20 -> 52
14 -> 52
42 -> 53
11 -> 53
20 -> 53
8 -> 53
11 -> 54
20 -> 54
39 -> 55
21 -> 55
14 -> 55
57 -> 56
62 -> 56
66 -> 56
58 -> 57
60 -> 57
61 -> 57
59 -> 58
45 -> 58
44 -> 60
45 -> 60
61 -> 60
59 -> 61
45 -> 61
42 -> 61
63 -> 62
65 -> 62
20 -> 63
47 -> 63
64 -> 63
61 -> 65
63 -> 66
60 -> 66
44 -> 67
47 -> 67
69 -> 68
52 -> 68
20 -> 68
52 -> 69
20 -> 69
20 -> 70
3 -> 71
20 -> 71
3 -> 72
20 -> 72
3 -> 73
20 -> 73
}

Myopic Foresight Scenarios#

Configuration#

To activate the myopic foresight mode, set

foresight: myopic

Scenarios can be defined like for electricity-only studies, but with additional wildcard options. For the myopic foresight mode, the {planning_horizons} wildcard defines the sequence of investment horizons.

scenario:
  ll:
  - v1.5
  clusters:
  - 5
  sector_opts:
  - ''
  planning_horizons:
  - 2030
  - 2040
  - 2050

For allowed wildcard values, refer to Wildcards.

In the myopic foresight mode, you can tweak for instance exogenously given transition paths, like the one for the share of primary steel production we change below:

industry:
  St_primary_fraction:
    2030: 0.6
    2040: 0.5
    2050: 0.4

Documentation for all options will be added successively to Configuration.

Execution#

To run a myopic foresight scenario with the specifications above, run

snakemake -call all --configfile config/test/config.myopic.yaml

which will result in additional jobs snakemake wants to run, which translates to the following workflow diagram which nicely outlines how the sequential pathway optimisation with myopic foresight is implemented in the workflow:

Scaling-Up#

If you now feel confident and want to tackle runs with larger temporal, technological and spatial scope, clean-up the repository and after modifying the config/config.yaml file target the collection rule all again without providing the test configuration file.

snakemake -call purge
snakemake -call all

Note

It is good practice to perform a dry-run using the option -n, before you commit to a run:

snakemake -call all -n

Tutorial: Sector-Coupled

Contents

Tutorial: Sector-Coupled#

Overnight Scenarios#

Configuration#

Execution#

Myopic Foresight Scenarios#

Configuration#

Execution#

Scaling-Up#