Retrieving Data#
Not all data dependencies are shipped with the git repository,
since git is not suited for handling large changing files.
Instead we provide separate data bundles which can be obtained
using the retrieve* rules.
Rule retrieve_databundle#
The data bundle (1.4 GB) contains common GIS datasets like NUTS3 shapes, EEZ shapes, CORINE Landcover, Natura 2000 and also electricity specific summary statistics like historic per country yearly totals of hydro generation, GDP and POP on NUTS3 levels and per-country load time-series.
This rule downloads the data bundle from zenodo and extracts it in the data sub-directory, such that all files of the bundle are stored in the data/bundle subdirectory.
The Tutorial: Electricity-Only uses a smaller data bundle than required for the full model (188 MB)
Relevant Settings
tutorial:
See also
Documentation of the configuration file config/config.yaml at
Top-level configuration
Outputs
data/bundle: input data collected from various sources
Rule retrieve_cutout#
Cutouts are spatio-temporal subsets of the European weather data from the ECMWF ERA5 reanalysis dataset and the CMSAF SARAH-2 solar surface radiation dataset for the year 2013.
They have been prepared by and are for use with the atlite tool. You can either generate them yourself using the build_cutouts rule or retrieve them directly from zenodo through the rule retrieve_cutout.
The Tutorial: Electricity-Only uses a smaller cutout than required for the full model (30 MB), which is also automatically downloaded.
Note
To download cutouts yourself from the ECMWF ERA5 you need to set up the CDS API.
Relevant Settings
tutorial:
enable:
build_cutout:
See also
Documentation of the configuration file config/config.yaml at
Top-level configuration
Outputs
cutouts/{cutout}: weather data from either the ERA5 reanalysis weather dataset or SARAH-2 satellite-based historic weather data.
See also
For details see build_cutout and read the atlite documentation.
Rule retrieve_natura_raster#
This rule, as a substitute for build_natura_raster, downloads an already rasterized version (natura.tiff) of Natura 2000 natural protection areas to reduce computation times. The file is placed into the resources sub-directory.
Relevant Settings
enable:
build_natura_raster:
See also
Documentation of the configuration file config/config.yaml at
Top-level configuration
Outputs
resources/natura.tiff: Rasterized version of Natura 2000 natural protection areas to reduce computation times.
See also
For details see build_natura_raster.
Rule retrieve_electricity_demand#
This rule downloads hourly electric load data for each country from the OPSD platform.
Relevant Settings
None.
Outputs
data/electricity_demand_raw.csv
Rule retrieve_cost_data#
This rule downloads techno-economic assumptions from the technology-data repository.
Relevant Settings
enable:
retrieve_cost_data:
costs:
year:
version:
See also
Documentation of the configuration file config/config.yaml at
costs
Outputs
resources/costs.csv
Rule retrieve_irena#
This rule downloads the existing capacities from IRENASTAT and extracts it in the data/existing_capacities sub-directory.
Relevant Settings
enable:
retrieve_irena:
See also
Documentation of the configuration file config.yaml at
enable
Outputs
data/existing_capacities: existing capacities for offwind, onwind and solar
Rule retrieve_ship_raster#
This rule downloads data on global shipping traffic density from the World Bank Data Catalogue.
Relevant Settings
None.
Outputs
data/shipdensity_global.zip
Rule retrieve_sector_databundle#
In addition to the databundle required for electricity-only studies, another databundle is required for modelling sector-coupled systems. The size of this data bundle is around 640 MB.