Collect pieces for SSP 2024/ScenarioMIP workflows

[khaeru]

We want to, at some point, bring together all the improvements and new code used in the SSP/ScenarioMIP workflows. This issue is to:

1. Identify what and where those pieces are, how they are used (in what order), etc.
2. Decide where they should eventually ‘land’ within message-ix-models or other repos.
3. Track as they are associated with PRs, either:
   • If atomic and separable, directly into main, or
   • If they need extensive clean-up that is not yet scheduled, into a ssp-dev branch: Collect pieces for SSP 2024/ScenarioMIP #235.

Originally discussed at the 2024-09-24 MESSAGE team meeting.

Things to do

• Leave a comment below or edit the description to add further details.
  • Please try not to add so much that the overall list is not readable; rather add full description at the respective issue/PR, and put a ~1-sentence summary.
  • These can include future plans/intentions for next steps.
• Open a draft PR for any branch with associated code.
  • This PR may not ever be merged, but makes it much easier to understand and communicate about the changes on a branch.
• or, Add to #235.
• Open a PR with a subset of the commits from #235.
  • See Merge part of ssp-dev #340 for an example.
  • See this Slack thread for discussion.
• Ask @glatterf42 @khaeru if unsure about what to do.

Pieces

General/other

• Extend SSP argument options #233 by @OFR-IIASA (@macflo8 made a similar change).
• Merge part of ssp-dev #340.
• Lots of code in iiasa/message_single_country@SSP_Dev_2023
  • @OFR-IIASA has reworked some of this code to use message_ix_models.Context objects for settings handling, which should ease future integration with message-ix-models.
  • See Collect code from ssp_dev branches in private repos #275.
• Lots of code in iiasa/message_data@ssp_dev → see Collect code from ssp_dev branches in private repos #275
• iiasa/message_ix@ssp_dev
  • Includes (is based on) Adjust calculation of PRICE_EMISSION message_ix#726
  • Certain CPLEX settings
  • Work from @GamzeUnlu95 on MESSAGE-MACRO iteration.
    • TODO Confirm: is this Correct MACRO GDP reporting & update docs message_ix#430, or something else?

Direct air capture (DAC)

• Code in @ywpratama branch https://github.com/ywpratama/message_ix/tree/add_dac_disposal_split (this should eventually land in message-ix-models, rather than message_ix)

Materials

• Code on @macflo8's branch https://github.com/macflo8/message-ix-models/tree/ssp_dev-W35
• Improve aluminum model #345
• Fetch aluminum data from upstream sources #348
• Improve cement model #361
• Improve steel model #388

Techno-economic parameters (@measrainsey)

• Change technology inputs and replace solar + wind technologies in tools.costs #206
• Reconfigure usage of technology modules in tools.costs #221
• Change decay to reach cost reduction specified by 2100 (instead of 2110) tools.costs #227
• Add variant/module for cooling technologies in tools.costs #222
• Update water to use cost projections from tools.costs #243
• Merge costs-related changes from ssp-dev #378

Water/nexus (@adrivinca)

• Update hydrological aggregation in model.water #223
• Nexus cooling updates for R12/SSP scenarios #236
• Flexible setup of constraints for cooling technologies #242
• Wat ssp upd3: third update to cooling technology, with SSP differentiation #256
• Fix issue with materials and cooling CCS technologies becoming cheaper than non-CCS counterpart #258
• Change in SSP parameters and add missing csp data #262
• Updating cooling constraints for SSP runs #268

Contents of #235

Remaining commits

bf3045196	Florian Maczek	2024-11-05	Add new materials and industry reporting
cb339dac7	FRICKO Oliver	2024-11-07	Correct syntax for materials reporting to change units
4bab1fe0b	Florian Maczek	2024-11-07	Extend and rename variable mappings
977f89534	Florian Maczek	2024-08-27	Update docs
d15053658	Florian Maczek	2024-08-29	Revise materials documentation
69ff5ab56	Florian Maczek	2024-05-26	Update cement furnaces efficiency
83eae2ff9	Florian Maczek	2024-05-26	Update clinker CCS diffusion constraint
9a936deea	Florian Maczek	2024-05-27	Update cement and aluminum demand SSP5
36967bc7c	Florian Maczek	2024-05-27	Add SSP specific input steel/cement data
acb2bf641	Florian Maczek	2024-05-27	Add SSP changes to data_steel
b55f4a980	Florian Maczek	2024-05-28	Remove unused low temp cement furnaces
f757ef52d	Florian Maczek	2024-05-28	Update base year steel and cement demands
b218980e7	Florian Maczek	2024-05-28	Update data read functions to new SSP argument
960c06493	Florian Maczek	2024-06-03	Keep solar and biomass base year industry bounds
0356f1706	Florian Maczek	2024-06-03	Adjust base year cement demand of CHN region
e0ab860f5	Florian Maczek	2024-06-03	Fix low temp cement furnace ACT to 0
8f16b8681	Florian Maczek	2024-06-03	Update non-metallic minerals base year calibration
6eb486bcf	Florian Maczek	2024-06-03	Add cement furnace base year bounds
23950ecb2	Florian Maczek	2024-06-03	Silence pandas FutureWarnings in reporting
849ae1b25	Florian Maczek	2024-06-03	Improve materials reporting
3da46fe26	Florian Maczek	2024-06-05	Add non-CO2 emissions factors to industry furnaces
a6f1965e6	Florian Maczek	2024-06-05	Remove deprecated Materials gas heat pumps
f305a36dd	Florian Maczek	2024-06-05	Remove duplicated technology in set and format
cc7d6ee67	Florian Maczek	2024-06-05	Fix non-CO2 furnace build bugs
df4419e47	Florian Maczek	2024-06-06	Fix bug in refactored materials reporting function
f32098d58	Florian Maczek	2024-06-06	Add furnaces to existing GAINS link relation
ed8dc6143	Florian Maczek	2024-06-18	Fix missing years error caused by data_generic.py
fb298da48	Florian Maczek	2024-07-29	Exclude chemicals flow from i_spec calibration
1ce3db47b	Florian Maczek	2024-07-29	Reorganize materials commands 2
818cb148f	Florian Maczek	2024-07-30	Add updated cement calibration stats
e696a1e13	Florian Maczek	2024-08-01	Run TE-tool with "gdp" method by default
60df34fd9	Florian Maczek	2024-08-01	Add cost updates from costs/new_inputs branch
28fbea7be	Florian Maczek	2024-08-01	Clean up new custom SSP build helper
9166df918	Florian Maczek	2024-08-01	Add filter for relations in methanol build
cb4cd44d8	Florian Maczek	2024-08-01	Add technologies to remove section to set.yaml
9dd8388cc	Florian Maczek	2024-08-01	Add extra MACRO calibration CLI command
47696977c	Florian Maczek	2024-08-01	Add updated aluminum demands
922faed08	Florian Maczek	2024-08-01	Revert to SSP2 for all SSPs for steel/cement
af5d969e3	Florian Maczek	2024-08-06	Add industry non-CO2 emission data file
dd8840cee	Florian Maczek	2024-08-14	Add share constraint generator
9c76a79ee	Florian Maczek	2024-08-14	Move "other industry" utilities to module
97dce5736	Florian Maczek	2024-08-16	Extend docstrings and type hints
30128aad9	Florian Maczek	2024-08-16	Split calibration function
bd6335157	Florian Maczek	2024-08-16	Move CCS parametrization to input files
9b28fbfb6	Florian Maczek	2024-08-16	Move set modification to set.yaml
6f7f8eb7e	Florian Maczek	2024-08-19	Add filename to iea_data_path cli option
96680ea80	Florian Maczek	2024-08-19	Add new residual industry calibration
ec28a4452	Florian Maczek	2024-08-19	Generalize coal_i share constraint helper
ec7a1d341	Florian Maczek	2024-08-19	Remove deprecated CCS function from build
bda48e811	Florian Maczek	2024-08-21	Fix new "other industry" calibration workflow
0eb5295da	Florian Maczek	2024-09-02	Update data_generic to sdmx Code set
df90fd040	Florian Maczek	2024-09-02	Extend type hints and docstrings to data_util
55cad979e	Florian Maczek	2024-09-02	Add water sets missing in SSP_dev
837123ce9	Florian Maczek	2024-09-02	Add MTO_petro 0 bound_activity_up for 2025
767ecdd9c	Florian Maczek	2024-09-02	Move co2_trans_disp parametrization to file
915038196	Florian Maczek	2024-09-02	Reorganize parametrization scripts
1409055e6	Florian Maczek	2024-09-02	Add new demand and activity data to other industry
1e79c1253	Florian Maczek	2024-09-02	Add low temp heat share constraint modifier
ab6fdb530	Florian Maczek	2024-09-02	Integrate parametrization updates in build
af209ebd9	Florian Maczek	2024-09-02	Add 0 bounds for low temp furnace modes
dbddef2a3	Florian Maczek	2024-09-03	Fix fix_cost timeseries break for i_therm tecs
62ddcc8e1	Florian Maczek	2024-09-03	Update SSP MACRO calibration workflow
6b309740d	Florian Maczek	2024-09-03	Extend SSP 2020 activity calibration procedure
ae1787bfb	Florian Maczek	2024-09-05	Remove unused option from material build command
f636d3760	Florian Maczek	2024-09-05	Rename share constraint generator function
8aacd7ab7	Florian Maczek	2024-09-05	Remove unused context from materials reporting
194c70778	Florian Maczek	2024-10-05	Fix in/output unit of furnaces input file
4486e133d	Florian Maczek	2024-10-13	Add new plastics CO2_Emission calculator
ea5aa2075	Florian Maczek	2024-10-15	Extend methanol fs downstream supply chain
25b10a60c	Florian Maczek	2024-10-17	Add missing SSP industry input files
5a0d6d2a3	Florian Maczek	2024-10-22	Fix material balance of MTO_petro technology
f54e01472	Florian Maczek	2024-10-23	Add new CO2_ind calculator for chemicals
43918799d	Florian Maczek	2024-10-27	Add embodied emissions for ethanol to ethylene
8f236af06	Florian Maczek	2024-10-28	Remove "World" meth_ind_fs parameter regions
e21e04743	Florian Maczek	2024-10-28	Fix biomass_nh3_ccs CO2_Emission coefficient
dc30a60c4	Florian Maczek	2024-10-28	Add ethanol_to_ethylene CO2_ind emi factor
06b26aad0	Florian Maczek	2024-11-01	Replace get_nodes with tested utility
fc3c6e735	Florian Maczek	2024-11-05	Add CO2_cc coefficient for cokeoven
213adc831	Florian Maczek	2024-11-11	Fix merge duplication
0c80238c2	Florian Maczek	2024-11-11	Migrate ssp cost updates
c082cdcec	Florian Maczek	2024-11-13	Delete unused tab in cement input xlsx
2e6f1c4d4	GamzeUnlu95	2024-11-13	Update High scenario cost reductions
ec5c6720d	PRATAMA Yoga	2024-11-06	Add DAC to cost projection tool
44692d3c1	PRATAMA Yoga	2024-11-06	Add add_dac tool and related data
ae9e2f626	PRATAMA Yoga	2024-11-06	Add draft of CCS and DAC implementation script
59f406924	PRATAMA Yoga	2024-11-07	Update DAC parameters
7b4c04f67	PRATAMA Yoga	2024-11-07	Fix bug and improve year_act parameter cut
f35065eb8	PRATAMA Yoga	2024-11-11	Add low overshoot scenarios script
3e8b6febf	PRATAMA Yoga	2024-11-15	Add CO2_cc for leakages
b66019209	PRATAMA Yoga	2024-11-15	Add add_ccs_setup function
d814373c5	PRATAMA Yoga	2024-11-18	Update data reading in add_tech function
ae31a43c9	Florian Maczek	2024-11-19	Add macro calibration files for all SSPs
84c528f76	Florian Maczek	2024-11-21	Fix methanol final energy allocation bug
35104992d	FRICKO Oliver	2024-12-02	Add macro calibration files for SSPs
1ef889fe0	FRICKO Oliver	2024-12-02	Change default region config in model/config from R14 to R12
bae9dada0	FRICKO Oliver	2024-12-02	Change data_methanol syntax for reading file
a035d92b6	FRICKO Oliver	2024-12-02	Add scenario transact statement to DAC setup workflow
fc1592723	GamzeUnlu95	2024-11-27	Add diffusion constraint changes
c674f95a6	GamzeUnlu95	2024-12-02	Differentitate growth_new_capacity_up for SSPs
0585c6906	GamzeUnlu95	2024-12-02	Differentiate the scalar used for initial_capacity_new for SSPs
c5b402191	GamzeUnlu95	2024-12-04	Update steel diffusion constraints for steel in baselines
6ff689605	GamzeUnlu95	2024-12-04	Add custom cost differentiation for materials
d88dd8d69	GamzeUnlu95	2024-12-05	Add steel recycling changes
0405ec08e	Florian Maczek	2024-11-25	Fix 2025 material demands for all SSPs
0659245d6	Florian Maczek	2024-11-25	Add updated aluminum capacity calibration
d3604bef9	Florian Maczek	2024-11-25	Add updated aluminum activity calibration
a7098e643	Florian Maczek	2024-11-27	Remove aluminum timeseries growth constraints
b7214c15a	Florian Maczek	2024-11-28	Update aluminum sector furnace efficiencies
e9bbe41f9	Florian Maczek	2024-12-02	Add typing to ssp functions to resolve warning
0bf00481e	Florian Maczek	2024-12-02	Remove unneeded rows from parametrization dfs
3c72ea05d	Florian Maczek	2024-12-02	Remove power sector module from build
ef456c0d3	Florian Maczek	2024-12-02	Add aluminum updates
9d845e0bc	Florian Maczek	2024-12-02	Set fuel constraints for aluminum refining
622c09e25	Florian Maczek	2024-12-02	Limit soderberg aluminum new capacity
d55bcee74	Florian Maczek	2024-12-04	Add regionally differentiated alumina heat inputs
b983119cb	Florian Maczek	2024-12-05	Fix 2025 industry energy demands for all SSPs
28b0e2bac	Florian Maczek	2024-12-06	Remove whitespaces in materials cost csv
06dd80844	GamzeUnlu95	2024-12-06	Differentiate aluminum recycling
32a0c3e27	PRATAMA Yoga	2024-12-06	Remove operation reserve for DAC
811186f22	PRATAMA Yoga	2024-12-06	Update CO2 injection rates using literature values
78df0c4c2	PRATAMA Yoga	2024-12-06	Remove CO2 outputs at useful level
7884f0547	Florian Maczek	2024-12-06	Update clinker CCS heat demand
96c1df7d6	Florian Maczek	2024-12-09	Add exception for LED methanol reporting
2e522d47d	Florian Maczek	2024-12-12	Exclude pre-firstmodelyear years from material rep
6a3aefea8	Measrainsey Meng	2024-12-17	Add dac module to function type hints
9c95e774f	Measrainsey Meng	2024-12-17	Move `dac` cost reduction assumptions to module folder
ae345c88f	Measrainsey Meng	2025-01-27	Add reduction_year as parameter in Config
f2166f508	Measrainsey Meng	2025-01-27	Switch from hardcoding reduction year to using Config.reduction_year
bbcd65f14	Measrainsey Meng	2025-01-27	Add attributes for Config.final_projection_year and Config.final_model_year
905495bf8	Measrainsey Meng	2025-01-27	Update projections code to use new year parameters
0f821231f	Measrainsey Meng	2025-01-27	Update docstrings and comments
aa9291f62	Measrainsey Meng	2025-01-27	Edit missing column name
f6329be4c	Measrainsey Meng	2025-01-27	Edit config comments
f17574e0b	Measrainsey Meng	2025-01-27	Add functions to modify pre-base year costs values
1074a31a5	Measrainsey Meng	2025-01-27	Add example of how to use update_scenario_costs()
00f87b674	Florian Maczek	2024-12-20	Start changelog for SSP development
f4ee1e028	Florian Maczek	2025-01-07	Refine formatting of SSP changelog
d42f83898	Florian Maczek	2025-01-07	Fix missing MEA alumina refining input
fdd5728bd	Florian Maczek	2025-01-19	Fix materials reporting bugs
2527ecaea	Florian Maczek	2025-01-24	Add cost to alumina trade
115146128	Florian Maczek	2025-01-25	Delete deprecated input data
f64fee01a	Florian Maczek	2025-01-26	Refactor aluminum input data
76bae7fd6	Florian Maczek	2025-01-26	Refactor cement input data
d487547ec	Florian Maczek	2025-01-27	Refactor steel input data
271550929	FRICKO Oliver	2024-12-06	TEMPORARY fix cooling function to enable integration with SSP workflow
ad956b47e	FRICKO Oliver	2025-01-29	Add argument for cost-tool function call horizon
10b313a1a	Florian Maczek	2025-01-29	Fix input level for furnace_biomass_refining tec
fcb4fa771	Florian Maczek	2025-01-29	Fix 2025 methanol demand
5b54fc5c6	FRICKO Oliver	2025-01-30	Add correction for accounting of CF4 emissions from industry
b4203deb7	Florian Maczek	2025-01-30	Fix materials timeseries read-in
a08f88662	Florian Maczek	2025-01-30	Remove 2020 entries from steel relation
fbbfb201f	Measrainsey Meng	2025-01-27	Remove `final_year` attribute from Config
15098074d	Paul Natsuo Kishimoto	2025-02-06	Remove use of .costs.Config.final_year in 3 places
b1cb135c0	Paul Natsuo Kishimoto	2025-02-06	Satisfy ruff, mypy in 3 files
5aee685db	PRATAMA Yoga	2025-02-13	Adjust dac_htg co2_cc and co2 utilisation setup
da855202b	PRATAMA Yoga	2025-02-14	Fix bugs on meth_h2 co2 input
1e54bc0bb	Florian Maczek	2025-02-17	Fix Other Sector string manipulation bug
5a28ea14c	Florian Maczek	2025-02-17	Fix aggregation of Final Energy Methanol
7674e20cc	Florian Maczek	2025-02-17	Fix typo in chemicals biomass aggregation
0fe72b22f	Florian Maczek	2025-02-17	Set Liquids|Other to 0 after re-allocation
959df684f	Florian Maczek	2025-02-17	Fix Industry Electricity components
8bc400e54	Florian Maczek	2025-02-17	Update reporting to new meth_h2 modes
78ecf809b	Fridolin Glatter	2025-02-19	Fix type hints using `or`
5710c631d	Florian Maczek	2025-02-19	Implement meth_h2 update in DAC-CCS workflow
a89a91a73	FRICKO Oliver	2025-02-19	Remove transact within transact statement
858622300	Florian Maczek	2025-02-19	Adjust Materials reporter computation
c62aec320	Florian Maczek	2025-03-04	Fix industry reporting issues
aba96a007	Florian Maczek	2025-03-04	Add missing electricity in ammonia aggregate
ce31e5367	Florian Maczek	2025-03-04	Fix double counting of high-value chemicals
430300d48	FRICKO Oliver	2025-02-20	Add renewable hist_2025 technologies
02bb5340d	FRICKO Oliver	2025-02-20	Add (but disabled) temporary fix for handling incosistent entries from costing tool
b5f5f0bb8	Florian Maczek	2025-03-24	Fix incorrect biomass_NH3_ccs CO2 capture value
d53ba59ba	FRICKO Oliver	2025-03-12	Remove temporary code snippet for adjusting fix_ and inv_cost
446c40567	FRICKO Oliver	2025-03-12	Revise cost reductions for energy related technologies
9742422cd	FRICKO Oliver	2025-03-24	Fix update_macro_calib routine when extrapolating values to assign correct regions
d93836ec2	Florian Maczek	2025-03-18	Change refinery hydrogen level
82106ebf3	Florian Maczek	2025-03-24	Fix ammonia CCS activity in 2020/2025
a48f7e66d	Florian Maczek	2025-03-19	Update cement furnaces 2020 calibration
bc8e66e1b	Florian Maczek	2025-03-19	Update cement 2020 demand
b3e95eb89	Florian Maczek	2025-03-20	Differentiate clinker ratios
70a014385	Florian Maczek	2025-03-26	Comment out DAC_mpen growth constraint
3a70302ad	Florian Maczek	2025-04-22	Add missing years for cement grinder input
0e879f965	PRATAMA Yoga	2025-04-23	adjust ssp-specific growth_new_capacity_up  for DACs
4af06fdf7	FRICKO Oliver	2025-04-25	Add Rooftop solar technologies to input data for costs
bb95646f9	Florian Maczek	2025-04-28	Add new rooftop solar technology to reporting
d7431b2ad	FRICKO Oliver	2025-04-30	Update Final Energy|Industry|Other Sector
119cd77f6	FRICKO Oliver	2025-04-30	Add rooftop solar to Industry|Electricity|Solar
77078bf90	Florian Maczek	2025-04-30	Add missing component in ammonia aggregate
08461e367	Florian Maczek	2025-04-30	Fix relation_activity coefficients

Files changed

Generated with git diff --name-only main..ssp-dev and some manual editing:

message_ix_materials
├── data (@ywpratama)
│   ├── ccs-dac
│   │   ├── co2infrastructure_data_leddev.yaml
│   │   ├── co2infrastructure_data_ssp1dev.yaml
│   │   ├── co2infrastructure_data_ssp2dev.yaml
│   │   ├── co2infrastructure_data_ssp3dev.yaml
│   │   ├── co2infrastructure_data_ssp4dev.yaml
│   │   ├── co2infrastructure_data_ssp5dev.yaml
│   │   ├── daccs_setup_data_leddev.yaml
│   │   ├── daccs_setup_data_ssp1dev.yaml
│   │   ├── daccs_setup_data_ssp2dev.yaml
│   │   ├── daccs_setup_data_ssp3dev.yaml
│   │   ├── daccs_setup_data_ssp4dev.yaml
│   │   └── daccs_setup_data_ssp5dev.yaml
│   ├── costs
│   │   ├── dac (@ywpratama)
│   │   │   ├── cost_reduction.csv
│   │   │   ├── scenarios_reduction.csv
│   │   │   └── tech_map.csv
│   │   ├── energy (???)
│   │   │   ├── cost_reduction.csv
│   │   │   ├── scenarios_reduction.csv
│   │   │   └── tech_map.csv
│   │   └── materials (@macflo8)
│   │       ├── cost_reduction.csv
│   │       ├── scenarios_reduction.csv
│   │       └── tech_map.csv
│   ├── material (@macflo8)
│   │   ├── aluminum
│   │   │   ├── alu_ref_int_1985_2023.csv
│   │   │   ├── aluminum_techno_economic.xlsx
│   │   │   ├── archived/aluminum_techno_economic.xlsx
│   │   │   ├── data_R12.csv
│   │   │   ├── demand_2025.csv
│   │   │   ├── demand_aluminum.xlsx
│   │   │   ├── demand_aluminum.yaml
│   │   │   ├── raw
│   │   │   │   ├── MetallurgicalAluminaRefiningFuelConsumption_1985-2023_File_8CountryOrRegion.csv
│   │   │   │   ├── bgs_production
│   │   │   │   │   ├── alumina/2015-22.xlsx
│   │   │   │   │   └── aluminum
│   │   │   │   │       ├── 1970-78.xlsx
│   │   │   │   │       ├── 1979-89.xlsx
│   │   │   │   │       ├── 1990-2000.xlsx
│   │   │   │   │       ├── 2001-11.xlsx
│   │   │   │   │       └── 2010-22.xlsx
│   │   │   │   └── smelters-with 2022 projection.xls
│   │   │   ├── relations_R12.csv
│   │   │   └── timeseries_R12.csv
│   │   ├── ammonia
│   │   │   ├── demand_2025.csv
│   │   │   └── fert_techno_economic.xlsx
│   │   ├── cement
│   │   │   ├── Global_cement_MESSAGE.xlsx
│   │   │   ├── cement_R12.csv
│   │   │   ├── cement_bound_2020.csv
│   │   │   ├── demand_2025.csv
│   │   │   ├── demand_cement.yaml
│   │   │   └── timeseries_R12.csv
│   │   ├── macro
│   │   │   ├── macro_calibration_input_LED.xlsx
│   │   │   ├── macro_calibration_input_SSP1.xlsx
│   │   │   ├── macro_calibration_input_SSP2.xlsx
│   │   │   ├── macro_calibration_input_SSP3.xlsx
│   │   │   ├── macro_calibration_input_SSP4.xlsx
│   │   │   └── macro_calibration_input_SSP5.xlsx
│   │   ├── methanol
│   │   │   ├── demand_2025.csv
│   │   │   └── methanol_techno_economic.xlsx
│   │   ├── other
│   │   │   ├── activity
│   │   │   │   ├── i_spec_tecs_hist_act.csv
│   │   │   │   └── i_therm_tecs_hist_act.csv
│   │   │   ├── coal_i_shares_2020.csv
│   │   │   ├── demand
│   │   │   │   ├── i_spec_LED.csv
│   │   │   │   ├── i_spec_SSP1.csv
│   │   │   │   ├── i_spec_SSP2.csv
│   │   │   │   ├── i_spec_SSP3.csv
│   │   │   │   ├── i_spec_SSP4.csv
│   │   │   │   ├── i_spec_SSP5.csv
│   │   │   │   ├── i_therm_LED.csv
│   │   │   │   ├── i_therm_SSP1.csv
│   │   │   │   ├── i_therm_SSP2.csv
│   │   │   │   ├── i_therm_SSP3.csv
│   │   │   │   ├── i_therm_SSP4.csv
│   │   │   │   └── i_therm_SSP5.csv
│   │   │   ├── generic_furnace_boiler_techno_economic.xlsx
│   │   │   ├── industry_thermal_emi_coefficients.csv
│   │   │   └── residual_industry_2019.csv
│   │   ├── petrochemicals
│   │   │   ├── chemicals_carbon_parameters.yaml
│   │   │   ├── demand_2025.csv
│   │   │   └── petrochemicals_techno_economic.xlsx
│   │   ├── reporting
│   │   │   ├── ch4_emi_reporting.yaml
│   │   │   ├── fe_methanol_ammonia_reporting.yaml
│   │   │   ├── fe_methanol_ammonia_reporting_aggregates.yaml
│   │   │   ├── fe_reporting.yaml
│   │   │   ├── fe_reporting_aggregates.yaml
│   │   │   ├── fe_solar_reporting_aggregates.yaml
│   │   │   ├── fs1_reporting.yaml
│   │   │   ├── prod_reporting.yaml
│   │   │   └── prod_reporting_aggregates.yaml
│   │   ├── set.yaml
│   │   └── steel
│   │       ├── Global_steel_MESSAGE.xlsx
│   │       ├── archived/Global_steel_MESSAGE.xlsx
│   │       ├── demand_2025.csv
│   │       ├── demand_steel.yaml
│   │       ├── relations_R12.csv
│   │       ├── steel_R12.csv
│   │       └── timeseries_R12.csv
│   └── technology.yaml (???)
├── model
│   ├── config.py (???)
│   ├── material (@macflo8)
│   │   ├── build.py
│   │   ├── cli.py
│   │   ├── data_aluminum.py
│   │   ├── data_ammonia_new.py
│   │   ├── data_cement.py
│   │   ├── data_generic.py
│   │   ├── data_methanol.py
│   │   ├── data_other_industry.py
│   │   ├── data_petro.py
│   │   ├── data_steel.py
│   │   ├── data_util.py
│   │   ├── material_demand/material_demand_calc.py
│   │   ├── report
│   │   │   ├── reporter_utils.py
│   │   │   ├── reporting.py
│   │   │   └── run_reporting.py
│   │   ├── share_constraints.py
│   │   ├── share_constraints_constants.py
│   │   └── util.py
│   └── water/cli.py (@adrivinca)
├── project/ssp/script (???)
│   ├── scenarios
│   │   ├── ccs_dac.py
│   │   └── low_overshoot.py
│   └── util/functions.py
├── tests/model/material (@macflo8)
│   ├── test_data_aluminum.py
│   └── test_data_util.py
└── tools
    ├── add_dac/__init__.py (@ywpramata)
    └── costs (@OFR-IIASA)
        ├── config.py
        ├── decay.py
        ├── demo.py
        ├── projections.py
        ├── regional_differentiation.py
        └── scenario.py

[adrivinca]

Thanks for this, I started a branch wat_SSP_upd1 that takes a bit from the older water_SSP_update (soon obsolete) but that is meant to be for few incremental fixes, including tests when possible

[khaeru]

@adrivinca I updated the description to replace “Another small change by @adrivinca that will be included in a small PR” with #236 —assuming that's the thing you referred to on Thursday. Please correct if I'm wrong there.

[measrainsey]

Hi! Thank you for documenting this process.

I have a question: I have a few scripts (that are currently on a personal repo) that have my workflow of the modifications I made to certain scenarios for the ScenarioMIP submission. Nothing complicated, just small changes to diffusion constraints and share constraints in the transport, residential + commercial, and industry sectors.
I imagine it would be best to migrate these scripts to a team-accessible location.

Where would be the best place to move my scripts over? Should they be housed here on message-ix-models (for example, in message_ix_models.project.ssp)?

[khaeru]

@measrainsey yes, that would be wonderful, thank you!

I would suggest:

1. Create a branch like ssp-dev/mm or similar.
2. Create a directory like message_ix_models/project/ssp/script/.
3. Commit files (warts and all, no clean-up needed) into that directory.
4. Open a draft PR into the branch ssp-dev associated with Collect pieces for SSP 2024/ScenarioMIP #235.

Once others to do the same, we can check for discrepancies, and figure out an appropriate way to bring the pieces together.