Notes on Technical Infrastructure for Energy Modeling
March 30, 2024 — Brad Venner
What was hard about energy modeling
- Figuring out which model to use
- Learning to use Julia (i.e. putting long-term goals on par with short-term goals)
- Deciding how much detail was necesssary for the model
- We went down the Julia roll-your-own pathway, then went to Switch, but tried to keep the existing Julia code.
- Identifying sources for data.
- Transforming data into the correct format.
- Getting things written up.
- Outreach. We never did develop a website or present our results in a systematic way to interested parties.
- Reproducibility. We did not have a fully documented data engineering pipeline.
- Calibration. Reproducing Xcel’s results to show that we could their model results. This turned out to be the must-run constraints.
- Power network. We never moved past a copper plate model.
- Time. We started too late and by the time we had the model working
- Lack of support. Leslie was always at best “meh” about the work and did not line up any other advocates that could present the work during testimony.
- The PUC. This whole system is designed in a legal framework that has no interest in the truth. This seems really obvious but was still a surprise.
- I wasn’t willing to devote 6 months of full-time work to do this.
- Loss of motivation. We had no plan to present the results outside of Leslie.
If I were to redo this:
- Have a separate server, perhaps a VPS, that would run a task queue for simulations (RabbitMQ and Celery).
- All input and ouput files would be put into a database.
- Visualizations would be output from the database.
- Spend money on cloud compute
Why do energy modeling
- Every time you democratically plan how to create and distribute resources you are building socialism, because you’re learning how to do it.
- In this frame, building energy models is a step towards socialism.
- Actively weakening capitalism.