Sequential Simulations with PowerSimulations.jl

Originally Contributed by: Clayton Barrows

Introduction

PowerSimulations.jl supports simulations that consist of sequential optimization problems where results from previous problems inform subsequent problems in a variety of ways. This example demonstrates some of these capabilities to represent electricity market clearing. This example is intended to be an extension of the OperationsProblem tutorial.

Load Packages

using PowerSystems
using PowerSimulations
using HydroPowerSimulations
const PSI = PowerSimulations
using PowerSystemCaseBuilder
using Dates
using HiGHS #solver

Optimizer

It's most convenient to define an optimizer instance upfront and pass it into the DecisionModel constructor. For this example, we can use the free HiGHS solver with a relatively relaxed MIP gap (ratioGap) setting to improve speed.

solver = optimizer_with_attributes(HiGHS.Optimizer, "mip_rel_gap" => 0.5)
MathOptInterface.OptimizerWithAttributes(HiGHS.Optimizer, Pair{MathOptInterface.AbstractOptimizerAttribute, Any}[MathOptInterface.RawOptimizerAttribute("mip_rel_gap") => 0.5])

Hourly day-ahead system

First, we'll create a System with hourly data to represent day-ahead forecasted wind, solar, and load profiles:

sys_DA = build_system(PSISystems, "modified_RTS_GMLC_DA_sys"; skip_serialization = true)
System
Property Value
Name
Description
System Units Base SYSTEM_BASE
Base Power 100.0
Base Frequency 60.0
Num Components 501
Static Components
Type Count
ACBus 73
Arc 109
Area 3
FixedAdmittance 3
HydroDispatch 1
Line 105
LoadZone 21
PowerLoad 51
RenewableDispatch 29
RenewableNonDispatch 31
TapTransformer 15
ThermalStandard 54
TwoTerminalHVDCLine 1
VariableReserve{ReserveDown} 1
VariableReserve{ReserveUp} 4
Time Series Summary
owner_type owner_category time_series_type time_series_category initial_timestamp resolution_ms count
String String String String String Int64 Int64
Area Component DeterministicSingleTimeSeries Forecast 2020-01-01T00:00:00 3600000 3
Area Component SingleTimeSeries StaticTimeSeries 2020-01-01T00:00:00 3600000 3
FixedAdmittance Component DeterministicSingleTimeSeries Forecast 2020-01-01T00:00:00 3600000 3
FixedAdmittance Component SingleTimeSeries StaticTimeSeries 2020-01-01T00:00:00 3600000 3
HydroDispatch Component DeterministicSingleTimeSeries Forecast 2020-01-01T00:00:00 3600000 2
HydroDispatch Component SingleTimeSeries StaticTimeSeries 2020-01-01T00:00:00 3600000 2
PowerLoad Component DeterministicSingleTimeSeries Forecast 2020-01-01T00:00:00 3600000 51
PowerLoad Component SingleTimeSeries StaticTimeSeries 2020-01-01T00:00:00 3600000 51
RenewableDispatch Component DeterministicSingleTimeSeries Forecast 2020-01-01T00:00:00 3600000 29
RenewableDispatch Component SingleTimeSeries StaticTimeSeries 2020-01-01T00:00:00 3600000 29
RenewableNonDispatch Component DeterministicSingleTimeSeries Forecast 2020-01-01T00:00:00 3600000 31
RenewableNonDispatch Component SingleTimeSeries StaticTimeSeries 2020-01-01T00:00:00 3600000 31
VariableReserve Component DeterministicSingleTimeSeries Forecast 2020-01-01T00:00:00 3600000 5
VariableReserve Component SingleTimeSeries StaticTimeSeries 2020-01-01T00:00:00 3600000 5

5-Minute system

The RTS data also includes 5-minute resolution time series data. So, we can create another System to represent 15 minute ahead forecasted data for a "real-time" market:

sys_RT = build_system(PSISystems, "modified_RTS_GMLC_RT_sys"; skip_serialization = true)
System
Property Value
Name
Description
System Units Base SYSTEM_BASE
Base Power 100.0
Base Frequency 60.0
Num Components 499
Static Components
Type Count
ACBus 73
Arc 109
Area 1
FixedAdmittance 3
HydroDispatch 1
Line 105
LoadZone 21
PowerLoad 51
RenewableDispatch 29
RenewableNonDispatch 31
TapTransformer 15
ThermalStandard 54
TwoTerminalHVDCLine 1
VariableReserve{ReserveDown} 1
VariableReserve{ReserveUp} 4
Time Series Summary
owner_type owner_category time_series_type time_series_category initial_timestamp resolution_ms count
String String String String String Int64 Int64
Area Component DeterministicSingleTimeSeries Forecast 2020-01-01T00:00:00 300000 1
Area Component SingleTimeSeries StaticTimeSeries 2020-01-01T00:00:00 300000 1
FixedAdmittance Component DeterministicSingleTimeSeries Forecast 2020-01-01T00:00:00 300000 3
FixedAdmittance Component SingleTimeSeries StaticTimeSeries 2020-01-01T00:00:00 300000 3
HydroDispatch Component DeterministicSingleTimeSeries Forecast 2020-01-01T00:00:00 300000 2
HydroDispatch Component SingleTimeSeries StaticTimeSeries 2020-01-01T00:00:00 300000 2
PowerLoad Component DeterministicSingleTimeSeries Forecast 2020-01-01T00:00:00 300000 51
PowerLoad Component SingleTimeSeries StaticTimeSeries 2020-01-01T00:00:00 300000 51
RenewableDispatch Component DeterministicSingleTimeSeries Forecast 2020-01-01T00:00:00 300000 29
RenewableDispatch Component SingleTimeSeries StaticTimeSeries 2020-01-01T00:00:00 300000 29
RenewableNonDispatch Component DeterministicSingleTimeSeries Forecast 2020-01-01T00:00:00 300000 31
RenewableNonDispatch Component SingleTimeSeries StaticTimeSeries 2020-01-01T00:00:00 300000 31
VariableReserve Component DeterministicSingleTimeSeries Forecast 2020-01-01T00:00:00 300000 5
VariableReserve Component SingleTimeSeries StaticTimeSeries 2020-01-01T00:00:00 300000 5

ProblemTemplates define stages

Sequential simulations in PowerSimulations are created by defining OperationsProblems that represent stages, and how information flows between executions of a stage and between different stages.

Let's start by defining a two stage simulation that might look like a typical day-Ahead and real-time electricity market clearing process.

Day-ahead unit commitment stage

First, we can define a unit commitment template for the day ahead problem. We can use the included UC template, but in this example, we'll replace the ThermalBasicUnitCommitment with the slightly more complex ThermalStandardUnitCommitment for the thermal generators.

template_uc = template_unit_commitment()
set_device_model!(template_uc, ThermalStandard, ThermalStandardUnitCommitment)
set_device_model!(template_uc, HydroDispatch, HydroDispatchRunOfRiver)
┌ Warning: Overwriting ThermalStandard existing model
└ @ PowerSimulations ~/work/PowerSimulations.jl/PowerSimulations.jl/src/core/device_model.jl:116

Define the reference model for the real-time economic dispatch

In addition to the manual specification process demonstrated in the OperationsProblem example, PSI also provides pre-specified templates for some standard problems:

template_ed = template_economic_dispatch(
    network = NetworkModel(PTDFPowerModel, use_slacks = true),
)
Network Model
Network Model PTDFPowerModel
Slacks true
PTDF false
Duals None
Device Models
Device Type Formulation Slacks
RenewableNonDispatch FixedOutput false
ThermalStandard ThermalBasicDispatch false
PowerLoad StaticPowerLoad false
InterruptiblePowerLoad PowerLoadInterruption false
RenewableDispatch RenewableFullDispatch false
Branch Models
Branch Type Formulation Slacks
Line StaticBranch false
TapTransformer StaticBranch false
Transformer2W StaticBranch false
TwoTerminalHVDCLine HVDCTwoTerminalDispatch false
Service Models
Service Type Formulation Slacks Aggregated Model
VariableReserve{ReserveUp} RangeReserve false true
VariableReserve{ReserveDown} RangeReserve false true

Define the SimulationModels

DecisionModels define the problems that are executed in the simulation. The actual problem will change as the stage gets updated to represent different time periods, but the formulations applied to the components is constant within a stage. In this case, we want to define two stages with the ProblemTemplates and the Systems that we've already created.

models = SimulationModels(
    decision_models = [
        DecisionModel(template_uc, sys_DA, optimizer = solver, name = "UC"),
        DecisionModel(template_ed, sys_RT, optimizer = solver, name = "ED"),
    ],
)
Decision Models
Model Name Model Type Status Output Directory
UC GenericOpProblem EMPTY nothing
ED GenericOpProblem EMPTY nothing
No Emulator Model Specified

SimulationSequence

Similar to an ProblemTemplate, the SimulationSequence provides a template of how to execute a sequential set of operations problems.

Let's review some of the SimulationSequence arguments.

Chronologies

In PowerSimulations, chronologies define where information is flowing. There are two types of chronologies.

  • inter-stage chronologies: Define how information flows between stages. e.g. day-ahead solutions are used to inform economic dispatch problems
  • intra-stage chronologies: Define how information flows between multiple executions of a single stage. e.g. the dispatch setpoints of the first period of an economic dispatch problem are constrained by the ramping limits from setpoints in the final period of the previous problem.

FeedForward

The definition of exactly what information is passed using the defined chronologies is accomplished with FeedForward. Specifically, FeedForward is used to define what to do with information being passed with an inter-stage chronology. Let's define a FeedForward that affects the semi-continuous range constraints of thermal generators in the economic dispatch problems based on the value of the unit-commitment variables.

feedforward = Dict(
    "ED" => [
        SemiContinuousFeedforward(
            component_type = ThermalStandard,
            source = OnVariable,
            affected_values = [ActivePowerVariable],
        ),
    ],
)
Dict{String, Vector{SemiContinuousFeedforward}} with 1 entry:
  "ED" => [SemiContinuousFeedforward(VariableKey{OnVariable, ThermalStandard}("…

Sequencing

The stage problem length, look-ahead, and other details surrounding the temporal Sequencing of stages are controlled using the structure of the time series data in the Systems. So, to define a typical day-ahead - real-time sequence:

  • Day ahead problems should represent 48 hours, advancing 24 hours after each execution (24-hour look-ahead)
  • Real time problems should represent 1 hour (12 5-minute periods), advancing 15 min after each execution (15 min look-ahead)

We can adjust the time series data to reflect this structure in each System:

  • transform_single_time_series!(sys_DA, 48, Hour(1))
  • transform_single_time_series!(sys_RT, 12, Minute(15))

Now we can put it all together to define a SimulationSequence

DA_RT_sequence = SimulationSequence(
    models = models,
    ini_cond_chronology = InterProblemChronology(),
    feedforwards = feedforward,
)
Simulation Sequence
Simulation Step Interval 24 hours
Number of Problems 2
Simulation Problems
Model Name Horizon Interval Executions Per Step
UC 2 days 1 day 1
ED 1 hour 15 minutes 96
Feedforwards
Model Name Feed Forward Type
ED SemiContinuousFeedforward

Simulation

Now, we can build and execute a simulation using the SimulationSequence and Stages that we've defined.

sim = Simulation(
    name = "rts-test",
    steps = 2,
    models = models,
    sequence = DA_RT_sequence,
    simulation_folder = joinpath(".", "rts-store"),
)
Simulation
Simulation Name rts-test
Build Status EMPTY
Run Status NOT_READY
Initial Time Unset Initial Time
Steps 2
Decision Models
Model Name Model Type Status Output Directory
UC GenericOpProblem EMPTY nothing
ED GenericOpProblem EMPTY nothing
No Emulator Model Specified
Simulation Sequence
Simulation Step Interval 24 hours
Number of Problems 2
Simulation Problems
Model Name Horizon Interval Executions Per Step
UC 2 days 1 day 1
ED 1 hour 15 minutes 96
Feedforwards
Model Name Feed Forward Type
ED SemiContinuousFeedforward

Build simulation

build!(sim)
InfrastructureSystems.Simulation.SimulationBuildStatusModule.SimulationBuildStatus.BUILT = 0

Execute simulation

the following command returns the status of the simulation (0: is proper execution) and stores the results in a set of HDF5 files on disk.

execute!(sim, enable_progress_bar = false)
InfrastructureSystems.Simulation.RunStatusModule.RunStatus.FAILED = 2

Results

To access the results, we need to load the simulation result metadata and then make requests to the specific data of interest. This allows you to efficiently access the results of interest without overloading resources.

results = SimulationResults(sim);
uc_results = get_decision_problem_results(results, "UC"); # UC stage result metadata
ed_results = get_decision_problem_results(results, "ED"); # ED stage result metadata

We can read all the result variables

read_variables(uc_results)

or all the parameters

read_parameters(uc_results)

We can just list the variable names contained in uc_results:

list_variable_names(uc_results)

and a number of parameters (this pattern also works for aux_variables, expressions, and duals)

list_parameter_names(uc_results)

Now we can read the specific results of interest for a specific problem, time window (optional), and set of variables, duals, or parameters (optional)

Dict([
    v => read_variable(uc_results, v) for v in [
        "ActivePowerVariable__RenewableDispatch",
        "ActivePowerVariable__HydroDispatch",
        "StopVariable__ThermalStandard",
    ]
])

Or if we want the result of just one variable, parameter, or dual (must be defined in the problem definition), we can use:

read_parameter(
    ed_results,
    "ActivePowerTimeSeriesParameter__RenewableNonDispatch",
    initial_time = DateTime("2020-01-01T06:00:00"),
    count = 5,
)
Info

note that this returns the results of each execution step in a separate dataframe If you want the realized results (without lookahead periods), you can call read_realized_*:

read_realized_variables(
    uc_results,
    ["ActivePowerVariable__ThermalStandard", "ActivePowerVariable__RenewableDispatch"],
)
rm(path, force = true, recursive = true) #hide

Plotting

Take a look at the plotting capabilities in PowerGraphics.jl