Why Legacy Market Architecture is Struggling

Learning objectives

By the end of this lesson you should be able to:

Understand why many electricity market designs were developed for very different electricity systems.
Recognise how physical changes to the grid have changed the coordination problem.
Appreciate why multiple new market mechanisms have emerged over time.
Understand the relationship between markets, system operation and network constraints.
Recognise why many countries are reconsidering electricity market design.
Appreciate why future electricity markets may require fundamentally different approaches to coordination.

Introduction

Over the past several lessons, we have explored how electricity systems have changed.

We have seen the rapid growth of:

variable renewable generation,
electrification of transport and heating,
prosumers,
bidirectional power flows,
millions of controllable devices,
smart grids,
digital infrastructure.

These changes have transformed the physical electricity system.

This naturally raises an important question.

Have the mechanisms used to coordinate electricity systems evolved at the same pace?

To answer this question, it is useful to remember the purpose of electricity markets.

Markets are not objectives in themselves.

They are coordination mechanisms designed to help allocate resources efficiently while maintaining a reliable electricity supply.

As the physical system changes, it is reasonable to ask whether the coordination mechanisms should also evolve.

Markets solve coordination problems

Every electricity market is designed to solve a particular coordination problem.

Historically, that problem was relatively well defined.

System operators needed to coordinate:

a limited number of large generators,
predictable demand,
predominantly one-way power flows,
relatively slow operational changes.

Many of today's electricity markets were developed to perform this task extremely effectively.

The success of these markets reflects how well they matched the characteristics of the electricity systems for which they were designed.

The coordination problem has changed

Modern electricity systems present a much more complex coordination problem.

Operators increasingly need to coordinate:

millions of distributed energy resources,
flexible demand,
battery storage,
electric vehicles,
local network constraints,
variable renewable generation,
bidirectional power flows.

The objective is no longer simply deciding which generators should produce electricity.

Increasingly, it involves coordinating the behaviour of millions of distributed participants operating across every level of the electricity system.

The emergence of additional markets

One indication that the coordination problem has become more complex is the increasing number of market mechanisms that now exist.

In many electricity systems, participants may simultaneously interact with:

wholesale energy markets,
balancing markets,
ancillary service markets,
capacity markets,
flexibility markets,
reserve markets,
local congestion management schemes.

Each mechanism addresses a different operational requirement.

Rather than replacing existing markets, many have been added alongside them as new challenges have emerged.

Coordination across multiple objectives

Modern electricity systems must satisfy many objectives simultaneously.

These include:

balancing supply and demand,
maintaining network security,
managing congestion,
maintaining frequency,
supporting voltage,
ensuring reliability,
encouraging investment.

Each objective influences the others.

For example, a decision that is economically attractive at a national level may create congestion within a local distribution network.

Similarly, a locally beneficial action may have wider implications for system operation.

Coordinating these objectives becomes increasingly challenging as electricity systems become more distributed.

Different layers of the electricity system

Electricity systems now operate across several interconnected layers.

These include:

transmission networks,
distribution networks,
wholesale markets,
balancing mechanisms,
local flexibility services,
distributed energy resources.

Each layer has different responsibilities.

However, all ultimately influence the same physical electricity network.

Increasing interaction between these layers requires increasing levels of coordination.

Markets and physical networks

Markets allocate resources.

Networks transport electricity.

Although these functions are distinct, they cannot be separated.

Every market outcome must ultimately be physically feasible.

Electricity can only flow through available network capacity.

Voltage must remain within acceptable limits.

Equipment ratings cannot be exceeded.

As distributed resources become increasingly important, market decisions become more closely coupled to the physical operation of electricity networks.

The growing importance of real-time coordination

Historically, many market decisions were made well before electricity was delivered.

Generators submitted offers.

Markets cleared.

System operators then implemented the resulting schedules.

Today, however, operating conditions can change much more rapidly.

Renewable output varies.

Electric vehicles connect and disconnect.

Consumers respond to prices.

Local congestion emerges and disappears.

This increases the importance of continuous operational coordination throughout the day.

The challenge of scale

Perhaps the greatest challenge is scale.

Traditional electricity markets coordinated hundreds of large participants.

Future electricity systems may coordinate millions of distributed devices.

Each participant may have:

different objectives,
different operating constraints,
different locations,
different capabilities,
different communication links.

This increases both the volume of decisions and the speed at which those decisions must be made.

Why reform is being discussed

Around the world, governments, regulators and system operators are actively exploring reforms to electricity market design.

Different countries are considering different approaches.

Examples include:

locational pricing,
regional pricing,
enhanced flexibility markets,
demand-side participation,
distributed energy resource coordination,
new ancillary service products,
digital market platforms.

Although these proposals differ, they generally reflect a common observation.

The electricity system is changing, and market arrangements may also need to evolve.

Evolution rather than replacement

It is important not to view this as a choice between old and new.

Existing market designs have delivered enormous benefits over many decades.

Many of their underlying economic principles remain highly valuable.

However, as electricity systems evolve, additional coordination mechanisms may become necessary.

Future electricity markets are therefore likely to build upon existing ideas rather than replace them entirely.

An interdisciplinary challenge

Designing future electricity systems is no longer solely an economics problem.

Nor is it solely an engineering problem.

It increasingly combines:

electrical engineering,
economics,
control theory,
optimisation,
computer science,
communications,
cybersecurity,
data science,
public policy.

Successfully coordinating future electricity systems requires expertise across multiple disciplines.

Preparing for the next stage

This module has examined how the physical electricity system is changing.

The next part of the course explores how coordination mechanisms may evolve in response.

Rather than assuming that existing market architectures are either right or wrong, we will investigate how different designs attempt to solve different coordination problems.

The central question is not:

"Which market is best?"

Instead, it is:

"What coordination problem are we trying to solve, and which mechanisms are best suited to solving it?"

A key insight

Modern electricity systems have become far more distributed, dynamic and information-rich than the systems for which many existing market architectures were originally developed.

As the physical coordination problem evolves, market design is increasingly focused on finding new ways to coordinate millions of distributed resources while maintaining reliability, efficiency and fairness.

The evolution of electricity markets therefore reflects the evolution of the electricity system itself.

Key takeaways

Electricity markets are coordination mechanisms designed to solve specific operational problems.
Many existing market designs were developed for systems with relatively few large generators and passive consumers.
Modern electricity systems include distributed generation, flexible demand and millions of controllable devices.
Additional market mechanisms have emerged to address increasingly complex operational requirements.
Market outcomes must always remain consistent with the physical operation of electricity networks.
Many countries are actively exploring reforms to electricity market design.
Future market evolution is likely to build upon existing principles while addressing the coordination challenges of increasingly distributed electricity systems.

Module summary

In this module, we have examined how electricity systems are undergoing one of the largest transformations in their history.

We explored the rise of renewable generation, the electrification of transport and heating, the emergence of prosumers, bidirectional power flows, millions of controllable devices, the importance of observability, and the role of digital infrastructure and smart grids.

Together, these developments have fundamentally changed the nature of the electricity system.

Understanding this transformation provides the foundation for the remainder of the course, where we turn our attention from how the electricity system is changing to how its coordination mechanisms may evolve in response.