Through the Smart Systems and Heat (SSH) Programme, Energy Systems Catapult (ESC) delivered a large consumer-focused project aimed at identifying how to overcome the barriers to the decarbonisation of residential heat. SSH was designed as an opportunity for learning about what and how to innovate in the delivery of residential heat.
Evaluation was built into the programme, with a role in helping to deliver this learning aim.
This paper by Michelle Hollier, Research & Evaluation Director at Winning Moves, and Emma Harrison of ESC UK, uses the evaluation of SSH as a case study of the challenges in evaluating what has and will work with regards to systems innovation and the methods and approaches that do, don’t and might be used to address this. In particular:
- How to identify relevant outputs and outcomes? The understanding of what the programme could do (within the context of the wider decarbonisation agenda) developed throughout delivery.
- How to engage with programme stakeholders in an appropriate and timely way? Stakeholder groups adapted through the programme and the messaging of the programme evolved during delivery through testing and refinement with stakeholders.
- How to provide useful learning about the potential of approaches to systems innovation? The evaluation was conducted concurrent to delivery of SSH2; this limited the extent to which the achievement of intended outcomes could be accurately assessed.
We need to learn fast about what can work (and won’t work) to understand how to achieve a transition in the energy market. This paper reflects on the challenges for the evaluation practitioner in supporting this.