JESIP Research Symposium Summary

On 17 January 2025, the second JESIP Research Symposium brought together around 40 academics and practitioners to explore the questions:

1. What do we need to measure to evaluate the effectiveness of interoperability?
2. How can we ensure these measurements are robust, meaningful, and practical?
3. Most importantly, how do we use this information to sustain and adapt JESIP in a world of evolving risks and challenges?

The event began with a series of presentations given by invited speakers with specific subject, industry or research knowledge. Dr Nikki Power (University of Liverpool) provided a welcome address, followed by a keynote presentation by Chief Superintendent David Boyle (National JESIP lead for Strategy and Transformation) and Polly Stannard (Home Office Senior Strategy Adviser) who provided an overview of JESIP, including its history, and current and future goals.

Session 1 presentations focused on ‘Defining Good Interoperability: What Should We Measure?’. Dr Philip C Butler (University of Liverpool) spoke on the use of behavioural marker systems to assess non-technical skills including teamwork in high reliability organisations. Dr Katherine Lamb (K Lamb Associates) then spoke about monitoring and assessment, command competence and the open sharing of lessons and academic review based on her experiences in the Fire sector.

...embedding trust, psychological safety, and social identity research into JESIP, expanding training provisions, and developing a central research repository will be key steps.

In Session 2 presentations focused on ‘Measuring Good Interoperability: How Should We Measure It?’. Dr Richard Philpot (Lancaster University) presented research on a behavioural framework for analysing multi-agency interactions, whilst Dr Andrew Harding (Lancaster University) described how a realist evaluation approach can support ongoing measurement and evaluation of efforts to improve interoperability.

The afternoon involved interactive discussions, where mixed tables of academics and practitioners reflected on the morning talks, alongside their expert views working in academia and/or practice. The first discussion asked delegates to consider what key metrics define interoperability and how should they be measured. The second discussion asked them to consider what a future JESIP research agenda might involve, reflecting on feedback from the first JESIP Research Symposium in July 2024, presented by Saarah Ahmed (Strategy Advisor, Home Office).

This document highlights the key themes from the event oriented around the two table discussions. You can download a pdf version of this summary here.

Metrics and Measurement of Interoperability

• Metrics of Interoperability

Key metrics included communication, leadership, trust, understanding roles and responsibilities, situational awareness, and psychological safety.

• Measuring Interoperability at the Incident Ground

Participants discussed how interoperability might be observed at the incident ground. This included binary questions (e.g., “Did you co-locate?” yes/no) to measure whether JESIP principles were applied. It was also recommended that communication logs could be analysed to measure the content, accuracy, and flow of information.

• Qualitative and Mixed-Methods Approaches

Less tangible constructs such as trust were considered better measured using qualitative and mixed methods approaches, such as self-report surveys and interviews, which could ask responders about their trust within and between organisational groups.

• Invasive and Non-Invasive Data Collection

Whilst the analysis of audio and video recordings of multi-agency incidents and training could yield important insights, it was considered potentially invasive.

• Focus on Processes Rather than Outcomes

It was acknowledged that the unpredictable nature of emergencies meant that even if JESIP principles are applied well, the outcome might not be positive. To ensure validity in evaluating interoperability, it was recommended to focus on process rather than outcomes.

Shaping the JESIP Research Agenda

• Priority Areas for Research

The priority areas for research highlighted by the delegates included: (i) trust; (ii) psychological safety; and (iii) social identities.

• Co-Produced Research

Co-production was viewed as necessary to improve interoperability, where practitioners and academics work together to identify problem spaces, conduct research, and generate evidence-based solutions. To support effective collaborations, it was suggested that the aims, objectives, and expectations of co-produced research are made clear at the outset.

• Engaging with a Broader Range of Academics

Engaging with researchers from across a wide range of disciplines could help to strengthen future research on interoperability. To achieve this, activities might include inter-disciplinary events, conferences, and funding opportunities.

• Creating a Central Research and Data Repository

Creating a research and data repository was recommended to provide a corpus of research and data in the interoperability space. A good example is the College of Policing’s What Works Centre for Crime Reduction, which has a variety of toolkits.

• Focus Research on What Works, Not What Doesn’t

Research should move away from focusing on evaluating interoperability failures towards identifying and testing practical solutions.

• Financial and Capacity Constraints

It was acknowledged that financial and capacity constraints limited the extent to which research can be funded and changes can be embedded across the Emergency Services.

• Preparing JESIP for the Future

To futureproof JESIP, a research-informed approach is essential. Evidence-based training and education should be: (i) delivered from day one; (ii) available to both Category 1 and 2 organisations; (iii) regular; and (iv) utilise VR and simulation technologies.

Conclusion

The second JESIP Research Symposium reinforced the importance of evidence-based approaches to measuring and improving interoperability. Discussions highlighted the need for clear, practical metrics, a focus on process over outcomes, and a co-produced research agenda that brings together academics and practitioners. Moving forward, embedding trust, psychological safety, and social identity research into JESIP, expanding training provisions, and developing a central research repository will be key steps. While financial and capacity constraints present challenges, a collaborative, forward-thinking approach will help ensure JESIP remains adaptable and effective in an evolving emergency response landscape.

Acknowledgements

We would like to thank the presenters, delegates, and note takers for their invaluable contributions, which made this event a success and provided the inspiration for this readout.