Statistics Under Pressure: informing decision-making at pace


For statisticians working under pressure, it can be challenging to judge when imperfect data is good enough to inform decisions, and which trade-offs can appropriately be made. The Covid-19 pandemic highlighted the importance of data being used to inform decision-making at pace. 

This project aims to foster an environment in which statistics, data and modelling that are good enough to inform time-pressured decisions can be used with confidence, especially in cases where the data is not perfect and decisions might otherwise be made in the absence of data. 

Statistics Under Pressure aims to support statisticians to provide the best possible statistics under pressure, including consideration of when and how to make suitable trade-offs. It aims to raise awareness around the need for trade-offs in real-world circumstances, along with the merits of such an approach. It also aims to support decision-makers and the public to interpret and use data that is associated with limitations or uncertainties. 
 

Case studies and principles 

Case studies
 

As the first stage of this project, we have developed and published a series of case studies to illustrate instances in which compromises had to be made in order for data to best inform decision-making. The case studies highlight which trade-offs were made and explain why these compromises were necessary. 

Developed in collaboration with contacts from across the Government Statistical Service and in academia, the case studies cover a range of topic areas, with examples from the Covid-19 pandemic – and before – to more recent examples, including in health, economics, transport, and public statistics. For insights into the trade-offs involved in a range of prominent statistical and data projects, explore our case studies

Principles

By looking across the case studies and through discussions with a range of stakeholders, we have developed a set of principles to help statisticians and analysts consider when and how to appropriately make trade-offs, in line with good practice. Take a look at the principles. 

Policy recommendations

We have developed a set of recommendations, informed by this initiative, that outline practical steps policymakers can take to ensure that data and analyses are able to feed into decision-making in pressurised situations. Take a look at the five recommendations

Watch a video on the Statistics Under Pressure initiative here, where members of the steering group take us through the case studies and principles. 

 


Statistics Under Pressure objectives
  1. Deepen understanding on how trade-offs can be employed in line with good practice among statisticians and analysts  
  2. Improve the ability of non-analysts to interpret statistics and data that are presented with uncertainties and caveats, and to use them to inform decisions   
  3. Strengthen resources and structures (eg data platforms, team structures) to promote statistics that are produced at pace and feed into decision-making rapidly, including capacity to ramp back up in the event of another crisis  
  4. Increase cross-team communication, including between decision-makers and analysts, and between analysts and external stakeholders/data users to increase understanding of user needs and data context 
  5. Raise awareness of the need for and value of an approach that involves trade-offs among the wider statistical community, end users of data, and the public, to increase understanding and explain the necessity and merits of such an approach
 
Oversight
The following individuals form a Steering Group that helps to direct and advise on the project: 
 
  • John Aston (Chair) - RSS President, Harding Professor of Statistics in Public Life and Pro-Vice-Chancellor for Research at the University of Cambridge, previous Chief Scientific Advisor to the Home Office (2017-2020) and Non-Executive Director of the UK Statistics Authority
  • Paul Allin - RSS Honorary Officer for National Statistics, Chair of RSS National Statistics Advisory Group, visiting Professor in the Department of Mathematics, Imperial College London, previous roles chairing the UK Statistics User Forum and at the Office for National Statistics and Government Statistical Service 
  • Christl Donnelly – Past RSS Vice President for External Affairs, Chair of RSS Campaign Advisory Group, Professor of Applied Statistics at University of Oxford and Visiting Professor at Imperial College London 
  • Clare Griffiths - previously Head of the UK COVID-19 dashboard, currently Head of Public Health Analytical Product Development at the Department for Health and Social Care
  • Sarah Walker - Chief Investigator of the Covid Infection Survey, Professor of Medical Statistics and Epidemiology at the University of Oxford. 
 
Your views

We welcome your thoughts on this project, including feedback on what you would find helpful to support you to produce, communicate, use, or interpret statistics and data in high-pressure fast-paced circumstances. 

Please get in touch at policy@rss.org.uk.