ø£Ąū¼§

28 December 2020

Reports from Imperial College regarding the spread and the effects of Covid-19 had considerable policy impacts in several European countries. But the models that informed the reports have considerable flaws, and are not sufficient to draw the conclusions that were published. This is according to researchers from universities including LiU, in an article in Nature.

Fredrik Gustafsson and Toomas Timpka looks into the camera.
Fredrik Gustafsson, professor at the Department of Electrical Engineering and Toomas Timpka, professor at the department of Health, Medicine and Caring Sciences.  Photographer: Charlotte Perhammar

ā€œThere is too great a distance between the adaptation to reality in the models and the firm recommendations that were issued. As planners of healthcare resources, we have no use for over-confident recommendations based on such shaky data – it would cause problems in healthcare in an already tough situationā€, says Toomas Timpka, professor of social medicine at Linkƶping University, LiU, and senior consultant physician at Region Ɩstergƶtland, where he is in charge of planning healthcare resources.

Toomas Timpka and Fredrik Gustafsson, professor of sensor informatics at LiU, have, together with researchers at Lund University, KTH Royal Institute of Technology and Uppsala University, studied models from Imperial College which estimate the efficiency of various societal measures in preventing the spread of Covid-19. These models have affected the strategies of many countries, not least the United Kingdom which suddenly changed strategy and went into lockdown on 24 March based on the first report from Imperial College. The study has been published in Nature.

ā€œAs the models are so hugely influential, they deserve a more in-depth analysis of the bases, assumptions and data that they rest uponā€, says Fredrik Gustafsson.

Sensitive models

The Swedish research group used the original code from Imperial College to conduct a sensitivity analysis of the models. The analysis showed that very small changes to the input greatly affect the result – and consequently also conclusions and recommendations. Fredrik Gustafsson says that there are too many parameters and degrees of freedom in the models than can be explained by the available data.

According to the study by the Swedish research group, the models from Imperial College were not validated properly. Because the societal measures were implemented at roughly the same time, it is difficult to determine which measure was most effective in slowing the spread of the virus.

ā€œPoliticians and decision-makers should take care when basing their decisions on non-validated and sensitive models, and this also applies when countries in lockdown are to be opened up. Models must be scrutinised carefully and broad interdisciplinarity is required when developing and validating these types of modelsā€, says Fredrik Gustafsson.

The results from Imperial College showed that total lockdown was the measure that in the spring dampened the spread of the virus in Europe in all the modelled countries – with one exception. In Sweden a different measure was the explanation – a measure that appeared to be almost ineffectual in the other countries.

ā€œIt's improbable that every country but one introduces an effective lockdown, but that a different measure proves unusually effective in that one country,ā€ says Fredrik Gustafsson.

Proper validation necessary

The interdisciplinary research group, with broad-based expertise in fields such as automatic control, medicine, information technology and behavioural science, documents in the study further examples of inconsistencies.

ā€œWhen you build complex models on which to base prognoses, you normally validate them by going back and testing them on historical data, in order to ensure as far as possible that the model is correct. For instance, weather forecasting has improved greatly in recent years; meteorologists have added new parameters over time, and have then validated the results against historical data. But epidemiology is different, both in terms of available historical data and modeling traditionā€, says Fredrik Gustafsson.

Fredrik Gustafsson and Toomas Timpka have now joined forces in an interdisciplinary research project, RIDES, in order to further refine the models that Toomas Timpka, Armin Spreco and their colleagues have worked on for many years. These models are based on real data and are validated thoroughly.

###

Imperial College published its models and conclusions in reports released on 16 and 30 March 2020. The models were also published in an article in Nature on 8 June 2020. The study conducted by the Swedish research group, led by researchers at Lund University, has been published in Nature in response to the Imperial College publications.

The research has been made possible through funding from collaborations within the strategic research initiative ELLIIT, Wallenberg AI, Autonomous Systems and Software Program, and the Swedish Foundation for Strategic Research.

Kristian Soltesz, Fredrik Gustafsson, Toomas Timpka, Joakim Jaldén, Carl Jidling, Albin Heimerson, Thomas B. Schön, Armin Spreco, Joakim Ekberg, Örjan Dahlström, Fredrik Bagge Carlson, Anna Jöud, Bo Bernhardsson. Nature 2020, DOI 10.1038/s41586-020-3025-y

Translated by Martin Mirko.



Contact

-

Collaboration and funding

More news on COVID-19

Jendrik Seipp.

Research on next-generation AI planning receives SEK 15 million

LiU researcher Jendrik Seipp has been awarded SEK 15 million to develop an AI planning system that uses multi-core processors for parallel computation. This could lead to more efficient logistics and large-scale energy optimisation, among much else.

Woman by a tree looking into the camera.

The paper industry can become more energy-efficient with a new measurement method

The pulp and paper industry consumes large amounts of energy. But despite stricter EU requirements for efficiency improvements, there has been no way to compare energy consumption between different companies. Now there may be a solution.

Reseracher in lab.

New master’s programmes in world-leading materials science

ø£Ąū¼§ is one of the world’s leading universities in materials science. The autumn of 2026 will see the launch of two new master’s programmes in this field. The students can look forward to an excellent labour market.

Organisation

Latest news from LiU

Jendrik Seipp.

Research on next-generation AI planning receives SEK 15 million

LiU researcher Jendrik Seipp has been awarded SEK 15 million to develop an AI planning system that uses multi-core processors for parallel computation. This could lead to more efficient logistics and large-scale energy optimisation, among much else.

Woman by a tree looking into the camera.

The paper industry can become more energy-efficient with a new measurement method

The pulp and paper industry consumes large amounts of energy. But despite stricter EU requirements for efficiency improvements, there has been no way to compare energy consumption between different companies. Now there may be a solution.

Reseracher in lab.

New master’s programmes in world-leading materials science

ø£Ąū¼§ is one of the world’s leading universities in materials science. The autumn of 2026 will see the launch of two new master’s programmes in this field. The students can look forward to an excellent labour market.