University of Virginia: Here’s What It Takes To Do Good Science Under Pressure

This question has taken on new relevance with the COVID-19 vaccine rollout. Researchers developed vaccines in under a year – easily breaking the previous record of four years. But that pace of development may be part of the reason about 1 in 7 unvaccinated adults in the U.S. say they will never get the COVID-19 shot. This is in spite of continued assurances from infectious disease experts that the vaccines are safe.

Scientists are called on to come up with answers under pressure whenever there is a crisis, from the Challenger space shuttle explosion to the 2020 California wildfires. As they shift from “regular” to “crisis” research, they must maintain rigorous standards despite long hours, mentally demanding tasks and persistent outside scrutiny. Thankfully, science produced under urgent conditions can be just as robust and safe as results produced under normal conditions.

Your gift. Our impact. Give through the Commonwealth of Virginia Campaign.
We are two social scientists interested in understanding how researchers can best work on urgent problems and deliver useful findings.

In a recent study, we focused on “conflict archaeologists,” an interdisciplinary group tasked with rapid assessments of archaeological destruction in Syria during the war between 2014 and 2017. Observers feared that one particular form of destruction, artifact looting, was a major source of revenue for terrorist groups, including the Islamic State. Prominent policymakers, security officials and a worried public wanted clear answers, quickly.

By any measure, conflict archaeologists succeeded. They produced findings that improved scientific knowledge. Their research led to a landmark bipartisan bill signed by President Obama. Perhaps most importantly, they raised public awareness of the problems associated with looting and smuggling archaeological materials.

Our latest research aimed to understand how work cultures played a role in these achievements – and what lessons can be applied in crisis science across disciplines.

What Worked for Conflict Archaeologists
To investigate, we interviewed 35 conflict archaeologists and other scientists who worked with them. We also observed work in satellite labs and team meetings, and talked to people who used the data and analysis created by conflict archaeologists.

Those we interviewed worked in different physical locations and across multiple disciplines. If they met, they would do so remotely. And yet they were generally aware of what others in this research area were doing. Collaboration is central to doing good urgent science, and we found three key factors behind successfully working together during a crisis.

First, the percentage and distribution of effort matters. We call this “temporal control.” We found that full-time devotion to crisis science was not necessarily the only way to produce good work. In fact, researchers involved on a part-time basis expressed higher confidence in the quality of other collaborators’ work. We think part-timers were able to maintain a more comprehensive perspective on the collaboration overall.

And keeping a hand in their usual scientific practices seemed to help researchers stay sharp. It meant that when they turned to urgent science tasks, they could do so with fresh eyes and renewed attention to methodological precision.