Monday, September 13, 2021

"How the Pandemic Is Changing the Norms of Science"

 The author, John P.A. Ioannidis, hangs his hats (he has triple professorships) at Stanford.*

From Tablet Magazine:

Imperatives like skepticism and disinterestedness are being junked to fuel political warfare that has nothing in common with scientific methodology

In the past I had often fervently wished that one day everyone would be passionate and excited about scientific research. I should have been more careful about what I had wished for. The crisis caused by the lethal COVID-19 pandemic and by the responses to the crisis have made billions of people worldwide acutely interested and overexcited about science. Decisions pronounced in the name of science have become arbitrators of life, death, and fundamental freedoms. Everything that mattered was affected by science, by scientists interpreting science, and by those who impose measures based on their interpretations of science in the context of political warfare.

One problem with this new mass engagement with science is that most people, including most people in the West, had never been seriously exposed to the fundamental norms of the scientific method. The Mertonian norms of communalism, universalism, disinterestedness, and organized skepticism have unfortunately never been mainstream in education, media, or even in science museums and TV documentaries on scientific topics.

Before the pandemic, the sharing of data, protocols, and discoveries for free was limited, compromising the communalism on which the scientific method is based. It was already widely tolerated that science was not universal, but the realm of an ever-more hierarchical elite, a minority of experts. Gargantuan financial and other interests and conflicts thrived in the neighborhood of science—and the norm of disinterestedness was left forlorn.

As for organized skepticism, it did not sell very well within academic sanctuaries. Even the best peer-reviewed journals often presented results with bias and spin. Broader public and media dissemination of scientific discoveries was largely focused on what could be exaggerated about the research, rather than the rigor of its methods and the inherent uncertainty of the results.  

Nevertheless, despite the cynical realization that the methodological norms of science had been neglected (or perhaps because of this realization), voices struggling for more communalism, universalism, disinterestedness, and organized skepticism had been multiplying among scientific circles prior to the pandemic. Reformers were often seen as holding some sort of a moral higher ground, despite being outnumbered in occupancy of powerful positions. Reproducibility crises in many scientific fields, ranging from biomedicine to psychology, caused soul-searching and efforts to enhance transparency, including the sharing of raw data, protocols, and code. Inequalities within the academy were increasingly recognized with calls to remedy them. Many were receptive to pleas for reform.

Opinion-based experts (while still dominant in influential committees, professional societies, major conferences, funding bodies, and other power nodes of the system) were often challenged by evidence-based criticism. There were efforts to make conflicts of interest more transparent and to minimize their impact, even if most science leaders remained conflicted, especially in medicine. A thriving community of scientists focused on rigorous methods, understanding biases, and minimizing their impact. The field of metaresearch, i.e., research on research, had become widely respected. One might therefore have hoped that the pandemic crisis could have fostered change. Indeed, change did happen—but perhaps mostly for the worst.

Lack of communalism during the pandemic fueled scandals and conspiracy theories, which were then treated as fact in the name of science by much of the popular press and on social media. The retraction of a highly visible hydroxychloroquine paper from the The Lancet was a startling example: A lack of sharing and openness allowed a top medical journal to publish an article in which 671 hospitals allegedly contributed data that did not exist, and no one noticed this outright fabrication before publication. The New England Journal of Medicine, another top medical journal, managed to publish a similar paper; many scientists continue to heavily cite it long after its retraction.

The hottest public scientific debate of the moment—whether the COVID-19 virus was the product of natural evolution or a laboratory accident—could have been settled easily with a minimal demonstration of communalism (“communism,” actually, in the original Merton vocabulary) from China: Opening the lab books of the Wuhan Institute of Virology would have alleviated concerns immediately. Without such openness about which experiments were done, lab leak theories remain tantalizingly credible.

Personally, I don’t want to consider the lab leak theory—a major blow to scientific investigation—as the dominant explanation yet. However, if full public data-sharing cannot happen even for a question relevant to the deaths of millions and the suffering of billions, what hope is there for scientific transparency and a sharing culture? Whatever the origins of the virus, the refusal to abide by formerly accepted norms has done its own enormous damage.

The pandemic led seemingly overnight to a scary new form of scientific universalism. Everyone did COVID-19 science or commented on it. By August 2021, 330,000 scientific papers were published on COVID-19, involving roughly a million different authors. An analysis showed that scientists from every single one of the 174 disciplines that comprise what we know as science has published on COVID-19. By the end of 2020, only automobile engineering didn’t have scientists publishing on COVID-19. By early 2021, the automobile engineers had their say, too....

The author of this piece, John Ioannidis, MD, DSC, is one of the denizens of the tippy-top of the global thinking-about-medicine hierarchy. Here's part of his Stanford mini-bio:
John P.A. Ioannidis, MD, DSC, holds the C.F. Rehnborg Chair in Disease Prevention at Stanford University where he is professor of medicine, professor of health research and policy, and professor of statistics (by courtesy) at the School of Humanities and Sciences. From 1999 until 2010, Dr. Ioannidis chaired the Department of Hygiene and Epidemiology at the University of Ioannina School of Medicine in Greece. He trained at the University of Athens School of Medicine in Greece, Harvard and Tufts, and also held appointments at the U.S. National Institutes of Health, Johns Hopkins, Tufts, Harvard, and Imperial College London.

Dr. Ioannidis is one of the most-cited scientists of all times in the scientific literature. His current research at Stanford covers a wide agenda, including meta-research, large-scale evidence, population health sciences and predictive medicine and health....
And it just goes on and on. I hate him.
Possibly also of interest: