site:climateerinvest.blogspot.com modelsOur most recent visit:
Complexity, Modeling, and Forecasting: Oxford's J. Doyne Farmer
A look at Emanuel Derman's thinking on such things
Book Review: "Models.Behaving.Badly: Why Confusing Illusion with Reality Can Lead to Disaster, on Wall Street and in Life "
And the quotes, here leading off a 2012 post:
Modelling vs. Science
A subject near and dear to our jaded hearts, some links below.
If an experiment is not reproducible it is not science.
If an hypothesis is not falsifiable it is not science.
Finally, our two guiding principles regarding models:
"The map is not the territory"
-Alfred Korzybski
"A Non-Aristotelian System and its Necessity for Rigour in Mathematics and Physics"
presented before the American Mathematical Society December 28, 1931
...................................................................................................................................................................."All models are wrong, but some are useful"
-George E.P. Box
Section heading, page 2 of Box's paper, "Robustness in the Strategy of Scientific Model Building"
(May 1979)
And the headline story from Nautil.us:
May 06, 2020
In the COVID-19 pandemic, numerous models are being used to predict the future. But as helpful as they are, they cannot make sense of themselves. They rely on epidemiologists and other modelers to interpret them. Trouble is, making predictions in a pandemic is also a philosophical exercise. We need to think about hypothetical worlds, causation, evidence, and the relationship between models and reality.1,2....MUCH MORE
The value of philosophy in this crisis is that although the pandemic is unique, many of the challenges of prediction, evidence, and modeling are general problems. Philosophers like myself are trained to see the most general contours of problems—the view from the clouds. They can help interpret scientific results and claims and offer clarity in times of uncertainty, bringing their insights down to Earth. When it comes to predicting in an outbreak, building a model is only half the battle. The other half is making sense of what it shows, what it leaves out, and what else we need to know to predict the future of COVID-19.
Prediction is about forecasting the future, or, when comparing scenarios, projecting several hypothetical futures. Because epidemiology informs public health directives, predicting is central to the field. Epidemiologists compare hypothetical worlds to help governments decide whether to implement lockdowns and social distancing measures—and when to lift them. To make this comparison, they use models to predict the evolution of the outbreak under various simulated scenarios. However, some of these simulated worlds may turn out to misrepresent the real world, and then our prediction might be off.
In his book Philosophy of Epidemiology, Alex Broadbent, a philosopher at the University of Johannesburg, argues that good epidemiological prediction requires asking, “What could possibly go wrong?” He elaborated in an interview with Nautilus, “To predict well is to be able to explain why what you predict will happen rather than the most likely hypothetical alternatives. You consider the way the world would have to be for your prediction to be true, then consider worlds in which the prediction is false.” By ruling out hypothetical worlds in which they are wrong, epidemiologists can increase their confidence that they are right. For instance, by using antibody tests to estimate previous infections in the population, public health authorities could rule out the hypothetical possibility (modeled by a team at Oxford) that the coronavirus has circulated much more widely than we think.3
One reason the dynamics of an outbreak are often more complicated than a traditional model can predict is that they result from human behavior and not just biology.Broadbent is concerned that governments across Africa are not thinking carefully enough about what could possibly go wrong, having for the most part implemented coronavirus policies in line with the rest of the world. He believes a one-size-fits-all approach to the pandemic could prove fatal.4 The same interventions that might have worked elsewhere could have very different effects in the African context. For instance, the economic impacts of social distancing policies on all-cause mortality might be worse because so many people on the continent suffer increased food insecurity and malnutrition in an economic downturn.5 Epidemic models only represent the spread of the infection. They leave out important elements of the social world.
Another limitation of epidemic models is that they model the effect of behaviors on the spread of infection, but not the effect of a public health policy on behaviors. The latter requires understanding how a policy works. Nancy Cartwright, a philosopher at Durham University and the University of California, San Diego, suggests that “the road from ‘It works somewhere’ to ‘It will work for us’ is often long and tortuous.”6 The kinds of causal principles that make policies effective, she says, “are both local and fragile.” Principles can break in transit from one place to the other. Take the principle, “Stay-at-home policies reduce the number of social interactions.” This might be true in Wuhan, China, but might not be true in a South African township in which the policies are infeasible or in which homes are crowded. Simple extrapolation from one context to another is risky. A pandemic is global, but prediction should be local.
Predictions require assumptions that in turn require evidence. Cartwright and Jeremy Hardie, an economist and research associate at the Center for Philosophy of Natural and Social Science at the London School of Economics, represent evidence-based policy predictions using a pyramid, where each assumption is a building block.7 If evidence for any assumption is missing, the pyramid might topple. I have represented evidence-based medicine predictions using a chain of inferences, where each link in the chain is made of an alloy containing assumptions.8 If any assumption comes apart, the chain might break....
