The writer, Justina Lee has obviously done her homework.
From Bloomberg, August 20:
Wall Street quants and leading financial academics are clashing over whether artificial intelligence has upended one of the core principles of systematic investing.
Quant traders, who use rules-based strategies derived from data analysis, have long believed their models get less effective when they become too complicated. That’s because they suck in too much of the distortive noise that makes predicting markets such a challenge in the first place.
But a researcher at AQR Capital Management has sparked a backlash with a study claiming the opposite — that rather than being a liability, bigger and more complex models might offer advantages in finance. The paper, titled The Virtue of Complexity in Return Prediction, showed that a US stock market trading strategy trained on more than 10,000 parameters and just a year of data beat a simple buy-and-hold benchmark.
“This idea of preferring small, parsimonious models is a learned bias,” said Bryan Kelly, head of machine learning at AQR and one of the paper’s three authors. “All of us are on a day-to-day basis using these large language models that were revolutionary in their success because of this push toward extraordinarily large parameterizations.”
The research has triggered a heated debate since it was published in the prestigious Journal of Finance last year, among both peers in the quant industry and those in related academic circles.
At least six papers, including from scholars at Oxford University and Stanford University, have now challenged its findings. Some argue the Virtue of Complexity study has a questionable design that renders it irrelevant for live trading. Others say it’s less cutting-edge than it appears anyway. (Kelly has subsequently written a defense.)
Among the most notable critics is Stefan Nagel, a finance professor at the University of Chicago — the very school where two of AQR’s founders met and where the firm’s original investment philosophy took shape. His first reaction? “I found the empirical results hard to believe,” he said.
After digging into the details of the Virtue of Complexity study, Nagel concluded that because the model was dissecting just 12 months of data, it was simply copying signals that had worked more recently. In other words, it was following a momentum strategy — a well-established trading approach.
“It’s not because the approach learned from the data that this effect is there,” Nagel said. “It’s because they did something mechanical implicitly, and this mechanical thing happened to work well by luck.”
Jonathan Berk, a Stanford economist who was among the first and fiercest critics of the Virtue of Complexity paper, called it “virtually useless” for aiming at predictions that tell you nothing about what drives asset returns. Daniel Buncic at the Stockholm Business School said the study makes some obviously wrong design choices to reach its conclusions.
Co-written with Semyon Malamud at EPFL in Switzerland and Kangying Zhou at Yale University, the Virtue of Complexity paper has provoked this response because it challenges a long-held assumption about forecasting financial markets.
While modern AI can perform remarkable tasks like telling cats from dogs in an image, that’s because it can learn from a massive supply of photos, and because animals have defined and unchanging features. In contrast, stocks provide an inherently limited amount of data (especially for slower-moving strategies that may only trade once a month), and each can be swayed by countless different forces.
The fear has always been overfitting — that complex models will learn from all the noise in historical data, much of which may not apply in future trading. So quants have traditionally relied on relatively simple insights, like the famous Fama-French three-factor model (which analyzes returns based on each company’s size, valuation and relationship with the broader market).
AQR itself was built on such so-called factors, which aim to outperform over long stretches of time. It is only in recent years that the $146 billion money manager has raised capital for machine-learning strategies and said not all trading signals have to be backed by economic theory. Kelly’s main contention is that traditional quant models are so simple they under-fit, producing inferior forecasts, while sufficiently complex models actually learn not to overfit too much....
....MUCH MORE
Here's Quote Investigator digging into the history of the line "That Works Very Well in Practice, But How Does It Work In Theory?"
And some previous visits with the Quantfather:
- Cliff Asness’s AQR Staff Built Him A Robot Warren Buffett (BRK.B)
- UPDATED--Cliff Asness vs. Paul Krugman: Let's Get Ready To Rumble
- Let's Get Ready To Rumble II: Paul Krugman Responds to Cliff Asness
- Asness' AQR to Launch First Catastrophe Bond Fund Strategy
- The Last Word On Asness' Alpha, Buffet's Beta and The Failure of Commodity Quants (and how to turn hyperlinks into footnotes)
- Testing Small-batch Artisanal Portfolio Construction With Cliff Asness and Grantham, Mayo's James Montier
- "Capitalisn’t: Why Cliff Asness Believes Markets Are Getting Dumber"
Many more, including the Asness - Arnott dustup. Use the 'Search blog' box upper left if interested.
