Posts tagged ‘David Leinweber’
Investing in a World of Black Swans
In the world of modern finance, there has always been the search for the Holy Grail. Ever since the advent of computers, practitioners have looked to harness the power of computing and direct it towards the goal of producing endless profits. Today the buzz words being used across industries include, “AI – Artificial Intelligence,” “Machine Learning,” “Neural Networks,” and “Deep Learning.” Regrettably, nobody has found a silver bullet, but that hasn’t slowed down people from trying. Wall Street has an innate desire to try to turn the ultra-complex field of finance into a science, just as they do in the field of physics. Even banking stalwart JPMorgan Chase (JPM) and its renowned CEO/Chairman Jamie Dimon suffered billions in losses in the quest for infinite income, due in large part to their over-reliance on pseudo-science trading models.
Preceding JPM’s losses, James Montier of Grantham Mayo van Otterloo’s asset allocation team gave a keynote speech at a CFA Institute Annual Conference in Chicago, where he gave a prescient talk explaining why bad models were the root cause of the financial crisis. Montier noted these computer algorithms essentially underappreciate the number and severity of Black Swan events (low probability negative outcomes) and the models’ inability to accurately identify predictable surprises.
What are predictable surprises? Here’s what Montier had to say on the topic:
“Predictable surprises are really about situations where some people are aware of the problem. The problem gets worse over time and eventually explodes into crisis.”
When Dimon was made aware of the 2012 rogue trading activities, he strenuously denied the problem before reversing course and admitting to the dilemma. Unfortunately, many of these Wall Street firms and financial institutions use value-at-risk (VaR) models that are falsely based on the belief that past results will repeat themselves, and financial market returns are normally distributed. Those suppositions are not always true.
Another perfect example of a Black Swan created by a bad financial model is Long Term Capital Management (LTCM) – see also When Genius Failed. Robert Merton and Myron Scholes were world renowned Nobel Prize winners who single-handedly brought the global financial market to its knees in 1998 when LTCM lost $500 million in one day and required a $3.6 billion bailout from a consortium of banks. Their mathematical models worked for a while but did not fully account for trading environments with low liquidity (i.e., traders fleeing in panic) and outcomes that defied the historical correlations embedded in their computer algorithms. The “Flash Crash” of 2010, in which liquidity evaporated due to high-frequency traders temporarily jumping ship, is another illustration of computers wreaking havoc on the financial markets.
The problem with many of these models, even for the ones that work in the short-run, is that behavior and correlations are constantly changing. Therefore any strategy successfully reaping outsized profits in the near-term will eventually be discovered by other financial vultures and exploited away.
Another pundit with a firm hold on Wall Street financial models is David Leinweber, author of Nerds on Wall Street. As Leinweber points out, financial models become meaningless if the data is sliced and diced to form manipulated and nonsensical relationships. The data coming out can only be as good as the data going in – “garbage in, garbage out.”
In searching for the most absurd data possible to explain the returns of the S&P 500 index, Leinweiber discovered that butter production in Bangladesh was an excellent predictor of stock market returns, explaining 75% of the variation of historical returns. By tossing in U.S. cheese production and the total population of sheep in Bangladesh, Leinweber was able to mathematically “predict” past U.S. stock returns with 99% accuracy. To read more about other financial modeling absurdities, check out a previous Investing Caffeine article, Butter in Bangladesh.
Generally, investors want precision through math, but as famed investor Benjamin Graham noted more than 50 years ago, “Mathematics is ordinarily considered as producing precise, dependable results. But in the stock market, the more elaborate and obtuse the mathematics, the more uncertain and speculative the conclusions we draw therefrom. Whenever calculus is brought in, or higher algebra, you can take it as a warning signal that the operator is trying to substitute theory for experience.”
If these models are so bad, then why do so many people use them? Montier points to “intentional blindness,” the tendency to see what one expects to see, and “distorted incentives” (i.e., compensation structures rewarding improper or risky behavior).
Montier’s solution to dealing with these models is not to completely eradicate them, but rather recognize the numerous shortcomings of them and instead focus on the robustness of these models. Or in other words, be skeptical, know the limits of the models, and build portfolios to survive multiple different environments.
Investors seem to be discovering more financial Black Swans over the last few years in the form of events like the Lehman Brothers bankruptcy, Flash Crash, and Greek sovereign debt default. Rather than putting too much faith or dependence on bad financial models to identify or exploit Black Swan events, the over-reliance on these models may turn this rare breed of swans into a large bevy.
See Full Article on Montier: Failures of Modern Finance
Wade W. Slome, CFA, CFP®
Plan. Invest. Prosper.
DISCLOSURE: Sidoxia Capital Management (SCM) and some of its clients own JPM and certain exchange traded funds, but at the time of publishing SCM had no direct position in Lehman Brothers, or any other security referenced in this article. No information accessed through the Investing Caffeine (IC) website constitutes investment, financial, legal, tax or other advice nor is to be relied on in making an investment or other decision. Please read disclosure language on IC “Contact” page.
Investing in a World of Black Swans
In the world of modern finance, there has always been the search for the Holy Grail. Ever since the advent of computers, practitioners have looked to harness the power of computing and direct it towards the goal of producing endless profits. Regrettably, nobody has found the silver bullet, but that hasn’t slowed down people from trying. Wall Street has an innate desire to try to turn the ultra-complex field of finance into a science, just as they do in the field of physics. Even JPMorgan Chase (JPM) and its CEO Jamie Dimon are already on their way to suffering more than $2 billion in losses in the quest for infinite income, due in large part to their over-reliance on pseudo-science trading models.
James Montier of Grantham Mayo van Otterloo’s asset allocation team was recently a keynote speaker at the CFA Institute Annual Conference in Chicago. His prescient talk, which preceded JP Morgan’s recent speculative trading loss announcement, explained why bad models were the root cause of the financial crisis. Essentially these computer algorithms under-appreciate the number and severity of Black Swans (low probability negative outcomes) and the models’ inability to accurately identify predictable surprises.
What are predictable surprises? Here’s what Montier had to say on the topic:
“Predictable surprises are really about situations where some people are aware of the problem. The problem gets worse over time and eventually explodes into crisis.”
Just a month ago, when Dimon was made aware of the rogue trading activities, the CEO strenuously denied the problem before reversing course and admitting the dilemma last week. Unfortunately, many of these Wall Street firms and financial institutions use value-at-risk (VaR) models that are falsely based on the belief that past results will repeat themselves, and financial market returns are normally distributed. Those suppositions are not always true.
Another perfect example of a Black Swan created by a bad financial model is Long Term Capital Management (LTCM). Robert Merton and Myron Scholes were world renowned Nobel Prize winners who single handedly brought the global financial market to its knees in 1998 when LTCM lost $500 million in one day and required a $3.6 billion bailout from a consortium of banks. Their mathematical models worked for a while but did not fully account for trading environments with low liquidity (i.e., traders fleeing in panic) and outcomes that defied the historical correlations embedded in their computer algorithms. The “Flash Crash” of 2010, in which liquidity evaporated due to high frequency traders temporarily jumping ship, is another illustration of computers wreaking havoc on the financial markets.
The problem with many of these models, even for the ones that work in the short-run, is that behavior and correlations are constantly changing. Therefore any strategy successfully reaping outsized profits in the near-term will eventually be discovered by other financial vultures and exploited away.
Another pundit with a firm hold on Wall Street financial models is David Leinweber, author of Nerds on Wall Street. As Leinweber points out, financial models become meaningless if the data is sliced and diced to form manipulated and nonsensical relationships. The data coming out can only be as good as the data going in – “garbage in, garbage out.”
In searching for the most absurd data possible to explain the returns of the S&P 500 index, Leinweiber discovered that butter production in Bangladesh was an excellent predictor of stock market returns, explaining 75% of the variation of historical returns. By tossing in U.S. cheese production and the total population of sheep in Bangladesh, Leinweber was able to mathematically “predict” past U.S. stock returns with 99% accuracy. To read more about other financial modeling absurdities, check out a previous Investing Caffeine article, Butter in Bangladesh.
Generally, investors want precision through math, but as famed investor Benjamin Graham noted more than 50 years ago, “Mathematics is ordinarily considered as producing precise, dependable results. But in the stock market, the more elaborate and obtuse the mathematics, the more uncertain and speculative the conclusions we draw therefrom. Whenever calculus is brought in, or higher algebra, you can take it as a warning signal that the operator is trying to substitute theory for experience.”
If these models are so bad, then why do so many people use them? Montier points to “intentional blindness,” the tendency to see what one expects to see, and “distorted incentives” (i.e., compensation structures rewarding improper or risky behavior).
Montier’s solution to dealing with these models is not to completely eradicate them, but rather recognize the numerous shortcomings of them and instead focus on the robustness of these models. Or in other words, be skeptical, know the limits of the models, and build portfolios to survive multiple different environments.
Investors seem to be discovering more financial Black Swans over the last few years in the form of events like the Lehman Brothers bankruptcy, Flash Crash, and Greek sovereign debt default. Rather than putting too much faith or dependence on bad financial models to identify or exploit Black Swan events, the over-reliance on these models may turn this rare breed of swans into a large bevy.
See Full Article on Montier: Failures of Modern Finance
Wade W. Slome, CFA, CFP®
Plan. Invest. Prosper.
DISCLOSURE: Sidoxia Capital Management (SCM) and some of its clients own certain exchange traded funds, but at the time of publishing SCM had no direct position in JPM, Lehman Brothers, or any other security referenced in this article. No information accessed through the Investing Caffeine (IC) website constitutes investment, financial, legal, tax or other advice nor is to be relied on in making an investment or other decision. Please read disclosure language on IC “Contact” page.
Stock Market Nirvana: Butter in Bangladesh
Hallelulah to Jason Zweig at The Wall Street Journal for tackling the subject of data mining through his interview with David Leinweber, author of Nerds on Wall Street. All this talk about Goldman Sachs, High Frequency Trading (HFT) and quantitative models is making my head spin and distorting the true value of data modeling. Quantitative modeling should serve as a handy device in your tool-box, not a robotic “black box” solely relied on for buy and sell recommendations. As the article points out, all types of sites and trading platforms are hawking their proprietary tools and models du jour.
The problem with many of these models, even for the ones that work, is that financial market behavior and factors are constantly changing. Therefore any strategy exploiting outsized profits will eventually be discovered by other financial vultures and exploited away. As Mr. Leinweber points out, these models become meaningless if the data is sliced and diced to form manipulated relationships and predictive advice that make no sense.
Butter in Bangladesh: To drive home the shortcomings of data mining, Leinweber uses a powerful example in his book, Nerds on Wall Street, of butter production in Bangladesh. In searching for the most absurd data possible to explain the returns of the S&P 500 index, Leinweiber discovered that butter production in Bangladesh was an excellent predictor of stock market returns, explaining 75% of the variation of historical returns. The Wall Street Journal goes onto add:
By tossing in U.S. cheese production and the total population of sheep in both Bangladesh and the U.S., Mr. Leinweber was able to “predict” past U.S. stock returns with 99% accuracy.
For some money managers, the satirical stab Leinweber was making with the ridiculous analysis was lost in translation – after the results were introduced Leinweber had multiple people request his dairy-sheep model. “A distressing number of people don’t get that it was a joke,” Leinweber sighed.
Super Bowl Crystal Ball: Leinweber is not the first person to discover the illogical use of meaningless factors in quantitative models. Industry observers have noticed stocks tend to perform well in years the old National Football league team wins the Super Bowl. Unfortunately, this year we had two “old” NFL teams play each other (Pittsburgh Steelers and Arizona Cardinals). Oops, I guess we need to readjust those models again.
Other bizarre studies have been done linking stock market performance to the number of nine-year-olds living in the U.S. and another linking positive stock market returns to smog reduction.
Data Mining Avoidance Rules:
1) Sniff Test: The data results have to make sense. Correlation between variables does not necessarily equate to causation.
2) Cut Data into Slices: By dividing the data into pieces, you can see how robust the relationships are across the whole data set.
3) Account for Costs: The results may look wonderful, but the model creator must verify the inclusion of all trading costs, fees, and taxes to increase confidence results will work in the real world.
4) Let Data Brew: What looks good on paper might not work in real life. “If a strategy’s worthwhile,” Mr. Leinweber says, “then it’ll still be worthwhile in six months or a year.”
Not everyone has a PhD in statistics, however you don’t need one to skeptically ask tough questions. Doing so will help avoid the buried land mines in many quantitative models. Happy butter churning…
Wade W. Slome, CFA, CFP®
Plan. Invest. Prosper.