Stock Market Nirvana: Butter in Bangladesh

August 11, 2009 at 4:00 am 4 comments

Butter

Hallelulah to Jason Zweig at The Wall Street Journal for tackling the subject of data mining through his interview with David Leinweber, author of Nerds on Wall Street. All this talk about Goldman Sachs, High Frequency Trading (HFT) and quantitative models is making my head spin and distorting the true value of data modeling. Quantitative modeling should serve as a handy device in your tool-box, not a robotic “black box” solely relied on for buy and sell recommendations. As the article points out, all types of sites and trading platforms are hawking their proprietary tools and models du jour.

The problem with many of these models, even for the ones that work, is that financial market behavior and factors are constantly changing. Therefore any strategy exploiting outsized profits will eventually be discovered by other financial vultures and exploited away. As Mr. Leinweber points out, these models become meaningless if the data is sliced and diced to form manipulated relationships and predictive advice that make no sense.

Butter in Bangladesh: To drive home the shortcomings of data mining, Leinweber uses a powerful example in his book, Nerds on Wall Street, of butter production in Bangladesh. In searching for the most absurd data possible to explain the returns of the S&P 500 index, Leinweiber discovered that butter production in Bangladesh was an excellent predictor of stock market returns, explaining 75% of the variation of historical returns. The Wall Street Journal goes onto add:

By tossing in U.S. cheese production and the total population of sheep in both Bangladesh and the U.S., Mr. Leinweber was able to “predict” past U.S. stock returns with 99% accuracy.

 

For some money managers, the satirical stab Leinweber was making with the ridiculous analysis was lost in translation –  after the results were introduced Leinweber had multiple people request his dairy-sheep model. “A distressing number of people don’t get that it was a joke,” Leinweber sighed.

Super Bowl Crystal Ball: Leinweber is not the first person to discover the illogical use of meaningless factors in quantitative models. Industry observers have noticed stocks tend to perform well in years the old National Football league team wins the Super Bowl. Unfortunately, this year we had two “old” NFL teams play each other (Pittsburgh Steelers and Arizona Cardinals). Oops, I guess we need to readjust those models again.

NFL Data mining

Other bizarre studies have been done linking stock market performance to the number of nine-year-olds living in the U.S. and another linking positive stock market returns to smog reduction.

Data Mining Avoidance Rules:

1)    Sniff Test: The data results have to make sense.  Correlation between variables does not necessarily equate to causation.

2)    Cut Data into Slices: By dividing the data into pieces, you can see how robust the relationships are across the whole data set.

3)    Account for Costs: The results may look wonderful, but the model creator must verify the inclusion of all trading costs, fees, and taxes to increase confidence results will work in the real world.

4)    Let Data Brew: What looks good on paper might not work in real life. “If a strategy’s worthwhile,” Mr. Leinweber says, “then it’ll still be worthwhile in six months or a year.”

Not everyone has a PhD in statistics, however you don’t need one to skeptically ask tough questions. Doing so will help avoid the buried land mines in many quantitative models. Happy butter churning…

Wade W. Slome, CFA, CFP®

Plan. Invest. Prosper.

Read Full WSJ Article Here

See WSJ Video Interview Here

About these ads

Entry filed under: Education, Financial Markets, Trading. Tags: , , , , , , , , , , , .

V-Shaped Recovery or Road to Japan Lost Decades? “Bye Bye Roubini, Hello Abby”

4 Comments Add your own

  • [...] in quantitative models, I suggest you learn more about butter production in Bangladesh (read article here). I will eagerly watch how Mr. Greenblatt’s “Magic Formula” works from a distance. In the [...]

    Reply
  • [...] and required a $3.6 billion bailout from a consortium of banks (see also why investors get hurt and Butter in Bangladesh articles). You may be able to quantitatively rank art with some success over a specific period of [...]

    Reply
  • [...] Stock Market Nirvana: Butter in Bangladesh [...]

    Reply
  • [...] In searching for the most absurd data possible to explain the returns of the S&P 500 index, Leinweiber discovered that butter production in Bangladesh was an excellent predictor of stock market returns, explaining 75% of the variation of historical returns. By tossing in U.S. cheese production and the total population of sheep in Bangladesh, Leinweber was able to mathematically “predict” past U.S. stock returns with 99% accuracy. To read more about other financial modeling absurdities, check out a previous Investing Caffeine article, Butter in Bangladesh. [...]

    Reply

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Trackback this post  |  Subscribe to the comments via RSS Feed


Subscribe to Blog

Meet Wade Slome, CFA, CFP®

More on Sidoxia Services

Recognition

Top Financial Advisor Blogs And Bloggers – Rankings From Nerd’s Eye View | Kitces.com

Wade on Twitter…

Share this blog

Bookmark and Share

Follow

Get every new post delivered to your Inbox.

Join 1,079 other followers

%d bloggers like this: