Gain from the pain of failure

From an FT Magazine feature on “Ten Ideas that will reshape business
Failure has always been a fundamental part of a market economy. When markets work, they do so because new ideas are constantly being tried out. Most fail. Those that succeed cause older ideas to fail instead. In the US, about 10 per cent of businesses disappears each year. This is an awkward insight – but trial and error could be starting to take its rightful place as a business technique, rather than the dirty little secret of capitalism.

There are some hopeful signs. Stefan Thomke of Harvard Business School has argued that advances in computation have made it possible to experiment on new products as a matter of course, trying many things and expecting many failures. It is now easy, for example, to experiment with changes in the layout of a website, showing different configurations to different visitors and tracking results in real time. Google, meanwhile, routinely launches new products with a “beta” label on them. And academic superstars such as Steven Levitt, co-author of Freakonomics, have been teaching executive courses in business experimentation.

We are also starting to learn more about the psychology of learning from mistakes. Richard Thaler, the behavioural economist behind Nudge, coined the phrase “hedonic editing” to describe our habit of lumping small losses together with larger gains in order to mask the pain of the loss. Sugar-coating is human, but it’s also a recipe for failing to learn from failure. Thaler, with colleagues, even studied the behaviour of contestants on Deal or No Deal. He discovered that people who had made unlucky choices then started to take reckless risks, which often compounded the error.

It’s hard to learn from failure if it briefly robs us of our judgment. As we start to understand why trial and error is so painful a process, we may be able to use it more constructively. The financial crisis has made us aware that a system that cannot tolerate a bit of failure is a dangerous one. The idea that an institution was “too big to fail” used to sound reassuring. Not any more.

The Undercover Economist: a guide

Publishing schedule: Excerpts from "The Undercover Economist" and "Dear Economist", Tim's weekly columns for the FT Magazine, are published on this blog on Saturday mornings.
More about Tim: Tim also writes editorials for the FT, presents Radio 4's More or Less and is the author of "The Undercover Economist" and "The Logic of Life".
Comment: To comment, please register with FT.com, which you can do for free here. Please also read our comments policy here.
Contact: Tim's contact address is: economist@ft.com
Time: UK time is shown on posts.
Follow: A link to the blog's RSS feeds is at the top of the page.
Follow on Twitter
FT blogs: See the full range of the FT's blogs here.