Levers for Capturing a Simulation Advantage
A company achieves a simulation advantage by establishing a system and culture that promote experimentation. Consider Intuit, the U.S.-based software company, which has embraced an aggressively experimental approach to business. By doing so, it has raised the number of new-product launches from an average of five per year in the ten years leading up to 2003 to 31 in 2009 alone, thereby generating significant new streams of revenue.
Companies can employ six levers for improving their experimental effectiveness.
Generate and capture ideas at greater speed and lower cost. Some companies are finding new ways to unleash collaboration among employees and customers to generate a continuous and rich supply of new ideas. Royal Dutch Shell’s GameChanger unit uses an online collaboration portal, workshops, and relationships with universities to gather ideas from contributors both inside and outside the company. A team of ten Shell professionals review the ideas and grant the best ones up to $25,000 in initial funding for development into investment proposals. These proposals are then assessed by project-specific panels, which can allocate more substantial funding from set-aside budgets. So far, GameChanger has evaluated more than 3,000 ideas from its submission teams. Roughly 70 percent of the ideas chosen for development involve at least one individual from outside Shell. GameChanger projects, which have generated a significant volume of patents, are most often picked up for further development in R&D but are also spun off into successful businesses or licenses to other companies. Royal Dutch Shell estimates that it has invested $250 million in GameChanger projects to date.
Make the process of experimentation faster and less expensive. Some companies have decreased the costs of physical prototyping and testing by creating “virtual worlds” in which they test products and ideas. Such environments make it possible to set up, modify, expand, and rapidly execute experiments at much lower cost. Kimberly-Clark, for example, has reduced the cost of testing new ideas before they are scaled up by using a 3-D virtual store to gauge consumer and customer reactions to new products, shelf layouts, and packaging.
Increase the volume of experiments. Virtual worlds have no capacity limit and therefore allow for a thorough exploration of possibilities. They enable companies to gain richer insights by increasing the number of variables tested or by running more tests in parallel. Amazon.com is able to test numerous page variants on different groups of consumers and track their resulting behavior. If the impact of a potential new feature is statistically significant, Amazon promptly incorporates it into its mainstream model. For example, the company ran a large number of experiments examining how the order of search results affected purchases. It then optimized its search results so that the items most likely to be of interest to consumers were listed first. The payoff was a 3 percent increase in sales. Despite the fact that half its experiments “fail,” Amazon promotes continuous experimentation to ensure that it doesn’t miss any break-through opportunities.
Lower the cost of failure. Real-world experiments can damage a brand or threaten supplier or customer relationships when they fail. Some companies have reduced this risk by switching to online testing or soft launches in friendly communities. The European telecommunications company Orange, for example, uses its online platform to interact with 30,000 Lab Explorers—customers who contribute to the company’s innovations. Orange mines the input of this community at multiple points in the development process using a suite of methodologies, including cocreation workshops, surveys, and usability testing. The results enable offerings to be refined before they are broadly released. Through hundreds of such experiments, Orange has consistently improved its “simplicity score”—an aggregate indicator of how likely consumers are to use and appreciate a product—resulting in improved marketplace performance and customer satisfaction.
Enhance predictive power. Companies can use virtual experimentation to capture a broader range of behavioral data with greater accuracy and without the “rationalization biases” associated with traditional perception-based market research. Such experiments improve the accuracy of predictions by providing a view of customer behavior not just at the point of purchase but before and after as well. Companies can also improve the predictive value of experimentation through the use of prediction markets, which collect, aggregate, and track many individual predictions of success.
Consider Best Buy’s online prediction market, TagTrade. More than 2,000 people participate in this virtual stock market by trading stocks on variables ranging from launch dates to sales estimates. Since its inception, TagTrade has consistently beaten the company’s internal estimates by a significant margin.
Accelerate learning and scale-up. Companies with a simulation advantage are able to scale up and deploy successful experiments more rapidly and comprehensively than their competitors can. Some do it by sharing information on successes through online knowledge platforms or virtual training. Others use the business itself as a vehicle for parallel piloting of new ideas. Wal-Mart, for example, tests different layouts in its own stores as a regular part of its operating model. Traffic patterns and sales impact are measured for each layout, and the most successful designs are rolled out across the country.