Why Business Schools Need to Teach Experimentation

Significant changes in the way businesses make decisions are happening. Traditionally, experiments and scientific experiments were the domain of scientists, but managers in all industries used experimental traditions to inform their decisions on an unprecedented scale.

In Microsoft Bing, for example, about 80% of product changes are initially tested as a controlled test. EBay now saves billions of dollars a year from advertising because of simple internal research, which shows that buying paid search ads was not profitable. Google conducts tests to determine which interview questions may be relevant to the job, and measures students' responses to those questions.

The combination of the availability of large amounts of consumer data and improved computer power, as well as the fact that it is easier and cheaper to do random participants than ever before, have created ideal conditions for the rise of so-called “experimental change” in business. . As businesses increasingly seek concrete data to inform their decisions through practical tests, MBA programs need to do more to equip future leaders with the necessary skills.

Test Case

The number of tests in non-scientific organizations is very high. Instead of calling on supervisors to resolve any complex or minor issue (Should we make the background yellow or blue? Should we improve basic functionality or add new features? Are staff members properly supported and motivated to provide quick responses?), Teams can run? evaluate and evaluate the effects of interest and, armed with new data, decide for itself, or at least prioritize a proposal based on relevant information. The data also provides visual cues to show participants to show progress and accountability.

Exploration promotes new invention. They can provide proof of concept and level of confidence in new ideas before taking major risks and raising standards. Properly covered, it will withstand a great deal of adverse conditions. The scientific method (empowering tests) is the gold standard for anti-bias tools and honest questions.

But as more and more companies adopt a culture of experimentation, they face a major challenge: talent. Testing is hard to do well. Other challenges include special mathematical knowledge, a clear definition of the problem, and an explanation of the results. And it is not enough to have a set of skills. The assessment should be repeated, building on previous knowledge and working on a deeper understanding of the existing question. There are also issues of managers' readiness to override their sense of understanding when data is inconsistent, as well as their ability to navigate positions and management to implement changes based on test results.

Some companies seem to be recruiting smaller armies of PhDs to address these skills challenges. (Amazon, for example, employs more than 100 PhD economists.) This is not surprising, given that PhDs receive years of training - and the deteriorating academic teure-track market has created a myriad of PhDs. Some companies provide housing developers, training them in intensive, industrialized ways. For example, General Mills recently hired their own innovator incubator team, called g-works, to advertise employees who “use business skills and intelligence” in what they call a testing and learning environment, with rapid testing to ensure or not work. imagined. ” Other companies - including Fidelity, LinkedIn, and Aetna - have hired experts to perform the tests, among them Irrational Labs, founded by Dan Ariely of Duke University and ethics economist Kristen Berman.

The important thing is that companies today are looking for someone who can do everything - design and test, be able to read numbers to interpret results, use their interpersonal skills to make data-driven change, and be motivated and visionary enough to lead. the culture of exploration. These skills, which are the core of what business students should know when they graduate, want to be trained in testing and the science approach. But business schools do not place such training at the core of their curriculum. What can they do differently?

Using Experiments in Business Schools

Some business schools teach limited testing. Professionals who teach marketing courses, for example, often cover basic A / B test forms (e.g., analyzing whether an ad compared to a public service ad leads to more product purchases and whether the ad campaign was a good investment).

Enjoyed this article? Stay informed by joining our newsletter!

Comments

You must be logged in to post a comment.

About Author