What’s the Difference Between Qualitative and Quantitative Research?

To be successful in the digital age, product teams need to deliver more value to customers faster than anyone else in the market. Doing so involves testing a number of assumptions, from strategic ones such as “what market should we enter?” to more tactical ones, such as “what features are most important to users?” Getting answers to these questions is often the difference between success and failure.

Fortunately, product teams today have a number of methodologies and tools at their disposal. There’s a major evolution happening in the way teams make decisions. In the past, teams relied exclusively on large, high-fidelity, and time consuming market research studies at the beginning of the product lifecycle. Now, the most effective product teams today, conduct research throughout the product life cycle and continuously iterate based on what they learn.

qualitative vs quantitative

According to Gregg Archibald, Partner at Gen2 Advisors and GreenBook, there are two broad types of market research studies: qualitative and quantitative. It’s important to use the right type of study to gain the insights that you need and to understand what each can and cannot achieve. Beyond that, it’s important to understand how to combine them with experimentation in a product management context in order to build solutions that customers love.

Qualitative and Quantitative Research Goals and Use Cases

difference between qualitative and quantitative research

Qualitative and quantitative research can help teams achieve different goals and are designed for different use cases.

Qualitative Market Research

Qualitative research provides insights into user pain points and perceptions. It helps decision makers gain an understanding of users’ underlying needs, motivations, and opinions.

Here are some examples of insights you can glean from qualitative research:

Qualitative market research WON’T help you decide:

Quantitative Market Research

Quantitative research quantifies problems. It’s used to measure industry trends, market sizes, and attitudes of large populations.

Here are some examples of insights you can glean from qualitative research:

Quantitative market research WON’T help you decide:

Qualitative vs Quantitative Research Studies and Methodologies

Broadly speaking, qualitative research identifies problems and explains the “why,” while quantitative research provides measurements across broader markets and customer segments. How are they conducted in practice?

Qualitative Research

Qualitative research often entails more in-depth interactions with a smaller sample size of users. The most common qualitative research methodologies include:

The output of these studies comes in the form of written responses, videos, and/or notes taken by the researcher. The decision maker then looks for patterns in the responses, cross references it with other research studies, fills in the gaps with their intuition, and draws conclusions.

Quantitative Research

Quantitative research generally provides less in-depth insights on larger populations of users.
It takes longer and costs more, but provides meaningful data on important strategic questions. Quantitative research is most commonly conducted through large scale surveys with multiple choice or scaled rating questions.

The output of these studies may include charts, graphs and figures. While quantitative research requires more upfront planning than qualitative research, it does not require as much analysis because the numbers are more tangible.

Experimentation and Market Research

qualitative and quantitative research

Qualitative and quantitative market research are important tools for product teams. Market research enlightens the organization on strategic questions such as market size and go-to-market strategy. However, modern teams also need data to inform shorter-term iterations. Experimentation introduces data to the daily decisions with which teams often struggle. Designed specifically for continuous iterations, experimentation informs teams with directional insight into distinct user preferences and behaviors.

Experimentation is different than traditional market research in two important ways.

First, it’s iterative. Experimentation provides multiple opportunities to run tests as compared to doing one large study that may or may not yield the data that you need. This enables the ability to run tests throughout the product lifecycle and iterate as consumer preferences evolve.

Second, the insights that you glean from experimentation are directional. Experimentation increases confidence for decisions that need to be made within shorter time frames. By doing so, teams can quickly identify overlooked risk and opportunities for improvement.

Experimentation provides data where there previously wasn’t any at all. Many product decisions are currently made without any data whatsoever, or are informed by what someone at a nearby Starbucks says. This data is not of sufficient quality or quantity.

Experimentation provides data for important questions such as:

Experimentation is done using techniques such as:

Such experiments enable you to test solutions and measure users behavior with the depth of qualitative research but with greater scale. Experimentation provides insights on critical product decisions and allows teams to iterate quickly. There’s less of a need for planning, which means you get more shots on goal, and faster iteration.

The challenge, however, is that despite how experimentation brings product managers closer to consumers, it’s also a new way of working. Here’s how Leonard Murphy, Partner at Gen2 Advisors and GreenBook, described this challenge, and why it’s so important for product research teams to overcome it:

Product [managers] need to be close to the consumers, that’s ultimately what their job is – to give the consumers what they will buy. So, anything that helps that process I think is inherently a good thing. Now, systemically it doesn’t fit necessarily in a way of lot of organizations have been structured in the past, but in an agile nimble type of organizational structure that’s increasingly being adopted then that ability to create tools that give the power to product managers directly is primarily a good thing. It’s different, it has its dangers, but anything that gets folks closer to the consumer experience so they can deliver a better product or a better solution for the consumer is ultimately a win win for all engaged.”

As the marketplace changes faster than ever before, and agile development becomes more prevalent, it’s critical for product teams to have the ability to make decisions quickly. Experimentation and market research are critical tools in any fast-moving organization’s tool kit.

Put our guest's advice into action.

Alpha is the world's most powerful product management platform for running experiments and generating on-demand insights.

Learn More

Subscribe to receive the latest episodes and exclusive resources

Related Episodes

168

Market Research is Product Management

Gregg Archibald and Leonard Murphy, Partners at Gen2 Advisors and GreenBook, share what product managers need to know about market research, how product managers and researchers can collaborate more effectively, and how technology is reshaping the field.

Listen to Episode
162

Discovery Research is Product Management

Alanna Ford, Innovation Product Manager at AARP, shares how she conducts user research to discover and validate new product concepts.

Listen to Episode
138

Becoming Data-Driven is Product Management

Sam Nordstrom, Product Manager at Intuit, shares how Intuit transformed into a more customer-centric company and how teams can adopt data-driven approaches.

Listen to Episode

Validate product decisions and accelerate innovation with Alpha

Learn More