The Ruby Cha Cha Guide to Quantitative Research

1. WHAT IS QUANTITATIVE MARKET RESEARCH?

Quantitative research is a systematic investigation that focuses on quantifying data and uncovering patterns. By using numerical data, statistical techniques and structured methodologies, this approach helps businesses make evidence-based decisions.

SIGNIFICANCE — WHAT PROBLEMS DOES QUANTITATIVE MARKET RESEARCH SOLVE?

• Understanding Market Trends: It identifies consumer behaviours and emerging market opportunities based on current market information.
• Making Informed Decisions: Data-driven insights reduce risk and improve strategic outcomes, for instance why is my brand in decline and how big is the size of the market that we wish to enter?
• Finding out who your Target Audience is: Many businesses are unclear about who they are targeting and the size of their audience. Quantitative research can provide clarification and potentially reveal new audiences of interest.
• Validating Hypotheses: Testing assumptions with large-scale data enhances accuracy. This provides confidence in choices and assists with planning.

WHAT ARE THE ADVANTAGES OF QUANTITATIVE MARKET RESEARCH?

There are several benefits to using a quantitative approach in your research efforts:

• Scalability — Easily collect large volumes of data from diverse audiences.
• Objectivity — Reduces researcher bias by focusing on measurable results.
• Predictive Power — Allows for modelling and forecasting using historical and current data.
• Efficiency — Quicker to collect, analyse, and act on than many qualitative methods.
• Comparability — Enables year-on-year benchmarking and tracking across markets.

WHAT ARE THE DIFFERENCES BETWEEN QUANTITATIVE MARKET RESEARCH AND QUALITATIVE?

Quantitative market research focuses on numerical data and statistical analyses, while qualitative research explores deeper, contextual insights through interviews, focus groups and open-ended questions. The two are often complementary, offering a holistic view of consumer behaviours and market conditions.

In practice, the two approaches often work best together. Quantitative research provides the statistical confidence needed to make business-wide decisions, while qualitative research reveals the motivations and emotions behind the numbers. Experienced researchers know when to use each, how to integrate findings and how to turn both into actionable strategies.

2. WHAT ARE SOME BEST PRACTICES IN QUANTITATIVE RESEARCH?

Quantitative market research is all about giving you and your business the confidence to make decisions. Whilst many businesses attempt to do their own surveys, a market research agency is really needed to ensure that you are asking the right questions, in the right way and transform them into a well-curated time efficient survey that connects your business with the market and consumer in detail.

HOW DO YOU ENSURE DATA QUALITY?

Data quality is especially important to ensure you have replicable results. When thinking about any data led project it is critical to:

1. Design clear, unambiguous questions to gather accurate insights.
2. Use representative sampling methods to ensure your findings are generalisable.
3. Employ robust statistical techniques to analyse data.

Sometimes, it is appropriate for a ‘quick and dirty’ option to give indicative results, which may mean leaning on data that is not standardised, unclean samples from social media or other sources, however wherever possible is of utmost importance to the credibility of the research outputs to ensure that data quality is clean and safe.

ETHICAL CONSIDERATIONS

Australia has clear privacy rules, and the market research industry follows these studiously to:

1. Protect respondent anonymity and confidentiality.
2. Obtain informed consent for participation.
3. Avoid deceptive practices in survey design or interpretation.

The Research Society has clear guidelines on ethics and standards in market research with fact sheets and information.

HOW CAN I REPORT AND INTERPRET RESULTS?

No one wants to read a telephone book (whatever they are anymore). Best practice quantitative market research is parsimonious (meaning it has tight boundaries to ensure efficiencies and economies of time and money) and actionable (meaning the results can be adopted and implemented immediately.

All quantitative reporting should:

1. Present findings clearly using visuals like charts and graphs with scales outlined, and colour coding blocks included.
2. Highlight actionable insights for stakeholders in a set of summary recommendations and preferably an executive overview.
3. Discuss any limitations of the research findings to provide a balanced perspective and allow future research and methodologies to potentially overcome these limitations.

3. SAMPLING IN QUANTITATIVE MARKET RESEARCH

WHY IS SAMPLING IMPORTANT?

Sampling involves selecting a subset of individuals from a population to represent the whole. It is crucial in market research because it allows researchers to gather insights about a target population efficiently and cost-effectively.

Here are the key reasons why sampling is important:

Here are the key reasons why sampling is important:

1. Cost Efficiency

• • Surveying an entire population is often too expensive and resource-intensive. Sampling enables researchers to study a smaller, manageable group while still obtaining meaningful results.

2. Time Efficiency

• • Collecting data from a sample is faster than attempting to gather information from an entire population. This is especially important when timely decisions are needed.

3. Feasibility

• • In many cases, it is impractical or impossible to collect data from every individual in the target population (e.g., for large or geographically dispersed populations). Sampling provides a practical alternative.

4. Accuracy and Reliability

• • A well-chosen sample can provide data that closely represents the broader population, ensuring accurate and reliable insights. This depends on using appropriate sampling methods and sample sizes.

5. Scalability

• • Sampling enables researchers to test and refine methodologies on a smaller scale before scaling up to broader studies or larger populations.

6. Focus on Target Audiences

• • Sampling allows researchers to focus on specific segments of the population, such as age groups, professions, or lifestyles, ensuring that insights are relevant to the objectives of the quantitative market research.

7. Minimised Data Overload

• • Handling data from an entire population can lead to overwhelming amounts of information, which may be difficult to analyse effectively. Sampling streamlines the data collection process and focuses only on the most critical data.

8. Enables Hypothesis Testing

• • By working with a sample, researchers can test hypotheses and generalise findings to the larger population, provided the sample is representative.

9. Mitigation of Response Bias

• • In some cases, a smaller, well-defined sample can help reduce response bias, as it allows for better control over the data collection process.

For market research to be effective, it’s essential that the sample is carefully designed to be representative of the target population. This involves choosing the right sampling methods (e.g., random sampling, stratified sampling) and determining the appropriate sample size to balance accuracy with practical constraints.

WHAT ARE THE TYPES OF SAMPLING METHODS?

Probability Sampling:

• Every individual has an equal chance of selection.
• Methods include simple random sampling and stratified sampling.

Non-Probability Sampling:

• Participants are chosen based on convenience or judgement.
• Useful for exploratory research.

WHAT IS NAT REP SAMPLING?

Definition: This refers to a sampling method designed to ensure that the participants in a study accurately reflect the demographics of the broader national population. The sample is structured to match proportions based on key variables such as age, gender, location, income, education, ethnicity, or other relevant factors depending on the context.

Applications: Nat Rep sampling provides insights that are generalisable across broader markets. To apply Nat Rep Sampling, start by identifying the population you want to represent and gathering national demographic data (e.g., age, gender, location). Decide on your sample size and use a method like stratified or quota sampling to recruit participants in proportions that match the national population. Monitor your sample during recruitment to ensure it aligns with the target demographics, and if some groups are underrepresented, adjust strategies or use statistical weighting during analysis to correct any imbalances. This ensures your results accurately reflect the broader population.

NICHE SAMPLING STRATEGIES

Niche sampling methods target specific populations to uncover unique insights. For example, luxury product consumers or specific geographic regions. In healthcare this is often doctors and specialists or patients with unique health issues.

4. WHAT IS A/B TESTING?

A/B testing, also known as split testing, compares two versions of a variable (e.g., an ad or landing page) to determine which performs better. This method optimises conversions and improves user experiences.

GUIDELINES FOR EFFECTIVE A/B TESTING

1. Test one variable at a time to isolate its impact.
2. Randomise sample groups for unbiased results.
3. Use statistical tools to verify significance.

WHAT ARE SOME VARIABLES TO TEST IN A/B TESTING?

• Landing Pages: Headline, layout, images.
• Call-to-Actions (CTAs): Size, colour, placement.
• Email Campaigns: Subject lines, send times and content length to optimise open and click-through rates.
• Ad Creative: Visuals, copy variations and audience targeting to identify the highest-performing combinations.
• Pricing and Offers: Different price points or discount structures to measure impact on conversions and perceived value.

CASE STUDY: OPTIMISING CONVERSION RATES THROUGH A/B TESTING

A financial services company improved click-through rates by 20% by testing variations of call-to-action buttons. Further testing of page layouts resulted in a 15% increase in lead generation.

5. WHAT IS BRAND HEALTH?

Brand health measures the overall perception, loyalty, and equity of a brand. It is critical to measure your brand health to understand marketing effectiveness. Brand Health encompasses metrics like awareness, favourability, and net promoter scores (NPS) but is much broader than all of this. Some of the key measures and uses include:

BRAND AWARENESS — HOW WELL DO CUSTOMERS KNOW YOUR BRAND?

• Surveys: Measure aided and unaided brand recall.
• Search Volume Trends: Analyse branded search queries using tools like Google Trends.
• Social Media Listening: Track mentions and hashtags related to your brand.

BRAND PERCEPTION — WHAT DO PEOPLE THINK ABOUT YOUR BRAND?

• Sentiment Analysis: Use AI tools to analyse the sentiment of online mentions, reviews, and social media discussions.
• Net Promoter Score (NPS): Measures customer willingness to recommend your brand.
• Customer Reviews and Ratings: Monitor feedback on platforms like Google Reviews, Amazon, etc.

BRAND EQUITY — WHAT DOES YOUR BRAND OWN AND HOW MUCH?

• Brand Association Surveys: Evaluate what attributes people associate with your brand.
• Price Premium: Assess if consumers are willing to pay more for your brand versus competitors.
• Customer Loyalty Metrics: Measure repeat purchase rates and retention rates.

BRAND ENGAGEMENT — HOW CONNECTED ARE CUSTOMERS TO YOUR BRAND?

• Social Media Metrics: Track likes, shares, comments, and followers.
• Website Analytics: Monitor metrics like bounce rate, average time on site, and return visitors.
• Email Marketing Metrics: Open rates, click-through rates, and subscription growth.

BRAND CONSIDERATION — HOW LIKELY ARE CUSTOMERS TO CHOOSE YOUR BRAND?

• Purchase Intent Surveys: Measure whether customers are considering buying your brand.
• Conversion Rate: Evaluate how many people take the desired action after interacting with your brand.
• Market Share Analysis: Compare your brand’s sales volume or revenue to competitors.

CUSTOMER SATISFACTION — HOW SATISFIED AND LOYAL ARE YOUR CUSTOMERS?

• Customer Satisfaction Score (CSAT): Measures how satisfied customers are with your brand or specific products.
• Customer Feedback Surveys: Collect insights from post-purchase or service interactions.

BRAND ADVOCACY — HOW LIKELY ARE YOUR CUSTOMERS TO RECOMMEND YOUR BRAND?

• NPS: Net Promoter Score measures how likely customers are to recommend the brand to others. Can be used internally for employees as well
• Customer Advocacy Rate: Measure the proportion of customers who actively promote your brand.
• User-Generated Content: Track the volume and quality of content created by customers, such as reviews, photos, or testimonials.

COMPETITIVE BENCHMARKING — WHAT IS YOUR BRAND’S SHARE OF VOICE?

• Share of Voice (SOV): Compare your brand’s online mentions to competitors.
• Brand Performance Benchmarks: Assess how your brand performs relative to industry norms.

BRAND DIFFERENTIATION — WHAT DIFFERENTIATES YOU FROM COMPETITORS?

• Unique Selling Proposition (USP) Analysis: Test whether customers perceive your brand as distinct from competitors.
• Competitor Surveys: Ask customers what makes your brand different.

BRAND CONSISTENCY — WHAT DRIVES TRUST IN YOUR BRAND?

• Visual Identity Audits: Check whether branding (logo, colours, fonts) is consistent across all touchpoints.
• Message Consistency: Evaluate if the brand messaging aligns with your core values.

SOCIAL RESPONSIBILITY AND ETHICS — HOW DOES YOUR BRAND STACK UP?

• Sustainability Metrics: Measure consumer perception of your environmental and social impact.
• Ethical Brand Indexes: Participate in independent assessments of corporate social responsibility (CSR).

SHAREHOLDER AND STAKEHOLDER SENTIMENT — HOW MUCH TRUST DO INVESTORS AND PARTNERS HAVE IN YOUR BRAND?

• Investor Confidence Surveys: Measure stakeholder trust in the brand.
• Public Relations Metrics: Analyse media coverage tone and alignment with brand goals.

To get a comprehensive understanding of brand health, it’s best to combine quantitative methods (e.g., surveys, metrics) with qualitative insights (e.g., focus groups, interviews). Regular monitoring ensures you can proactively address weaknesses and capitalise on strengths to maintain a strong market presence.

CASE STUDY: IMPLEMENTING BRAND HEALTH TRACKING FOR A NICHE BRAND

A niche skincare brand used brand health tracking to measure awareness and loyalty. Insights revealed opportunities to enhance messaging, resulting in a 10% increase in market share within six months.

CASE STUDY: GLOBAL BRAND HEALTH TRACKING IN THE SPIRITS CATEGORY

A spirit brand tracked brand health across multiple regions. Data-driven insights informed targeted campaigns, leading to a 25% increase in customer retention.

6. WHAT IS CONCEPT TESTING?

Concept testing is a powerful tool for refining ideas and ensuring your product, service, or campaign resonates with your target audience before launch. It helps with optimisation and go/no go decision-making.

By gathering feedback early, you can minimise risks, avoid costly mistakes, and gain insights that fine-tune your offering for success. The benefits are clear: it helps validate customer interest, uncover potential improvements, and assess market fit, saving both time and money in the long run.

There are several methods available to suit your needs, from surveys and focus groups for detailed qualitative and quantitative insights, to A/B testing that compares concepts in real-world scenarios. You can also leverage online panels for fast, diverse feedback or in-depth interviews to explore individual perceptions deeply. Whether you’re testing a new ad campaign, product design, or service offering, concept testing ensures your idea connects with your audience and aligns with their needs and expectations.

WHAT ARE SOME QUANTITATIVE APPROACHES TO CONCEPT TESTING?

There are several approaches, some are covered below:

1. Surveys

• • Use structured questionnaires to gather quantitative feedback from a broad audience.
  • Key Metrics: Purchase intent, perceived value, and likelihood of recommendation.
  • Tools: Online survey platforms (e.g., SurveyMonkey, Qualtrics).

2. A/B Testing — as outlined above

• • Present two or more variations of the concept to different segments of your audience to see which performs better.
  • Ideal For: Comparing design options, messaging, or features in real-world scenarios.

3. Online Panels

• • Leverage pre-recruited groups of participants that represent your target audience.
  • Benefits: Quick turnaround and diverse feedback.

4. Concept Optimisation

• • Break the concept into components (e.g., features, visuals, messaging) and test each individually.
  • Goal: Identify which elements resonate most with the audience.

5. Prototype Testing

• • Present a working prototype or mock-up of the concept for hands-on feedback.
  • Best For: Physical products, apps, or experiences that need usability testing.

7. Conjoint Analysis, for example BPTO (Brand Price Trade Off)

• • Present various combinations of features or benefits and ask participants to rank or choose their preferences.
  • Best For: Evaluating trade-offs and understanding what matters most to consumers.

8. Crowdsourcing

• • Share the concept with a large, diverse group to gather quick feedback.
  • Tools: Platforms like UserTesting or public opinion forums.

9. Simulated Test Markets

• • Mimic real-world purchasing scenarios to measure how participants respond to the concept.
  • Best For: Predicting market performance.

CASE STUDY: EFFECTIVE CONCEPT TESTING FOR PRODUCT DEVELOPMENT

A beverage company tested a new range of low-sugar drinks. By using quantitative evaluations, and feature optimiser tool, we identified consumer preferences and finalised a flavour mix that led to a 20% sales boost post-launch.

7. WHAT ARE USAGE AND ATTITUDE (U&A) STUDIES?

A Usage and Attitude (U&A) Study is a type of market research methodology designed to understand consumer behaviours, preferences, and perceptions related to a product category, brand, or service. It provides insights into how consumers use products, their attitudes towards them, and the motivations or barriers influencing their decisions. It helps clients:

UNDERSTAND USAGE PATTERNS

• Frequency of Use: How often the product or service is used.
• Occasions of Use: Situations or contexts where the product is used.
• Purchase Behaviour: Where, when, and how consumers buy the product.
• Competitor Usage: Insights into alternative products or brands.
• Exploring Consumer Attitudes

PERCEPTIONS OF THE CATEGORY

• What consumers think about the product category overall.
• Brand Associations: How they perceive specific brands within the category.
• Needs and Pain Points: Key needs the product meets and issues they face.

AUDIENCE SEGMENTS

• These distinct consumer segments based on usage habits and attitudes (e.g., heavy users, occasional users, brand loyalists, or switchers).

DECISION DRIVERS

• Purchase Drivers: Factors influencing purchasing decisions (e.g., price, quality, convenience).
• Barriers: Reasons why some consumers might avoid a product or brand.
• Exploring Trends: Helps track changes in behaviours or attitudes over time to identify emerging trends.

HOW CAN I DESIGN U&A STUDIES?

• Use targeted sampling to explore motivations, barriers, and consumption patterns.
• Combine behavioural data with attitudinal insights to gain a holistic understanding of customer habits.

WHEN TO USE A U&A STUDY

• Entering a New Market: To understand the landscape and consumer behaviours.
• Launching a New Product: To identify demand and potential barriers.
• Repositioning a Brand: To gauge current perceptions and opportunities for repositioning.
• Tracking Changes: To monitor evolving consumer behaviours and attitudes in a dynamic market.

A U&A study is a versatile tool that provides actionable insights into both consumer behaviours and the emotional or practical factors driving those behaviours, making it essential for strategic decision-making.

CASE STUDY: LEVERAGING U&A RESEARCH FOR MARKET ENTRY STRATEGIES

A travel company used U&A studies to identify customers and their pain points in its offer. The findings informed feature development, leading to a 30% increase in product adoption.

8. WHAT IS SEGMENTATION?

Segmentation is the process of dividing a broader market into smaller, more specific groups of consumers who share similar characteristics, needs, or behaviours. This helps businesses understand and target these groups more effectively, tailoring their marketing strategies to meet the unique demands of each segment.

Segmentation is a journey; it takes time to get it right. It is part science to divide your market into distinct groups based on demographics, behaviour, and part art to bring the psychographics to life in a meaningful way.

WHY DO MARKETERS NEED SEGMENTATION?

• Better Targeting and Personalisation

By identifying distinct customer groups, marketers can create tailored campaigns that resonate with specific audiences. For example, ads for a hydration product can target athletes differently than senior citizens.

• Efficient Resource Allocation

Segmentation allows marketers to focus their time, budget, and efforts on the most profitable or promising segments, avoiding waste on audiences unlikely to convert.

• Improved Product Development

Understanding the unique needs of different segments helps businesses design products or services that cater specifically to those groups, increasing customer satisfaction and loyalty.

• Competitive Advantage

Effective segmentation helps brands identify unmet needs or underserved markets, creating opportunities to differentiate themselves from competitors.

• Enhanced Messaging

Tailored messaging and positioning for each segment ensure that marketing speaks directly to the motivations, pain points, and values of the audience.

• Market Expansion

Segmentation helps identify potential new markets or niches by analysing emerging trends or consumer needs.

• Better Customer Retention

By addressing the specific preferences and concerns of different groups, segmentation improves customer satisfaction, loyalty, and retention rates.

WHAT ARE THE TYPES OF MARKET SEGMENTATION?

DEMOGRAPHIC SEGMENTATION — A VERY BASIC SEGMENTATION

• Based on age, gender, income, education, occupation, etc.
• Example: Targeting high-income earners with premium products.

GEOGRAPHIC SEGMENTATION

• Based on location, climate, or regional preferences.
• Example: Marketing winter gear to colder regions.

PSYCHOGRAPHIC SEGMENTATION

• Based on lifestyle, personality, values, and interests.
• Example: Targeting health-conscious individuals with wellness products.
• These types of segmentations can be hard to action

BEHAVIOURAL SEGMENTATION

• Based on purchasing habits, brand loyalty, or product usage.
• Example: Offering discounts to repeat buyers.
• Much easier to action

Needs-Based Segmentation

• Based on specific customer needs or problems they want solved.
• Example: Offering different hydration products for athletes and casual drinkers.
• Beware, needs can change, overlap and disappear.

WHY DOES SEGMENTATION MATTER?

Without segmentation, marketers risk delivering generic campaigns that fail to connect with their audience. Segmentation ensures that every marketing activity is purposeful, focused, and impactful, ultimately driving better customer engagement, increased sales, and stronger brand loyalty.

HOW DO I GET TRUE VALUE FROM SEGMENTATION?

• Combine internal behavioural data with external survey insights.
• Build actionable personas that address key consumer needs.

CASE STUDY: DEVELOPING EFFECTIVE MARKET SEGMENTATION FOR TARGETED MARKETING

A retail chain segmented its audience by shopping habits and demographics. Tailored campaigns increased engagement by 40% and drove a 15% revenue boost.

9. WHAT IS MODELLING AND DRIVERS ANALYSIS?

Statistical modelling identifies relationships between variables to predict outcomes. It helps us model or understand the kinds of choices that customers make when choosing between options and provides statistical predictions.

• Drivers’ analysis uncovers the factors influencing purchase decisions.
• Regression models explore the impact of marketing strategies.

WHAT ARE SOME KEY APPLICATIONS OF MODELLING AND DRIVERS ANALYSIS?

• Customer Satisfaction & Loyalty: Identifies what drives satisfaction or churn, such as speed of service, product features, or pricing.
• Brand Health: Determines which factors (e.g., trust, awareness, differentiation) influence brand equity.
• Product Development: Highlights must-have features versus “nice-to-haves” for future innovation.
• Pricing Strategy: Analyses sensitivity to price changes versus other value drivers.

CASE STUDY: APPLYING REGRESSION ANALYSIS TO UNCOVER PURCHASE DRIVERS

A subscription service used regression analysis to identify key drivers for retention. Adjustments in pricing and communication resulted in a 20% reduction in churn.

10. WHAT ARE SOME ADVANCED QUANTITATIVE MARKET RESEARCH TECHNIQUES?

Advanced quantitative research leverages sophisticated statistical techniques and modelling methods to provide deeper, more actionable insights than traditional quant methods. It is particularly useful for solving complex business questions and making data-driven decisions. Techniques might include conjoint analysis or scientific modelling

WHAT IS CONJOINT ANALYSIS?

• Helps determine how customers value product features.
• Feature optimiser is one of our tools that can also provide this

WHAT IS CLUSTER ANALYSIS?

• Identifies natural groupings within a dataset.

WHAT ARE APPLICATIONS OF ADVANCED QUANTITATIVE MARKET RESEARCH TECHNIQUES?

• Market Segmentation: Create precise, actionable consumer segments.
• Product Optimisation: Determine the optimal feature mix or pricing strategy for maximum appeal.
• Customer Journey Analysis: Track how customers interact with a brand and identify improvement points.
• Brand Equity Modelling: Assess the key drivers of brand strength and their financial impact.
• Demand Forecasting: Predict future sales or market trends.
• Campaign Effectiveness: Measure the ROI of marketing efforts through multi-touch attribution models.

CASE STUDY: USING CONJOINT ANALYSIS TO REFINE PRICING STRATEGY

An e-commerce company used conjoint analysis to evaluate pricing options for a premium product. The strategy led to a 15% increase in sales within the first quarter.