Review Final Survey Results with Statistical Insights
Overview
The Scorecard page in Insights becomes available once your surveys are closed, showing final results in a detailed table. Ranked by question impact and enriched with statistical significance, Scorecard helps you compare products and segments with confidence.
Accessing Final Results
Scorecard unlocks after all responses are collected and your surveys close, ensuring you see final values. It's organized as a table:
- Rows: Survey questions, ranked by impact (most impactful first). Labels match those from Explore.
- Columns: Combination of Products and Segments.
This setup lets you see the big picture of your survey data at a glance.
Filtering with Selectors
Customize your Scorecard with selectors at the top:
- Survey Selector: Choose which survey's data you want to analyze. By default, you view the Trial Survey, which allows for product comparisons. You can also select other available surveys such as Screener survey, Pre-trial surveys, or Post-trial surveys, if your project includes them.
- Product Selector: Pick from Products and Product Groups (same as Explore). Note: The Product Selector is not used when you select a Screener, Pre-trial, or Post-trial survey, as these surveys are not product-specific.
- Segment Selector: Choose Segments like demographics or survey questions (same as Explore). You can use the Segment Selector to analyze responses for all survey types, including Screener, Pre-trial, and Post-trial surveys.
- Confidence Level Selector: Set the statistical confidence level. Options are 99%, 95% (default), 90%, 85%, or 80%. You can only select one at a time.
Adjust these to focus on the data that matters most.
Understanding Aggregations
Each question row has a default aggregation based on its answer scale:
- 9-point questions: Top Box, Top 2 Box, Top 3 Box, Middle 3 Box, Bottom 3 Box, Bottom 2 Box, Bottom Box, or Mean.
- 5-point questions: Top Box, Top 2 Box, Middle Box, Bottom 2 Box, Bottom Box, or Mean.
Cells show percentages for most aggregations (e.g., 75% for Top Box) or a number for Mean (e.g., 7.2).
Interpreting Statistical Significance
Scorecard uses common market research notation to highlight statistically significant results. Here's how it works:
- Each column gets a letter (A, B, C, etc.).
- A green cell means the value is statistically higher than another column at your chosen confidence level.
- The cell includes the letter of the column it's higher than (e.g., "A" means higher than column A).
- We use pair-wise, two-tailed tests: t-tests for Mean, z-tests for proportions. Columns with fewer than 15 responses aren't tested.
Example: Imagine a "Satisfaction" question (5-point scale, Top 2 Box):
- Column A (Product X): 70%.
- Column B (Product Y): 85% (green, with "A").
At 95% confidence, Column B's 85% is statistically higher than Column A's 70%, so it's green with an "A" to show the comparison. Only higher values are highlighted, lower ones stay plain.
Tip: Adjust the Confidence Level to see how significance changes.
Exporting Your Scorecard
Save your analysis as a CSV file:
- Click the export option.
- Download the file with all table data included.
Tip: Export after making Product and Segment selections to share specific views with your team.