Review Final Survey Results with Statistical Insights
The Scorecard page in Insights becomes available once your surveys are closed, showing final results in a detailed table. Ranked by question impact and enriched with statistical significance, Scorecard helps you compare products and segments with confidence.
Accessing Final Results
Scorecard unlocks after all responses are collected and your surveys close, ensuring you see final values. It’s organized as a table:
- Rows: Survey questions, ranked by impact (most impactful first). Labels match those from Explore.
- Columns: Combination of Products and Segments.
This setup lets you see the big picture of your survey data at a glance.
Filtering with Selectors
Customize your Scorecard with three selectors at the top:
- Product Selector: Pick from Products and Product Groups (same as Explore).
- Segment Selector: Choose Segments like demographics or survey questions (same as Explore).
- Confidence Level Selector: Set the statistical confidence level. Options are 99%, 95% (default), 90%, 85%, or 80%. You can only select one at a time.
Adjust these to focus on the data that matters most.
Understanding Aggregations
Each question row has a default aggregation based on its answer scale:
- 9-point questions: Top Box, Top 2 Box, Top 3 Box, Middle 3 Box, Bottom 3 Box, Bottom 2 Box, Bottom Box, or Mean.
- 5-point questions: Top Box, Top 2 Box, Middle Box, Bottom 2 Box, Bottom Box, or Mean.
Cells show percentages for most aggregations (e.g., 75% for Top Box) or a number for Mean (e.g., 7.2).
Interpreting Statistical Significance
Scorecard uses common market research notation to highlight statistically significant results. Here’s how it works:
- Each column gets a letter (A, B, C, etc.).
- A green cell means the value is statistically higher than another column at your chosen confidence level.
- The cell includes the letter of the column it’s higher than (e.g., "A" means higher than column A).
- We use pair-wise, two-tailed tests: t-tests for Mean, z-tests for proportions. Columns with fewer than 15 responses aren’t tested.
Example: Imagine a "Satisfaction" question (5-point scale, Top 2 Box):
- Column A (Product X): 70%.
- Column B (Product Y): 85% (green, with "A").
- At 95% confidence, Column B’s 85% is statistically higher than Column A’s 70%, so it’s green with an "A" to show the comparison. Only higher values are highlighted, lower ones stay plain.
Tip: Adjust the Confidence Level to see how significance changes.
Exporting Your Scorecard
Save your analysis as a CSV file:
- Click the export option.
- Download the file with all table data included.
Tip: Export after making Product and Segment selections to share specific views with your team.