Response Types

Overview

One switch decides who's counted in every number in your Insights results: Full Completes Only.

With it on, your results count only the people who finished everything the study asked of them — participants approved on all of the surveys assigned to them. Turn it off and you count everyone whose responses were approved, including people who only got part of the way through. That gives you a bigger sample, but not everyone in it saw the same things.

It's on by default for new projects, because it's the safer basis for comparing products.

Throughout this article, Products are the labels you see on a physical product study. On a concept study they read Concepts; on a survey-only study, Surveys.

Where to Find the Setting

Open any Insights tab with a Settings panel — Explore always has one — and look below the divider. Full Completes Only is the first setting there. Click the switch; the tab reloads its numbers straight away, and any download or report you generate afterwards uses the new setting.

It's on every project from the moment the project is created. Projects created before the setting existed start out with it off until someone turns it on.

What Counts as a Full Complete

A full complete is a participant approved on all of the surveys assigned to them — not just the product surveys. Screeners, pre-trial, post-trial and profiling surveys all count towards it.

Two things worth knowing:

Photo and video tasks don't count towards it. Someone who skips their photo task is still a full complete, and any photos they did submit still appear in your results and downloads.
At least one approved product survey is needed. Someone approved on a screener alone never counts as a full complete, however clean their record.

Separately from this switch, a response is only counted once it's been approved in quality control. That's why someone you recruited can be missing from your results altogether.

The Count Tightens When Your Project Finishes

While your project is still fielding, a participant counts as a full complete if everything they've submitted so far has been approved. People are still working through their assignment, so anyone on track to finish is included — submit three of your five surveys and have all three approved, and you count today.

Once the project finishes, the test gets stricter: you now have to have been approved on every survey you were issued. That participant with three approvals out of five stops counting.

So your full completes figure can fall on the day a project completes, without anyone touching the switch. The definition underneath it changed, not your data.

On or Off

Tip: If you're unsure, leave it on. It removes the possibility that a product scored differently simply because a different set of people rated it.

It's a Project Setting, Not a Personal One

Full Completes Only is saved to the project, not to your login. Flip it and every colleague reading that project sees different numbers, with no warning to them. It's reversible — switch it back — but if you only want to narrow results for yourself, use Segments instead.

Where It Applies

Changing the switch rescopes Insights all at once: Explore, Scorecard, Crosstabs, Penalty Analysis and Alienation Analysis on screen, everything those tabs export, the files you generate from the Reports tab, and the Download Responses and Download Photos files on Downloads. It also scopes the AI summary on an open-ended question in Explore, and the participant counter you watch while building a segment.

The exception is the Summary tab, which is always built on all approved responses so its narrative doesn't move when somebody flips the switch. If the Summary narrative doesn't line up with what you see on Crosstabs, that's why. Summary's Participants figure is the exception to the exception — it always uses the strict finished-project count, and only appears once your project has finished.

Segments — narrow results for yourself without changing a project-wide setting
Downloads — the response and photo files this setting rescopes
Instant Reports — reports are built on whatever the switch is set to when you generate them

← Back to Insights Overview