Response Quality

BETA FEATURE: Response Quality is currently in beta and only available to a small number of customers on some paid plans.

Response Quality uses machine learning to scan your survey results and flag poor-quality responses. For example, if a survey-taker fills a comment box with gibberish, or answers option A on every question, we’ll flag the responses so you can focus on high-quality survey data.

A survey needs to have more than 50 responses in order to see Response Quality results. Survey responses collected before March 2nd, 2020 can’t be reviewed for quality.

Using Response Quality

To turn Response Quality on:

  1. Make sure that you’ve opted in to Automatic Insights.
  2. Go to the Analyze Results section of your survey.
  3. In the Insights section of the left sidebar under Response Quality, click the toggle On. It may take a few minutes to scan your survey responses.

If your survey is still collecting responses, we’ll automatically rescan new responses for quality about every 24 hours.

Once your responses are scanned, you can scroll through Individual Responses to find responses flagged as Poor Quality.

  • If you agree that the response is poor-quality and want to remove it from your results, you can click Delete. This is permanent and cannot be undone.
  • If you think that we’ve incorrectly flagged a response, click Not poor quality to remove the flag and flag type. This also helps improve flagging accuracy in the future.

Flag Types

Our machine learning models are trained to look for a few different types of poor-quality survey responses:

Flag TypeDescription
ProfanityThe survey response includes a curse word.
Straight-liningMultiple questions have been responded to with the same answer option. For example, the survey-taker chose option B for every question.
SpeedingThe survey took significantly less time to complete than is average.
GibberishThe response includes a text response primarily made of nonsensical words.
LengthThe response is significantly shorter than is average.

Exporting Response Quality

CSV, XLS, and SPSS export formats include columns that show if a response was flagged, and what the flag type is.

Get answers