Question Randomization

PAID FEATURE: Question Randomization is only available on some paid plans—see if it’s on your plan.

You can use Question Randomization to minimize question order bias and improve overall data quality. This feature enables you to randomize or flip all questions on a page, or only a specific set of questions.

To enable Question Randomization:

  1. In the left sidebar, click LOGIC.
  2. Click Question Randomization.
  3. From the "Select Page" menu, select the page whose questions you want to randomize or flip.
  4. Choose from the following Format options:
    • Randomize questions - Questions will appear in a random order for each new respondent.
    • Flip questions - On average, half of respondents will see the question order flipped. For example: 3, 2, 1 instead of 1, 2, 3.
  5. Under "Questions Affected", choose to apply the randomization or flipping to All questions on page 1 or only Selected Questions.
  6. Click Apply.

If you wish to add Question Randomization to more pages, click + New Question Randomization and repeat the steps above, starting from step 4.

Removing Question Randomization

You can remove question randomization at any time.

To remove question randomization:

  1. Click the Design Survey tab.
  2. In the left sidebar, click LOGIC.
  3. Click Question Randomization.
  4. Click the Page whose question randomization you wish to remove.
  5. Click Clear and Apply.
If you have Skip Logic or Question & Answer Piping applied to your survey, using question randomization may lead to unexpected behavior .
Use Question Randomization to alleviate question order bias. This feature enables you to randomize or flip questions on a page.

Get answers