SurveyMonkey

Question & Page Randomization

Using randomization can help reduce order bias and improve the quality of your data. One way to do that in SurveyMonkey is by using Question or Page Randomization to change the order in which people taking your survey see the questions.

Question Randomization lets you change the order of any questions on a page in your survey. You can apply it to a specific set of questions, or all questions on the page.

To turn on Question Randomization:

  1. Go to the Design Survey section.
  2. In the left sidebar, click the Logic icon.
  3. Click Question Randomization.
  4. From the Select Page menu to choose the correct survey page and click Next.
  5. For Format, Choose from the following options:
    • Randomize questions:questions will appear in a random order for each person taking your survey.
    • Flip questions:on average, half of the people taking your survey will see the question order flipped. For example, 3, 2, 1 or of 1, 2, 3.
  6. For Questions Affected, apply to All questions on page or only Selected questions.
  7. Click Apply to save.
  8. (Optional) Repeat the steps to apply Question Randomization to other survey pages.

TIP! Use answer randomization to flip, sort, or randomize choices for an individual question.

To turn off Question Randomization:

  1. Go to the Design Survey section.
  2. In the left sidebar, click the Logic icon.
  3. Click Question Randomization.
  4. From the Select Page menu, choose the page you added randomization to.
  5. For Format, select No Randomization.
  6. Click Apply to save.
  7. (Optional) Repeat the steps to remove Question Randomization from other survey pages.

Page Randomization lets you rotate, flip, or randomize pages in your survey—all pages or a specific set of pages.

To turn on Page Randomization:

  1. Go to the Design Survey section.
  2. In the left sidebar, click the Logic icon.
  3. Click Page Randomization.
  4. For Format choose from the following options:
    • Randomize pages: pages will appear in a random order for each new person taking your survey.
    • Flip pages: on average, half of the people taking your survey will see the page order flipped. For example, 3, 2, 1 or 1, 2, 3.
    • Rotate pages: the page order depends on what the previous person saw—the first page they saw is the last page the next person will see. For example,1, 2, 3, 4, 5, then 2, 3, 4, 5, 1, then 3, 4, 5, 1, 2.
  5. For Pages Affected apply randomization to All pages in the survey or Selected pages.
  6. Click Apply.

TIP! Block Randomization let's you randomize pages by group.

To turn off Page Randomization:

  1. Go to the Design Survey section.
  2. In the left sidebar, click the Logic icon.
  3. Click Page Randomization.
  4. For Format select No randomization.
  5. Click Apply to save.