m

Block Randomization

PAID FEATURE: Block Randomization is only available on some paid plans—see if it’s on your plan.

Block Randomization allows you to group pages of your survey into blocks, and then add logic to rotate, flip, or randomize the blocks. You can also add logic to the pages within a single block. This minimizes order bias in your survey.

To use Block Randomization:

  1. Go to the Design Survey section of the survey.
  2. In the left sidebar, click LOGIC.
  3. Click Block Randomization.
  4. Create blocks.
  5. Add logic to the blocks.
TIP! Your last step should be adding logic. Add all questions and pages to the survey design before creating blocks and applying logic.

Creating Blocks

A block is a group of consecutive pages in your survey. You can create up to 300 blocks in your survey.

To create blocks:

  1. Under the LOGIC menu in the left sidebar, click Block Randomization.
  2. Click + New Block.
  3. Select the consecutive pages you want to include in the block. Some pages may be disabled if you already added logic to them that isn't compatible with Block Randomization.
  4. Click Add Block.
  5. Create more blocks, as needed.
  6. When you're finished creating all your blocks, click Done in the bottom-left corner of the menu.

Block names indicate the range of pages included in the block. For example, a block containing Page 4, Page 5, Page 6, and Page 7 of your survey would be named Block: P4-P7.

TIP! A page can only belong to one block at a time. To use the same page in multiple blocks, you can instead make a copy of the page to use in another block.

Editing Blocks

To edit a block:

  1. Under the LOGIC menu in the left sidebar, click Block Randomization.
  2. Click Edit Blocks.
  3. Click . next to the right of the block.
  4. Click Show block details or Break block apart.

Adding Logic to Blocks

You can add Block Logic to control the order in which the blocks, or pages within a block, are presented to the respondent. There are two ways to apply Block Logic:

Block Logic
Description
Across multiple blocksApply randomization logic to the blocks themselves, or a subset of blocks.

You can also set a limit on the number of blocks that will be shown to a respondent.
Within a single blockApply randomization logic to the pages within a single block.

You can apply both types of Block Logic to a survey.

Applying Logic Across Multiple Blocks

To apply logic across multiple blocks:

  1. Under the LOGIC menu in the left sidebar, click Block Randomization.
  2. Under Add Block Logic, choose Across multiple blocks.
  3. Choose a Logic Type (see the table below for details).
  4. Under Blocks Affected, choose to apply the logic to All blocks in this survey or Selected blocks, where you can choose a subset of blocks to apply the logic to.
  5. Optional: Select Limit number of blocks to display and enter a limit.
  6. Click Apply.
Logic Type
Description
No block randomizationNo logic is applied across the blocks. They are shown to respondents in order.
Randomize blocksBlocks are shown in a random order for each new respondent.
Flip blocksOn average, half of respondents will see the block order flipped. Example: 3, 2, 1 instead of 1, 2, 3.
Rotate blocksEach respondent will see a random first block, with the following blocks arranged in successive order based on the first. Example: The first respondent might see 3, 4, 5, 1, 2; the second respondent might see 2, 3, 4, 5, 1; and the third respondent might see 5, 1, 2, 3, 4.
 
Limiting the Number of Blocks to Display

If you apply logic across multiple blocks, you can also select the Limit number of blocks to display setting and enter the number of blocks you want each respondent to see. This setting can help reduce survey fatigue for any given respondent by showing them a smaller subset of blocks to answer, while still allowing you to collect responses for a larger survey.

The Limit number of blocks to display setting applies to all blocks in the survey, even if the Blocks Affected setting is set to only apply logic to Selected blocks.

For example, if you set a limit of 2 blocks, the respondent is shown the first 2 blocks they would have seen based on the Logic Type you applied. See the example below:

Total Blocks in Survey
Number of Blocks Limit
Logic Type
Blocks Affected
What Respondents See
4 (with no extra pages not included in a block)2Rotate blocksAll blocks in this survey

Each respondent sees the first 2 blocks they would have seen based on their position in the rotation.

  • The first respondent sees Block 1, then Block 2, then ends the survey.
  • The second respondent sees Block 2, then Block 3, then ends the survey.
  • The third respondent sees Block 3, then Block 4, then ends the survey.
  • The fourth respondent sees Block 4, then Block 1, then ends the survey.
  • The fifth respondent sees Block 1, then Block 2, then ends the survey.
Applying Logic Within a Single Block

To apply logic within a single block:

  1. Under the LOGIC menu in the left sidebar, click Block Randomization.
  2. Under Add Block Logic, choose Within a single block.
  3. Click the block you want to apply logic to.
  4. Choose a Logic Type (see the table below for details).
  5. Under Pages Affected, choose to apply the logic to All pages in this block or Selected pages, where you can choose a subset of pages to apply the logic to.
  6. Click Apply.
Logic Type
Description
No page randomizationNo logic is applied to the pages within the block. They are shown to respondents in order.
RandomizationPages within the block are shown in a random order for each new respondent.
Flip pagesOn average, half of respondents will see the pages within the block flipped. Example: 3, 2, 1 instead of 1, 2, 3.
Rotate pagesEach respondent will see a random first page, with the following pages of the block arranged in successive order based on the first. Example: The first respondent might see 3, 4, 5, 1, 2 within the block; the second respondent might see 2, 3, 4, 5, 1; and the third respondent might see 5, 1, 2, 3, 4.

 

Example

Block Randomization is commonly used for concept testing. Let's say you're testing three different advertisements. You'll need to create three blocks of pages, one for each ad.

Page 1Page 2Page 3Page 4Page 5Page 6Page 7Page 8
 Block 1Block 2Block 3 
FF + FF + FF + FF

To show each respondent all three blocks in a random order, add logic to randomize all the blocks in the survey. All respondents will see Page 1 first and Page 8 last, and they'll see the blocks in a random order.

To show each respondent only one random block, first add logic to randomize all the blocks in the survey. Then, limit the number of blocks to display to 1. Respondents will see Page 1, then one random block selected from Block 1 OR Block 2 OR Block 3, then Page 8.

Using Block Randomization With Other Logic Options

Logic Option
How it Works with Block Randomization
Skip LogicYou can use Question Skip Logic or Page Skip Logic to skip respondents out of a block and to the end of the survey, disqualification page, or a future page in your survey—as long as that page doesn't belong to a block, or have Page Randomization applied to it.
Advanced BranchingYou can use Advanced Branching to skip respondents out of a block and to the next available block in the survey.
Page Randomization

You can't apply Page Randomization to any pages contained within a block—that logic option will be disabled for pages within a block. Instead, you can randomize the pages within a single block in the Block Randomization feature to achieve the same result.

Question RandomizationYou can apply Question Randomization to pages within blocks.

Analyzing Results

When you send a survey with Block Randomization, you can see the order in which each respondent saw the pages in your survey by exporting the results in XLS format.

To export the page order per respondent:

  1. Go to the Analyze Results section of the survey.
  2. Click Export All in the upper-right corner of the page.
  3. Choose All responses data.
  4. Choose XLS.
  5. Under EXPORTS in the left sidebar, click the export to download it.
  6. Within the Excel folder, open PageOrder.xls.

Column A contains the Respondent ID, which you can match to the Respondent ID in the spreadsheet (Sheet_1.xls) containing your survey results.

Column B contains the page number of the first page of the survey the respondent saw, Column C contains the page number of the second page of the survey the respondent saw, and so on.

블록 무작위화 로직을 사용하면 설문조사 페이지를 블록으로 묶어 블록을 회전하거나 순서를 뒤집거나 무작위화하는 로직을 추가할 수 있습니다. 단일 블록 내의 페이지들에 로직을 추가할 수도 있습니다. 이렇게 하면 설문조사에서 순서로 인해 생기는 편향을 최소화할 수 있습니다.

답을 얻으세요