m

A/B Tests (Random Assignment)

PAID FEATURE: A/B Testing is only available on some paid plans—see if it’s on your plan.

Our A/B Test feature allows you to randomly display different versions of a question, image, or free-standing text, and set the percentage of respondents that will be shown each variable. When you analyze your results, you can assess how the different stimuli affected responses.

Creating an A/B Test

Set up your A/B Test on the Design Survey page.

Image A/B Test

Image A/B Tests allow you to display different images to different sets of respondents. The image will be independent of any questions, so you can add follow-up questions that refer to the image.

To add an Image A/B Test:

  1. From the BUILDER section of the left sidebar, drag and drop Image A/B Test into your survey.
  2. Upload an image for each variable, or add an image via URL.
  3. In the A and B text fields, enter descriptions of each image (optional).
  4. Click + to add another variable if needed.
Text A/B Test

Text A/B Tests allow you to display variations in free-standing text to different sets of respondents. The text will be independent of any questions, so you can follow it with questions that ask respondents to refer to the text.

To add a Text A/B Test:

  1. From the BUILDER section of the left sidebar, drag and drop Text A/B Test into your survey.
  2. In the A and B fields, enter the two variables you want to show to respondents.
  3. Click + to add another variable if needed.
Question Text A/B Test

Question Text A/B Tests allow you to display variations in question text to different sets of respondents.

To enable a Question Text A/B Test:

  1. Click an existing question to edit it. Or, add a new question to your survey.
  2. Click the Options tab.
  3. Click Enable Question Text A/B Test (Random Assignment).
  4. Go back to the Edit tab.
  5. In the A field, enter the question text for the first variable.
  6. Click + to add another variable if needed.
  7. In the % field to the right of each variable, enter the percentage of overall respondents you want to show the variable to.

Unsupported Question Types

The following question types do not support Question Text A/B Tests:

  • Net Promoter Score
  • File Upload
  • Matrix of Dropdown Menus

You can enable Question Text A/B Tests for any question type, except Net Promoter Score, File Upload, or Matrix of Dropdown Menus.

Video A/B Test

You can use the formatting toolbar in a Text or Question Text A/B Test to add a video into each variable field.

As you add variables, the respondent percentages will split evenly across all variables. However, you can enter your own percentages if you prefer. Variable percentages must total 100%. These percentages determine the probability of a new respondent seeing that variable when they take your survey.

Previewing A/B Tests

Before you send out your survey, preview your survey design a few times to see what your survey will look like to respondents. You'll be shown different A/B Test variables each time you preview your survey.

As people take your survey, SurveyMonkey randomly assigns each respondent to be shown a certain variable based on the percentages you define.

Analyzing A/B Test Results

There are several areas in the Analyze Results section where you can view and analyze the results of your A/B test.

  • Under the Question Summaries tab, you can see the number and percentage of respondents that viewed each variable.
  • In the CURRENT VIEW section of the left sidebar, you can Filter by A/B Test or Compare by A/B Test.
  • Under the Individual Responses tab, you can see which variable each respondent was shown.

You may notice that the distribution of respondents that saw each variable doesn't exactly match the percentages you defined. The more responses you collect, the more likely it is that your results will reflect the percentages. Since variables are randomly assigned, we do not guarantee the split will be exact, particularly for smaller numbers of participants. We suggest collecting at least 50 responses.

TIP! See if there are significant differences in how respondents who saw different variables answered your survey.

Exports

When a Filter by A/B Test rule is applied, you can only export summary data in PDF or PPT format. However, the A/B Test questions themselves are excluded from PPT exports since there are no charts and data tables to display in the presentation.

When a Compare by A/B Test rule is applied, you can only export summary data in PDF format.

A/B Testing allows you to randomly display different versions of a question, image, or free-standing text, and set the percentage of respondents that will be shown each variable.

Get answers