Advanced Randomization - How to?


Randomization is a research technique which is used to overcome order bias- the bias that can result due to the order of answer choices. Respondents tend to favour choices at the beginning and at the end of a list because they are more memorized. First items may also be chosen by respondents to save time.

Order bias can be took into account by randomizing the order in which the answer choices are presented.

We provide 3 different options to randomize answer choices:

  • Simple Randomization: This option randomizes the order of all answer choices
  • Random Sub Selection: This option randomly displays a specified number of choices from the total choices available.
  • Advanced Randomization: Using this option you can create sub groups of choices. Then, you can randomize all choices in one group and randomly display a specified number of choices in another group.

How to set up Advanced Randomization?

  • Click on the Edit >> Workspace.
  • Click on Question Settings.
  • Select Advanced Randomization from Answer Display Order.

You’ll see a link to set up Advanced Randomization.

Survey Software Help Image

Advanced Randomization helps you to divide the answer choices in 3 different categories

Current Display Order

Items in this category will always be displayed in the same order as presented in the list. You can use the up and down arrows to the left to reorder the choices:

Survey Software Help Image

In the above example, “Visa” will always be displayed at the top, “None of the above” and “I don’t use credit cards at all” will always be displayed at the bottom.

Randomize All Choices

Items in this category will be inserted randomly into the question in the spots labeled {random}.

Survey Software Help Image

Random Sub Selection

Items in this category will be inserted randomly into the question in the spots labeled {random subset}. Here, you specify the number of choices to be inserted.

Survey Software Help Image

Do Not Display

Items in this category will not be displayed.

Survey Software Help Image
Note: When a respondent completes the survey, the survey options will randomize for the next respondent, if the respondent goes back or refreshes the page in the same browser the options will not randomize.

License & Access Options

This feature/tools described here are available with the following license(s) :

Team Edition

Unlimited Surveys, Questions

Advanced Toolset and Features

No Long Term Commitment

Was this article helpful?
Sorry about that
How can we improve it?