Primacy effect

Topic
Survey bias
Contents

The primacy effect is the tendency of respondents to choose options near the top of a list more often than options further down, regardless of content. In surveys it shows up mostly when options are read on screen or paper, and it is one type of response bias that can distort survey results.

The primacy effect is the opposite of the recency effect, where the last items are remembered better. Both effects stem from the limits of human memory and attention and are types of bias in surveys: we remember what we see at the beginning or the end of a list better, and what is in the middle worse.

What the primacy effect is in simple terms

Primacy effect is the tendency of respondents to remember and give more weight to the first items in a list of answer options, especially when the options are presented visually. It arises from the limits of human memory and attention: the first options get more careful thought, and respondents who satisfice stop at the first acceptable one. The primacy effect can distort survey results by over-representing the first options in a list and under-representing the middle and last ones. It is a subtype of response bias related to the order in which information is presented.

Put simply: the primacy effect is when the first option is remembered best. If a respondent picks the first option in a list of ten, it may not be because it fits best, but because it was the first acceptable one they read.

Why the primacy effect occurs

Initial attention. The first items in a list receive more attention because the respondent is not yet tired and reads the options carefully. Attention fades as the respondent moves down the list.

Memory encoding. The first items are encoded into long-term memory more effectively because the respondent has the time and cognitive resources to process them. Later items may push the first ones out of working memory or receive less attention.

First-impression effect. The first items create a "first impression" of the list of options, which can influence how later items are interpreted. This is especially noticeable in questions about opinions or preferences.

Cognitive economy. Respondents may use a "pick the first suitable option" heuristic to save cognitive resources. This is especially noticeable in long lists, where reviewing every option takes effort.

When the primacy effect is stronger

Long option lists. The more options a respondent has to read, the more tempting it is to stop at the first acceptable one. Even in lists of 3–4 options the effect can be noticeable.

Tired or less motivated respondents. According to Krosnick's satisficing theory (Krosnick, 1991), respondents who are tired, rushed or not interested in the topic put less effort into reading every option, and order effects grow.

Written versus oral presentation. Order effects depend on the mode (Krosnick and Alwin, 1987): when options are read on screen or paper, the first ones are chosen more often (primacy); when an interviewer reads them aloud, the last ones heard are chosen more often (the recency effect).

Simple questions. In questions that do not require deep thought, the primacy effect can be stronger, because respondents reach a decision faster based on the first options.

Visual presentation. If the options are visible on screen at the same time, the primacy effect can be stronger, because respondents start reading from top to bottom and the first options receive more attention.

Examples of the primacy effect

List of brands. The question "Which brand do you prefer?" with ten options. Respondents may choose the first brands in the list more often not because they prefer them, but because those were remembered better. This can distort the results of a preference study.

Evaluating service quality. The question "What matters most to you in a service?" with eight options. The first options (for example, "product quality," "price") may get more selections simply because they were remembered better, even if they are not the most important to the respondent. To evaluate services, you can use ready-made survey templates.

Choosing a product category. In a survey about food preferences with a list of twelve categories, respondents may choose the first categories (for example, "main courses," "salads") more often not because they prefer them, but because they were remembered better at the start of the list.

Rating attributes. The question "Rate the importance of the following product attributes" with ten attributes. The first attributes may receive higher ratings simply because they were read first, before the respondent got tired.

How to minimize the primacy effect

Randomizing options. Use randomization of answer options so that each option has an equal chance of appearing at the beginning, middle, or end of the list. This minimizes the influence of the primacy effect (and the recency effect) on results. In SurveyNinja you can set a random order of options for each respondent.

Limiting list length. If the list of options is long, split it into several questions or use logic jumps to show only the relevant options. The shorter the list, the weaker the primacy effect, but in very short lists (3–4 options) the effect can remain noticeable.

Balanced order. If randomization is not possible, use a balanced order: place important options both at the beginning and at the end of the list to minimize the influence of the primacy effect and the recency effect.

Instructions for respondents. At the start of the survey you can add an instruction: "Please read all the options carefully before choosing" — this helps respondents pay attention to the whole list rather than only the first options. It is also important to minimize other sources of response bias.

Avoid leading questions. It is important to avoid leading questions that can amplify the influence of option order. Neutral wording helps respondents make a choice based on content rather than order.

Relation to the recency effect

The primacy effect is the opposite of the recency effect, where the last items in a list are remembered better. Both effects stem from the limits of human memory and can affect survey results:

  • The primacy effect is typical when options are shown on screen or paper.
  • The recency effect is typical when options are read aloud, as in phone interviews.
  • In the middle positions of a list both effects are weaker, which can lead to under-representation of the middle options.

Randomizing options minimizes both effects, because each option has an equal chance of appearing in any position in the list.

Common mistakes

Ignoring the primacy effect. Assuming that option order does not influence respondents' choices, especially in online surveys. This can lead to distorted results and incorrect conclusions.

Always placing important options first. If important options are always at the start of the list, they may get more selections because of the primacy effect rather than their actual importance. This distorts the results.

Not using randomization. If options are always in the same order, the primacy effect will systematically influence results, over-representing the first options. Randomization solves this problem.

Confusing the primacy effect and the recency effect. Both effects are related to order, but they work differently and are stronger under different conditions. It is important to understand when each effect is stronger and to apply the appropriate measures to minimize it.

How it looks in SurveyNinja

In SurveyNinja you can set a random order of answer options for each respondent, which minimizes the influence of the primacy effect (and the recency effect). You can limit the length of the list of options and use logic jumps to show only the relevant options. To keep respondents attentive, you can use short surveys and logic jumps to show only the relevant questions. When creating surveys you can start from ready-made survey templates. When analyzing results, consider the possible influence of the primacy effect on any question where the order of options was fixed.

Practical recommendations

Always use randomization in option lists. If a list of options contains more than 3–4 items, use randomization to minimize the influence of the primacy effect and the recency effect on the results.

Limit list length. If the list of options is long, split it into several questions or use logic jumps to show only the relevant options. This helps reduce the influence of the primacy effect.

Use instructions for respondents. At the start of the survey, add an instruction to read all options before choosing. This helps respondents pay attention to the whole list rather than only the first options.

Account for order when interpreting. When analyzing results, keep in mind that the primacy effect can over-represent the first options in a list, especially when the order was fixed and respondents were tired. Randomization helps minimize this influence.

What to write in the report. If randomization of options was used, you can briefly mention it in the methodology: "To minimize the influence of the primacy effect and the recency effect, the order of answer options was randomized for each respondent."

1