MEDIA LITERACY

Self-Selection Bias: Definition, Examples and Fixes

Self-selection bias happens when people choose to join a study, poll or program, so the sample differs from everyone else. Definitions, examples and fixes.

LAST UPDATED 2026-10-20

CORE SUMMARY

Self-selection bias arises when individuals select themselves into a group, such as a survey, trial or course, producing a biased sample that does not represent the wider population. The Catalogue of Bias notes that volunteers tend to differ from non-volunteers in education, social class and motivation. The Catalogue says its impact, and even the direction of its effect, is difficult to estimate. Its preventive steps focus on lowering refusal rates, raising participation and ensuring anonymity and confidentiality.

What self-selection bias means

Wikipedia's definition (checked 20 October 2026) says self-selection bias arises in any situation in which individuals select themselves into a group, causing a biased sample with nonprobability sampling. The problem is not that people choose. It is that the traits that lead them to choose can also shape the result being measured.

The Wikipedia entry (checked 20 October 2026) adds that a poll suffering from this bias is sometimes called a self-selected listener opinion poll, or SLOP, and that the problem is a major one in sociology, psychology, economics and other social sciences. It separates self-selection from other selection problems by cause: self-selection may involve purposeful intent by respondents, while other forms of selection bias may arise more inadvertently, possibly as the result of mistakes by those designing a study.

The Catalogue of Bias, a collaborative project that documents biases in health research, covers the same ground under the name volunteer bias. Its definition is short: participants volunteering to take part in a study intrinsically have different characteristics from the general population of interest.

How it fits with related biases

Several overlapping terms describe the same family of problems. The table below lists the definitions as each source gives them.

TermShort definitionSource
Selection biasStudy participants differ systematically from the population of interest, producing a systematic errorCatalogue of Bias
Self-selection biasIndividuals select themselves into a group, producing a biased, nonprobability sampleWikipedia
Volunteer biasVolunteers for a study have intrinsically different characteristics from the general populationCatalogue of Bias
Nonresponse biasThe people who respond have different answers from those who do notWikipedia (as a close relative)

The Catalogue of Bias defines selection bias more broadly and explains why it matters for cause and effect: when participants differ in ways other than the treatment or exposure being studied, the results are biased by confounding. Our guide to confounding variables covers that mechanism. Self-selection bias is also closely related to nonresponse bias, which is about who answers rather than who signs up.

Five examples from research

Each case below comes from the cited source. The first is a teaching example; the rest are from published health research summarized by the Catalogue of Bias.

CaseWho selected themselvesWhat went wrongSource
Test-prep courseStudents who chose to take the courseHigher scores may reflect motivation, socioeconomic status or prior test experience, not the courseWikipedia
Hormone replacement therapy and heart diseaseWomen who chose HRTObservational studies suggested HRT reduced heart disease; later randomized trials suggested it might raise the riskCatalogue of Bias
Probiotic trial for childhood atopyMothers who stayed in the trialRepresentation of the most deprived fell as the trial went onCatalogue of Bias
Sexuality researchPeople who volunteeredVolunteers reported more positive attitudes, less guilt and more experience than non-volunteersCatalogue of Bias
Lifestyle cohort studiesPeople who signed upParticipants showed lower mortality than the general population, a healthy participant effectCatalogue of Bias

The test-prep case is a standard teaching illustration: students who choose to take a course may differ from those who do not in motivation, socioeconomic status or prior test-taking experience, so a gap in scores could appear even if the course did nothing. Those who chose the course might have scored higher anyway.

The hormone replacement therapy (HRT) case shows what is at stake. According to the Catalogue of Bias, several observational studies found HRT reduced coronary heart disease, but later randomized controlled trials found it might increase the risk. The women in the observational studies who were on HRT were more health conscious, more physically active and of higher socioeconomic status than those who were not. The Catalogue calls this self-selection a cause of confounding and a healthy-user bias.

Who tends to volunteer

The Catalogue of Bias summarizes what is known about volunteers: they tend to be more educated, come from a higher social class and be more approval motivated. It cites one report finding that women are more likely to volunteer than men and are healthier and adhere to treatment more often.

It also notes that differences are not limited to demographics. Volunteers can hold different attitudes toward the trial and the institutions running it, and people may be less likely to put themselves forward for studies of conditions or behaviors regarded as less socially acceptable, such as drug-related conditions. Volunteer bias can occur at every stage, from recruitment through retention to follow-up.

The probiotic trial in the table illustrates that last point. The Catalogue reports that as the trial went on, the most deprived participants were more likely to be lost to follow-up at six months and two years, while mothers interested in probiotics were more likely to attend research clinics.

Self-selection in polls and online surveys

Polls are where most readers meet this problem. Pew Research Center describes online opt-in sampling as an approach where people are not selected randomly but are recruited from online sources such as banner ads or social media. Pew says opt-in polls can perform similarly to traditional methods for some purposes, such as election polling, but that several studies have documented large errors in them.

Pew's own example is specific. A December 2023 opt-in poll reported that 20 percent of US adults under 30 agreed that the Holocaust is a myth. When Pew repeated the question in January 2024 on its American Trends Panel, which is recruited by random sampling of residential addresses, it found 3 percent, the same as every other age group. Pew says the gaps are what it would expect if many bogus respondents, people who answer insincerely to earn rewards, claimed to be under 30. That is a different mechanism from classic self-selection, yet it is still a question of how people enter the sample, and Pew contrasts opt-in recruitment with its own random address sampling. In another Pew study comparing three opt-in samples with three probability-based panels, young or Hispanic opt-in respondents were far more likely to say yes to 10 or more of 16 yes/no questions, while very few respondents on the probability panels gave such implausible answers. In an earlier Pew experiment, 12 percent of opt-in respondents under 30 claimed to be licensed to operate a nuclear submarine, a share that in reality rounds to 0 percent.

The same logic applies to informal polls on social media or news sites. Anyone who chooses to click is self-selected, so the result describes the people who answered, not the public.

How researchers reduce it

The Catalogue of Bias says it is difficult to estimate the impact of volunteer bias or even the direction of its effect. Separately, it lists preventive steps. It notes that the likelihood of volunteer bias increases as the refusal rate increases, so any technique that raises volunteer numbers is likely to reduce it, and that ensuring anonymity and confidentiality is essential to increase participation.

In the HRT example, later randomized controlled trials reached a different conclusion from the observational studies. For surveys, Pew's approach is probability-based recruitment, where nearly all adults have a chance of selection, followed by weighting to match the population.

In the test-prep example, a relative measure of improvement might make the study somewhat more reliable, but only partially.

Questions to ask when you read a result

Did the participants choose to take part, or were they selected at random? If they chose, what might make the people who joined different from those who did not?

Was the treatment, course or product assigned, or did people pick it? A comparison between choosers and non-choosers is open to the HRT problem.

For polls, how were respondents recruited? In Pew's replication, an opt-in survey and its own random address sample gave very different numbers on the same questions.

Frequently asked questions

What is a simple example of self-selection bias?

Comparing students who signed up for a prep class with those who skipped it. The joiners may be more motivated or advantaged, so better scores need not prove the class helped. Source: Wikipedia.

Is self-selection bias the same as selection bias?

It is one kind. Selection bias covers any systematic gap between participants and the target population; self-selection is the version where people pick themselves, sometimes deliberately. Source: Catalogue of Bias; Wikipedia.

How is it different from nonresponse bias?

Self-selection concerns who opts in. Nonresponse concerns people who were invited but whose answers are missing, which can differ from the answers given. Source: Wikipedia.

Can you fix self-selection bias after the fact?

Only partly. Using relative measures helps somewhat, though only in part, according to Wikipedia, checked on 20 October 2026. The Catalogue finds its size and direction hard to gauge; for prevention it covers refusal rates, participation and anonymity. Source: Wikipedia; Catalogue of Bias.

READER VERDICT

Did this entry hold up?

Published by Hollowvane