About The Survey
Thousands of people across the political spectrum took the surveys. Each survey participant was asked to self-report their personal political bias of Left, Lean Left, Center, Lean Right, and Right. These responses were normalized so that unequal sizes of these groups would not skew the final results in favor of one bias group over another.
Results are not assessed by majority rule; we calculate pluralities and averages, both within respondent groups and across all respondent groups, to arrive at final determinations.
For this survey, AllSides collected 10 pieces of content from media outlets: top headlines taken on two different days at the same time of day, and top stories the outlet ran around two major national news stories. Stories and headlines were stripped of branding and any information that would allow participants to identify the outlet. Participants were asked to rate the bias of the source on a scale of Left, Lean Left, Center, Lean Right, and Right.
Results are represented on a scale of -9 to +9, with 0 representing dead Center, -9 representing Left and +9 representing Right:
Left: -9.00 to -3.00
Lean Left: -2.99 to -1.00
Center: -0.99 to +0.99
Lean Right: +1.00 to +2.99
Right: +3.00 to +9.00
Note About Blind Bias Surveys
Blind surveys are robust, but do have limitations. They alone do not always determine our ratings. These surveys ask respondents to assess a relatively small snapshot of the source's content in time. The surveys don't include photos, content published over a long period of time, or other crucial elements for determining bias. Therefore, we often use blind survey data in conjunction with other methods to arrive at a final bias rating, such as Editorial Reviews, third party data and independent reviews by AllSides reviewers.
AllSides uses multiple methods for calculating media bias ratings.
Our Blind Bias Survey, described in the graphic below, represents one of our most robust media bias rating methods, but it is not the only method we use. A source might openly share its bias, or it may be determined by third party research, an independent review, or an Editorial Review. Take a look at the multiple methods AllSides uses to measure and rate media bias.