Methods

How we decide whether a member of Congress voted the way most people where they live wanted, and what we do when the answer isn't clear.

The idea in three steps

  1. Find survey questions about real votes. Independent surveys ask people whether they support specific bills or actions of Congress. We use only questions that a recorded floor vote answers.
  2. Estimate what people in each area want. For each state and House district, we estimate the share who support the proposal, with a range showing how sure we can be.
  3. Compare. If the range is clearly above or below an even split, the area has a clear majority, and we show whether the member's vote went with it or against it. If the range crosses the even split, we say it's too close to call and make no judgment.

Matching a survey question to a vote

Estimating opinion

Cooperative Election Study

The Cooperative Election Study (CES) surveys tens of thousands of people a year, but that's only a few dozen in a typical House district: too few to report a district's raw percentage reliably. So we use a standard technique called partial pooling:

Each estimate comes with a 90% range: the span the true figure very likely falls in. We tested the method on simulated surveys where the right answer was known. Pooling cut district errors by about a third compared with raw percentages, and our ranges contained the true figure 91–96% of the time. Adding the Census profile cut district errors by up to a third again where districts in a state really differ, made no difference where they don't, and gave more clear calls with fewer wrong ones. Where a district's range crosses 50%, it's too close to call. That's common in House districts and is the honest answer when few people were asked.

Senators are compared with their whole state, where samples are much larger.

Program for Public Consultation

The Program for Public Consultation publishes results for each state and district it surveys, from samples of several hundred to 2,000 people each, along with each sample's margin of error. We use those published figures directly: support is the share in favor among people who answered either way, and the range comes from the published margin of error, converted to the same 90% level we use for the CES. Where one margin is given as a range for several districts, we use the larger figure, so our ranges are never narrower than the survey supports.

State ballot measures

For a state ballot measure, the figure is the share of votes cast that were Yes: Yes ÷ (Yes + No), from the certified results. Blank ballots aren't counted, the same way surveys leave out people who didn't answer. Because these are real votes rather than a sample, there is no range; the majority is whichever side won, and only an exact tie would be too close to call. Each result is compared only with members who represent the whole state, and always as a related vote that isn't counted.

Showing the sources side by side

Different surveys ask different questions, in different years, in different ways. Rather than blend them into one number, every member's page shows one line per survey organization, and every comparison names its source. When sources agree, that's worth knowing; when they differ, you can see it.

Other figures on member pages

Limits

The technical details, including every special case we've handled for each source, are in the site's source code: see DATA_SOURCES.md and the estimate method in opinion.py.