Lessons from Other Fields
Clinical Drug Trials
A verification regime engineered to defeat wishful interpretation — a standard election results never have to meet.
In Brief
When you take a prescription drug, you are trusting that it was proven to work — and proven safe — by someone other than the company selling it. You can’t run an experiment on yourself, and you can’t tell the drug’s effect apart from coincidence or the placebo effect. So the system is engineered, from the ground up, to defeat wishful thinking.
A new drug must pass through phased trials and an independent FDA review by experts separate from the manufacturer, advised by outside scientists screened for conflicts. The trials are randomized and double-blind so neither patients nor researchers can nudge the result. An independent data safety monitoring board watches the data in real time and can halt a trial. And since 2007, trials must be pre-registered — the questions locked in before the data arrives, so no one can quietly switch what they were measuring after seeing the answer.
The cautionary cases drove the architecture. Thalidomide, blocked from U.S. approval by one skeptical FDA reviewer, led to the 1962 law requiring proof a drug actually works. Vioxx, withdrawn in 2004 after an independent monitoring board flagged cardiovascular harm, drove the modern pre-registration and post-market-safety rules.
Wishful interpretation is exactly the risk an election result faces too. The parties who report the totals have an interest in the outcome, and the public cannot independently check the number. Drug regulation answers that risk with pre-commitment and independent verification. Actual Vote brings the same posture to the reporting step of an election: an independent, primary-source record — captured before the official number is published — that the result can be checked against, so interpretation cannot quietly drift toward the answer someone hoped for.
I. What This Domain Is
The clinical-trial system exists to answer a question no individual can answer for themselves: does this drug actually work, and is it safe? A patient cannot run a controlled experiment on their own body. They take a drug and something happens, but they cannot tell the drug’s effect apart from the natural course of the illness, from coincidence, or from the placebo effect — the real, measurable improvement that can follow simply from being treated. Worse, the party that knows the most about the drug, the manufacturer, has a powerful financial interest in concluding that it works. The person with the highest stakes has the least ability to verify, and the best-informed party has the strongest incentive to see a favorable answer.
This is the same structure a citizen faces with an election result, with one feature especially pronounced: the risk of wishful interpretation. The parties who generate and report the totals are not disinterested, and the public cannot independently check the number against the underlying evidence. Drug regulation is the domain that has thought hardest about exactly this failure — how to keep interested parties and ordinary human optimism from bending an unverifiable result toward the answer someone wants.
Its answer is a verification regime engineered specifically to defeat wishful interpretation: independent review, randomization and blinding, independent real-time monitoring, and pre-commitment to what will be measured before the data exist. This entry describes that regime, the disasters that forced it into being, and what its logic implies for the least-verified step in American elections — the reporting layer.
II. The Institutional Architecture
The architecture begins with independent review. A new drug must pass through phased clinical trials — small early-phase safety studies, mid-phase studies of efficacy, and large pivotal trials — and then survive review of a New Drug Application by an FDA team of physicians, statisticians, pharmacologists, and chemists who are entirely separate from the sponsor. The reviewer’s explicit job is not to accept the sponsor’s conclusions but to independently evaluate whether the submitted studies actually show the drug is safe and effective. The FDA supplements its internal review with advisory committees of outside experts and patient representatives, who are screened for financial conflicts and may not participate when they hold a stake in the product under review. Independence — of the reviewer from the sponsor, and of the advisors from the product — is built in at every step.
The trials themselves are designed to remove bias mechanically rather than relying on the good intentions of the people running them. A randomized controlled trial assigns participants to treatment or control by chance, which prevents the investigators from consciously or unconsciously sorting patients in a way that favors the drug. Blinding goes further: in a double-blind trial, neither the patient nor the researcher knows who received the drug and who received a placebo, which simultaneously neutralizes the placebo effect and the observer-expectancy effect — the well-documented tendency of researchers who know the assignment to evaluate outcomes more favorably for the treatment. The structure assumes that everyone involved, however honest, is susceptible to seeing what they hope to see, and removes the information that would let them.
A third layer monitors the trial as it runs. A Data Safety Monitoring Board — independent of both the sponsor and the trial investigators — reviews the accumulating data in real time and has the authority to stop a trial early, either because the drug is clearly harming participants or because it is so clearly working that withholding it from the control group is no longer ethical. The board’s independence is the point: the people with an interest in the trial’s success are not the ones deciding whether its emerging safety signals are serious enough to halt it.
The fourth layer is pre-commitment, and it is the most direct answer to wishful interpretation. Under the Food and Drug Administration Amendments Act of 2007, applicable trials must be registered on ClinicalTrials.gov before enrollment and must report their results, and since 2005 the International Committee of Medical Journal Editors has refused to publish trials that were not pre-registered. Registration forces researchers to declare, in advance and in public, what they will measure and how — which prevents two of the most insidious forms of after-the-fact bending: outcome-switching, in which a trial that failed on its intended measure is rewritten around some other variable that happened to look good, and selective non-publication, in which unfavorable trials simply vanish. The commitment is made before the answer is known, so the answer cannot reshape the question.
Surrounding all of this is the human-subjects protection regime: every trial must be approved and monitored by an independent Institutional Review Board, informed consent is mandatory, and the FDA’s investigators inspect trial sites, comparing the reported data against source records to detect deviation or falsification.
III. Why This Exists
The regime exists because the stakes are high, the information asymmetry is severe, and the temptation toward favorable interpretation is built into the situation. Harm from an unsafe or ineffective drug can be severe and irreversible, the patient cannot verify safety or efficacy directly, and the party generating the evidence profits from a favorable reading of it. No amount of individual diligence by patients could substitute; trust has to be manufactured structurally, by independent parties and by mechanisms — randomization, blinding, pre-registration — that make a deceptive or self-deceiving result difficult to produce and detectable after the fact.
The benefit is not only the harmful drugs kept off the market. It is the warranted confidence that lets the entire pharmaceutical enterprise function: physicians prescribe and patients accept drugs they cannot personally evaluate because the verification system, not the manufacturer’s word, stands behind the claim. The architecture is the precondition for the trust, and the trust is the precondition for the practice.
The transfer to elections is direct. An election result is a claim generated by interested parties about a quantity the public cannot independently check, under exactly the conditions in which optimism and interest can bend an unverifiable number. Drug regulation’s response to those conditions is pre-commitment and independent verification. The election reporting layer, as currently built, has neither: there is typically no independent record committed in advance against which the published total can be checked.
IV. The Cautionary Cases: Thalidomide and Vioxx
Two disasters built much of the modern regime, and each illustrates a different part of it.
The first is thalidomide. Marketed across Europe, Canada, and Australia from the late 1950s as a sedative and remedy for morning sickness, it caused thousands of severe birth defects before researchers linked it to the drug. In the United States the catastrophe was averted almost single-handedly by Frances Oldham Kelsey, an FDA medical reviewer who, despite sustained pressure from the manufacturer, refused to approve the drug because she judged the safety evidence inadequate. The drug was never approved for general U.S. marketing. The near-miss made the gap in the law impossible to ignore: at the time, manufacturers had to show only that a drug was safe, not that it worked. Congress responded with the Kefauver-Harris Amendments of 1962, which for the first time required “substantial evidence of effectiveness” from “adequate and well-controlled” studies, mandated informed consent from trial subjects, and required adverse-event reporting. The modern requirement that a drug be proven to work — the foundation of the whole trial system — dates from this response.
The second is Vioxx. Approved in 1999 and prescribed to millions for pain, the drug carried a cardiovascular risk that emerged only gradually. An early signal appeared in the VIGOR trial in 2000, where heart attacks were more frequent among patients taking the drug — a signal the manufacturer attributed to a protective effect of the comparison drug rather than a hazard of its own. The decisive evidence came from the APPROVe trial, a randomized, placebo-controlled study whose independent data safety monitoring board recommended stopping it early in September 2004 because of cardiovascular toxicity. The manufacturer withdrew the drug worldwide on September 30, 2004. The scale of the harm was large: testifying before the Senate, the FDA’s David Graham estimated tens of thousands of excess heart attacks and sudden cardiac deaths in the United States, and he argued that the FDA’s structure — with the same office both approving drugs and monitoring their safety afterward — had left the agency poorly positioned to catch the problem. The episode exposed a different gap than thalidomide: not approval, but post-market surveillance and the suppression of unfavorable data. Congress responded with the Food and Drug Administration Amendments Act of 2007, which mandated results-reporting on ClinicalTrials.gov, created new post-market safety authorities, and strengthened the FDA’s ability to require follow-up studies.
Both cases display the diagnostic feature of a living verification architecture: a failure exposed a specific gap, and the institutional response was to close it — by adding the efficacy requirement after thalidomide, and the pre-registration and post-market-safety requirements after Vioxx — rather than to rationalize the failure as unrepresentative.
V. The Transfer to Elections
The structural parallel is precise, and the distinctive contribution of this domain is its focus on wishful interpretation. Both drug approval and election reporting involve a high-stakes claim about a quantity the affected public cannot verify, generated by parties who are not disinterested. Drug regulation’s central insight is that honesty is not enough — that interested parties and ordinary human optimism will bend an unverifiable result unless the system is engineered to prevent it. Its tools are pre-commitment (declaring the measure before the data exist) and independence (review and monitoring by parties with no stake in the answer).
The asymmetry with election reporting is sharp. A clinical trial must declare in advance, in a public registry, exactly what it will measure, so the result cannot be redefined after the fact; the election reporting layer has no equivalent independent record committed in advance against which the published total must be reconciled. A trial’s data are monitored in real time by a board independent of the sponsor; the reporting layer has no analogous independent monitor. A drug’s evidence is reviewed by experts separate from the manufacturer; the reporting layer is often verified, if at all, only by the same parties who produced the result.
The most transferable idea is pre-registration. Its power is that it fixes the standard of truth before anyone knows the answer, so the answer cannot shape the standard. The election analog is to capture an independent record of what each precinct reported at the moment it reports it — before the official total is published and before any interpretation can drift — so that the published number must be reconciled against a record committed in advance.
VI. Where Actual Vote Fits
Actual Vote is the election equivalent of pre-registration combined with independent monitoring. It does not replace election officials, audits, or certification, any more than a trial registry replaces the FDA. What it supplies is the pre-committed independent record that the domain’s logic identifies as the antidote to wishful interpretation: it captures the precinct tabulator’s own output — the poll tape — at the moment of reporting, independent of the parties who generate the official totals, so that the published result can be reconciled against a primary-source record fixed before the official number was set.
The role mirrors the data safety monitoring board’s independence. The board’s value comes precisely from being separate from the sponsor and the investigators — an outside party watching the real evidence as it accumulates, able to say when the official story and the underlying data have diverged. Actual Vote is structurally independent of both the administrator and the vendor: it examines the primary evidence and compares it against the official disclosure. When they match, the match is affirmative evidence that the reporting layer functioned, the way a trial that confirms its pre-registered result earns warranted confidence. When they diverge, the discrepancy is preserved in a form others can examine, the way an independent board’s halt makes a safety signal impossible to bury.
There is a further lesson in how the regime came to be. Pre-registration and results-reporting exist because Vioxx demonstrated that unfavorable evidence could be quietly withheld and favorable interpretation quietly substituted. The remedy was to make the underlying record public and fixed in advance. Most reporting-layer failures today live in the same darkness that pre-registration was built to dispel — discovered by accident, if at all, with no committed independent record to reconcile against. Actual Vote’s long-run contribution is to supply that record systematically, which is the precondition for the kind of reform that followed in the drug case.
VII. Cross-References
This entry most directly illuminates the reporting-layer case studies, where the absence of a pre-committed independent record let an unverified result stand:
-
Shelby County, Tennessee, 2015. A single photographed poll tape that did not match the official result is the election equivalent of the raw trial data that contradicts the sponsor’s published claim — one piece of primary evidence, captured independently, that makes the discrepancy undeniable.
-
Prince William County, Virginia, 2020. A reporting-layer error that survived a risk-limiting audit at greater than 99 percent confidence is the election equivalent of a trial that confirmed its endpoint while the real harm lived in a variable the protocol never tracked — the verification was rigorous and aimed at the wrong question.
-
Monmouth County, New Jersey, 2022. A “100 percent accuracy” audit that reported a clean result while the wrong candidate held office is the election equivalent of a favorable published result that later proved materially wrong — the procedure was complete and its conclusion was false.
-
The Fraction Magic Architecture. A reporting system whose internal structure permits silent manipulation within its own rules is the election equivalent of a trial design that leaves room for undisclosed outcome-switching — the drug-regulation response would be mandatory pre-registration of the result against an independent record, foreclosing the manipulation in advance.
VIII. Further Reading
-
FDA — Frances Oldham Kelsey and the Thalidomide Tragedy. The FDA’s history of the case that produced the 1962 efficacy requirement.
-
Kefauver-Harris Amendment (1962). The statute that first required proof of effectiveness and informed consent.
-
FDA Guidance — Establishment and Operation of Clinical Trial Data Monitoring Committees (2006). The primary guidance on independent data safety monitoring boards.
-
ICMJE — Clinical Trial Registration Policy. The journal editors’ pre-registration requirement and its rationale.
-
Bresalier et al., “Cardiovascular Events Associated with Rofecoxib” (APPROVe), NEJM, 2005. The trial whose independent monitoring board triggered the Vioxx withdrawal.
-
David Graham, Senate Finance Committee testimony on Vioxx (2004). The FDA scientist’s account of the excess-harm estimates and the surveillance failure.
-
FDA — Advisory Committees: Critical to the Product Review Process. How independent outside experts supplement FDA review.
