V-Dem is the academic project that labeled India an 'electoral autocracy' in 2021 — the phrase now quoted worldwide. The CID graded all ten Democracy Reports from 2017 to 2026, and they score Adequate at the very top of the band — the highest-scoring institutional report in the corpus, behind only Pew's one-off 2021 survey (the corpus's lone Research-Grade study). This is the mirror image of the Amnesty, USCIRF, and Freedom House country chapters: where those lacked a codebook, a sampling frame, inter-coder reliability, and a way to check claims inside the document, V-Dem has all four — a public codebook, expert coding run through a Bayesian model with confidence intervals, and a fully downloadable 31-million-point dataset. The grade describes the apparatus behind the 'electoral autocracy' call, not whether the call is correct; a skeptic can download the data and test the threshold themselves.
Composite score 7.94 / 10 — Adequate. Raw weighted score was 7.94.
| Dim | Dimension | Score | Weight | Flag |
|---|---|---|---|---|
| D1 | Definitional Precision | 8 | 10.8% | — |
| D2 | Classification Rigor | 8 | 16.2% | The decisive upgrade over Freedom House (5): inter-coder reliability is the center of the method, not an afterthought. |
| D3 | Case Capture & Sampling | 8 | 13.5% | — |
| D4 | Coverage Symmetry | 8 | 13.5% | — |
| D5 | Source Independence | 8 | 9% | — |
| D6 | Verification Standards | 8 | 16.2% | Verification (D6) = 8 ≥ 7 — the Research-Grade gate is OPEN. The only document in the corpus to reach it; the series falls just 0.06 short of the 8.0 line on arithmetic alone. |
| D7 | Transparency & Governance | 8 | 4.5% | — |
| D8 | Counter-Evidence | 7 | 6.3% | The only score that moves across the series: 6 (Era A) → 7 (Era B), tracking the peer-reviewed ERT method and the 2024 in-report self-critique. |
| Composite Score | 7.94 | Adequate | ||
Scope: The score credits V-Dem's referenced codebook, public dataset, and Bayesian measurement model, consistent with how Freedom House's companion methodology was credited. Under a conservative PDF-stands-alone reading the series scores about 6.2 — still Adequate, but mid-band. The pre-registration boundary decision is the analyst's.
Scope: Conditional Module activated. V-Dem aggregates 200-plus scored indicators into the Liberal Democracy Index and the four-category Regimes of the World classification.
Scope: Across ten editions only D8 (counter-evidence) moves, 6 (Era A) to 7 (Era B), tracking the peer-reviewed ERT method and the 2024 in-report self-critique. Every other dimension is invariant — here the invariance is the rigor, not its absence.
V-Dem's codebook (v14/v15) provides operational definitions for every one of its 200-plus indicators, each on an ordinal scale with written anchors for each scale point and coding guidance for hard cases. The four Regimes of the World categories are defined by explicit, published thresholds, with a documented uncertainty variant for grey-zone cases near a threshold. The report names these definitions and version numbers inline. This is materially more granular than the Freedom House 25-question framework (scored 6). Held below 9-10 because the annual report PDF reprints the definitions only partially — the full operational apparatus lives in the codebook a reader must fetch separately (an in-report definitions section appears in only 3 of 10 editions). Score of 8 reflects a genuinely codebook-grade definitional system, credited as referenced, docked one notch for not being self-contained in the report.
The decisive upgrade over Freedom House (5): inter-coder reliability is the center of the method, not an afterthought.
This is the dimension on which V-Dem decisively separates from Freedom House, which scored 5 for publishing zero inter-coder reliability data and using no blind coding. Roughly five independent country experts code each indicator, and their ratings are run through a Bayesian item-response-theory measurement model that estimates each coder's reliability and systematic bias, reconciles disagreement, and outputs a point estimate with a confidence interval. Anchoring vignettes and bridge coding link coders to a common scale. The report carries the markers throughout: expert coders born in 185 countries, 4,200 contributing scholars, and confidence intervals on the headline figures. Held below 9-10 because the report PDF does not reprint per-indicator reliability statistics — they reside in the methodology papers and dataset. Score of 8 reflects a measurement model built around inter-coder reliability, the single biggest upgrade over every prior document in the corpus.
Universal coverage: 202 countries from 1789 to the present, every one coded on the identical fixed framework, enabling genuine longitudinal and cross-national comparability. This is broader than Freedom House (scored 7) on both the country and the time axis. The indicator set is transparent and stable year to year. Held below 9 because the within-country evidence-gathering of individual experts is not documented at the per-claim level, and the deep historical coverage necessarily rests on thinner source material than the contemporary years. Score of 8 reflects universal, fixed-framework coverage with documented indicator selection.
The framework is structurally neutral and universalist: it scores electoral process, freedom of expression, civil society, rule of law, and constraints on the executive for every state, with no identity-specific criteria, and passes the Swap Test. India's prominence in the report is a product of the population-weighted metric — a large country moves the global average more than a small one — not of any India-specific or identity-specific framing, and the report says so explicitly. Identity directionality is minimal across the series. Held below 9 because narrative emphasis naturally tracks decline over improvement, and the editorial choice to foreground population-weighted figures structurally elevates large countries like India — a defensible choice, but a choice (see D8). Score of 8 reflects strong structural neutrality and accurate, non-overstated scope claims.
V-Dem is an academic project housed at the University of Gothenburg, funded through research councils and foundations rather than by the government of any country it assesses — a cleaner independence position than Freedom House (scored 7, docked for structural dependence on US-government funding). Its evidence base is its own network of independent country experts, not self-citation to prior advocacy. The report's external citation profile is diverse and broadens sharply over the series, from 6 unique domains in 2017 to 99 by 2026, mixing academic, media, and advocacy sources. Held below 9 because the report draws on secondary journalism and advocacy reporting for narrative color around the index findings, and because research-council and foundation funding, while disclosed and independent of assessed subjects, is still external funding. Score of 8 reflects academic independence and an increasingly diverse evidence base.
Verification (D6) = 8 ≥ 7 — the Research-Grade gate is OPEN. The only document in the corpus to reach it; the series falls just 0.06 short of the 8.0 line on arithmetic alone.
This is the dimension that gates Research-Grade, and where crediting the companion apparatus matters most. V-Dem publishes the full disaggregated dataset — every indicator, every country, every year, with point estimates and confidence intervals — as Tier-1 public, machine-readable, replicable data (31 million data points, downloaded over 360,000 times). The measurement model is documented and reproducible, and the report reports confidence intervals inline and names the exact dataset and codebook versions and variables it uses. The 2021 India passage demonstrates the standard in action: it states the prior year's classification was highly uncertain and that re-estimation with more and better data raised the certainty — a documented, data-driven self-correction. This is verification down to the indicator level, far beyond Freedom House (scored 5). Held below 9 because the individual expert coders' raw responses are confidentialized to protect coders, and per-claim sourcing in the report's narrative prose remains uneven. Score of 8.
V-Dem is governed as an academic institution with a steering committee and scientific oversight, names its 4,200 contributing scholars, publishes its data, codebook, and graphing tools openly, and discloses funding in every edition (a conflict-of-interest statement appears by 2025). This edges out Freedom House (scored 7). Held below 9 because per-edition itemization of funders inside the report PDF is partial. Score of 8 reflects strong academic transparency and open data infrastructure.
The only score that moves across the series: 6 (Era A) → 7 (Era B), tracking the peer-reviewed ERT method and the 2024 in-report self-critique.
V-Dem's defining counter-evidence practice is structural: every estimate it publishes carries its own confidence interval, so uncertainty is engaged at the level of each number rather than relegated to a disclaimer. In Era A (2017-2020, scored 6) uncertainty reporting and limitations sections appear in some editions, but change-detection uses the cruder 10-year-difference rule. In Era B (2021-2026, scored 7) the peer-review-vetted ERT method is adopted and explained, and the 2024 report contains a striking self-critique of its own headline finding: it warns that the population-weighted metric makes it look as though global democracy declined dramatically 'largely because India is backsliding,' states plainly that this framing 'may give misleading impressions,' and shows the arithmetic both with and without India. The series-level score reflects the current Era B state. Held below 8 because systematic engagement with the substantial external academic literature critiquing expert-coding and index aggregation is not carried inside the report.