South Asia State of Minorities Report 2024: Economic, Political and Social Participation and Representation of Minorities
Abstract
This evaluation applies the CID Rubric v0.3.2 to The South Asia Collective's 2024 report "South Asia State of Minorities Report 2024: Economic, Political and Social Participation and Representation of Minorities." The composite score of 4.19/10 (Deficient) reflects significant methodological deficiencies across multiple dimensions.
A full academic narrative for this report is in preparation. The dimensional analysis below is generated from scored data. See the Scoring Data view for the complete evidence trail.
Dimensional Analysis
Definitional Precision
4/10Characterizing terms (extremist, nationalist, majoritarian) used without operational criteria
International human rights framework (UDHR, ICCPR, UN Declaration on Minorities) provides a legal definitional anchor. 'Minority' is defined broadly across religious, linguistic, ethnic, caste, and gender categories, applied across seven countries with different constitutional contexts. That cross-country definitional ambition is real. The operational gap: 'nationalist' appears 40 times and 'extremist' 12 times without published criteria distinguishing these labels from standard political activity. BJP appears 98 times in perpetrator-adjacent framing but no codebook establishes what constitutes a BJP-linked incident versus BJP-adjacent versus BJP-irrelevant. Expert surveys ask about 'discrimination' without published definitions. Afghanistan survey (N=90) reports 95% of respondents feel minority voices are inadequately represented — question framing and response options not published. Score: 4. Better than documents with no framework (SASAC Field Manual, D1=2). Worse than those with published codebooks (Pew, D1=9). International legal anchor earns points; absent operational bridge loses them.
Classification Rigor
N/A/10N/A for TYPE 6 Advocacy Documents. Weight redistributed proportionally across remaining six dimensions. Expert surveys within the report would face classification issues if scored independently — no coding protocol disclosed for categorizing expert responses.
Case Capture & Sampling
N/A/10N/A for TYPE 6 Advocacy Documents. D3 non-compensatory cap not triggered. Expert surveys (Afghanistan N=90, Pakistan N=53, Nepal N=63) are convenience samples. Afghanistan survey: 81% urban respondents, acknowledged but uncorrected. No sampling frame disclosed, no weighting methodology, no AAPOR-equivalent disclosure. These weaknesses affect the reliability of all survey-derived claims in the document even though D3 is formally N/A for the TYPE 6 classification.
Coverage Symmetry
5/10Within-country directionality extreme: Muslim target/agent ratio 18.8:1, Hindu 30.0:1, Christian and Dalit infinity
The report's strongest structural feature. Seven-country scope creates natural multi-directionality that single-country reports cannot achieve. Hindu minorities persecuted in Bangladesh, Pakistan, Afghanistan. Muslim minorities discriminated against in India and Myanmar. Tamil minorities face systemic exclusion in Sri Lanka. Christian minorities face violence across the region. All documented. Swap Test partially passes at the regional level — the report covers victims across religious lines — but fails within individual country chapters. India chapter: BJP=98 mentions, Bajrang Dal=3, no systematic coverage of minority-on-minority or minority-as-agent dynamics. Identity directionality: Muslim target/agent ratio 18.8:1, Hindu 30.0:1, Christian 35:0, Dalit 31:0. Every group appears overwhelmingly as target, never as agent. Content directionality analysis: anti-Muslim content at 100% of directional terms in India-specific text. Score: 5. Highest D4 among TYPE 6 documents in the corpus, reflecting genuine structural symmetry. Below Pew (D4=8) because within-country framework is unidirectional.
Source Independence
4/10Advocacy source dominance: 83.8% of 1,538 citations are advocacy/non-academic
Source type split from pipeline: advocacy/other 1,289 (83.8%), media 193 (12.6%), government 43 (2.8%), academic 13 (0.8%). Academic sources constitute less than 1% of all citations in a 420-page report. Top cited organizations: HRW (75 combined mentions), Amnesty International (25), USCIRF (16), Freedom House (8). Media sources skew toward outlets with documented editorial positions: The Wire (31 domain hits), Al Jazeera (54), Maktoob Media (32), Dawn (25). Self-citation: thesouthasiacollective.org (12 domain hits), southasiajusticecampaign.org (14, network-adjacent). Provenance Trace on three claims: India anti-Muslim discrimination → USCIRF → HRW → local media/advocacy → partial loop to SAC bulletins (2 loops). Pakistan blasphemy → HRW/Amnesty → UN SR submissions including by SAC (1 loop). Sri Lanka Tamil exclusion → Tamil Guardian/ICG → independent of SAC (0 loops). SAC coalition structure (Citizens Against Hate, Nagorik Uddyog, MRG International, Social Science Baha, Law and Society Trust) creates network-adjacent sourcing but is structurally broader than the SASAC/Savera closed loop documented in CID-0007/0008. Score: 4.
Verification Standards
4/10Denominator flag rate 64% (80/125 claims). Tier 3 data access. 15.8% URL shorteners.
Citation infrastructure: 1,538 URLs across 242 unique domains — highest raw count in CID corpus. One citation every 79 words. Herfindahl Index 0.0229 (low concentration). For context, CID-0008 had 543 footnotes in 30,000 words; SASoM's density is comparable at much greater scale. Denominator audit: 80 of 125 quantitative claims (64%) carry flags — percentages without visible denominators (65 instances), trend claims without base year (4), YoY changes without monitoring capacity controls (12). Expert surveys present percentages from small samples (N=53, N=63, N=90) without published instruments, sampling frames, or weighting. URL shorteners (bitly.cx 168, shorturl.at 54, tinyurl.com 21) account for 243 of 1,538 URLs (15.8%), creating verification barriers. Data access: Tier 3 — no download pathway, no formal request process, no replication infrastructure. Structure audit: Data Availability MISSING. For adapted TYPE 6 criteria (citation accuracy): the 242 unique domains suggest genuine sourcing effort, and media/NGO sources are independently verifiable. But volume without methodology is citation theater. Score: 4.
Transparency & Governance
5/10Contributors named with institutional affiliations in 'Note on the Contributors.' SAC member organizations publicly listed on thesouthasiacollective.org — Citizens Against Hate (India), Nagorik Uddyog (Bangladesh), Minority Rights Group International (London), Social Science Baha (Nepal), Law and Society Trust (Sri Lanka). Corrections policy detected — unusual positive for an advocacy document. Eight editions published since 2016 — organizational continuity. Funding source for the 420-page production not clearly disclosed. MRG International pages note the report was produced 'in the context of the programme Supporting religious pluralism and respect for freedom of religion or belief across South Asia' — suggesting program funding, but amount and source undisclosed. Conflict of interest statement absent despite contributors being advocacy actors directly involved in the issues covered. No external financial audit. No data ethics policy. Governance structure opaque — no editorial board, review process, or quality control protocols documented. Score: 5.
Counter-Evidence
3/10No limitations section across eight annual editions (2016-2024)
Structure audit detects Counter-Evidence present, Limitations MISSING. Orientation assessment: 'Recommendations present but no limitations = ADVOCACY orientation.' A 420-page, seven-country report with no limitations section is analytically significant. Every country presents contested information; no methodological uncertainty is acknowledged. Expert surveys' limitations not discussed. India chapter references government counter-narratives (BJP positions, improvements in Muslim civil service recruitment — the '70% jump') but frames these as evidence of the problem (majoritarianism) rather than engaging as substantive counter-evidence. Corrections policy present — positive structural signal. Eight editions published since 2016. No methodology evolution documented between editions. No evidence of any revision or retraction across the series. For adapted TYPE 6 criteria: limitations acknowledgment and corrections policy weighted more than engagement with critics. Corrections policy is a positive; the complete absence of a limitations section after eight editions is a structural failure. Score: 3.
Citation Ecosystem
Post-publication citation analysis tracks how this report's findings have been represented in subsequent publications, policy documents, media coverage, and advocacy materials. Entries marked as escalations indicate instances where the report was cited with scope or authority beyond what the original methodology establishes.
Escalation Patterns (2)
Claimed scope: ReliefWeb lists the SASoM 2022 as a resource on the Afghanistan country page, framing it alongside UN and government reporting on humanitarian conditions
Established scope: The SASoM 2022 report is an advocacy compilation synthesizing existing data, not primary research or government assessment. Its expert surveys use undisclosed convenience samples. The report itself states it is 'planned as a tool for advocacy.'
ReliefWeb (managed by UN OCHA) hosts the SASoM 2022 report at reliefweb.int/report/afghanistan/south-asia-state-minorities-report-2022. By listing it alongside humanitarian agency products and government reports, the UN platform confers institutional credibility that exceeds the report's methodological standing. The report's self-description as an advocacy tool is not surfaced in the ReliefWeb listing. This is scope escalation by context: placing an advocacy document in an institutional framework that implies it meets the evidentiary standards of its neighbors.
Claimed scope: SAC made a submission to the UN Special Rapporteur on institutional mechanisms for minorities, referenced in the SAC bulletin. The submission covers seven countries and draws on SASoM data.
Established scope: The SASoM report is an advocacy compilation with undocumented expert survey methodology. SAC's submission to the Special Rapporteur creates a pathway where advocacy data enters the UN reporting chain — potentially cited downstream as UN-validated findings.
SAC's bulletin (2024) documents a submission to the UN SR on institutional mechanisms for minorities 'in response to a call for inputs ahead of the SR's report to the General Assembly.' This creates a provenance loop: SAC produces report → SAC submits to UN SR → SR report may cite SAC data → SAC's subsequent reports cite the SR's report as independent institutional validation. The 2024 SASoM report itself cites ohchr.org 41 times, confirming heavy reliance on UN materials. The circularity is structural rather than intentional — civil society participation in UN processes is legitimate and expected — but the CID documents it because downstream actors may treat SR reports citing SAC data as independent corroboration of SAC's own findings.
Additional Citations Tracked (4)
Scope: MRG hosts and distributes the SASoM report series on minorityrights.org, noting each edition 'was produced by MRG's partner(s) with MRG' in the context of the programme 'Supporting religious pluralism and respect for freedom of religion or belief across South Asia.' MRG is both a SAC coalition member and a distribution/publication partner.
MRG International is simultaneously a SAC member organization, a publication partner, and a funder (the reports are produced 'in the context of' MRG's programme). This creates a structural circularity: MRG funds and distributes the report, which then cites MRG's own publications and frameworks. MRG's website pages for SASoM 2020, 2021, and 2022 all carry this dual role disclosure. The circularity is low-severity because MRG's involvement is disclosed — this is not hidden — but the structural overlap between funder, publisher, coalition member, and cited source is the kind of institutional entanglement D5 exists to document.
Scope: The Caravan published a December 2020 excerpt from the SASoM 2020 report on civic space in South Asia, accurately attributed as 'an edited excerpt from the South Asia State of Minorities Report 2020, published with permission from the South Asia Collective.' The excerpt focused on the India chapter's findings on press freedom and anti-CAA crackdowns.
Accurate citation. The Caravan identified the source as a specific report from a specific organization, reproduced with permission, and did not expand the claims beyond what the report established. This is the baseline for responsible citation of the SASoM series. The Caravan appears 4 times in the pipeline's org mention counts, confirming cross-citation but not at a level suggesting circular dependency.
Scope: Rural India Online (People's Archive of Rural India) hosts summaries of SASoM 2020 and 2021 reports as library resources, accurately summarizing key findings with appropriate attribution to the South Asia Collective.
PARI's 2021 summary accurately attributes findings — e.g., reporting that the SASoM 'cites a 2019 study conducted by Equality Labs' rather than presenting the finding as independently established by SAC. This is responsible secondary citation that preserves the provenance chain. PARI correctly identifies SAC as 'a human rights group' rather than as a research institution.
Scope: USCIRF is cited 16 times in the SASoM 2024 report as an authoritative source on religious freedom conditions. USCIRF's own reports score Advocacy-Grade to Deficient in the CID corpus (CID-0011 through CID-0026 longitudinal series). The SASoM report treats USCIRF findings as established fact without noting USCIRF's methodological limitations.
The circularity here is not organizational but evidentiary. SAC cites USCIRF. USCIRF's own reports rely heavily on NGO submissions — including from organizations in SAC's network. Both draw from the same pool of advocacy organizations (HRW, Amnesty, local media) as primary evidence. When SAC cites a USCIRF finding, it is often citing a finding that was itself derived from the same advocacy network SAC belongs to. This is not a closed loop — USCIRF has independent statutory authority and conducts its own hearings — but the shared evidentiary base means the two bodies provide less independent corroboration than their separate institutional identities suggest. CID longitudinal scoring (CID-0011 through CID-0026) documents USCIRF's own methodological gaps, which SAC does not acknowledge when citing USCIRF as authoritative.
Limitations of This Review
This evaluation assesses methodological rigor only. It does not evaluate the factual accuracy of individual claims or the existence of the phenomena the report describes. The CID Rubric v0.3.2 is designed for published research reports; application to certain document types requires adapted interpretation of specific dimensions. The CID has not independently investigated the organizations or individuals referenced in the report.