Plain Read Summary

South Asia State of Minorities Report 2024: Economic, Political and Social Participation and Representation of Minorities

CID-0027 The South Asia Collective 2024 Advocacy Document Rubric v0.3.2

Key Finding

The SASoM report demonstrates that citation volume alone does not constitute methodological rigor. 1,538 citations across 242 domains is the highest raw count in the CID corpus. But 84% are advocacy sources, 64% of quantitative claims have denominator problems, and the expert surveys are methodologically undocumented. Eight editions have been published since 2016 with no limitations section in any of them. The regional architecture provides genuine structural symmetry — the report's strongest feature — but the within-country analytical framework is uniformly unidirectional.

What This Report Is

The South Asia Collective, a coalition of human rights groups from seven countries, published this 420-page report in 2024. It covers how minorities are treated across Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan, and Sri Lanka. The organization calls the report “a tool for advocacy.”

What We Looked At

How a study is done determines whether you can trust what it found. CID scores methodology (how the research was done), not conclusions (what the research found). We classified this report as an Advocacy Document, which means it advances a stated policy position. That classification changes how we score it. Two dimensions (which measure specific aspects of methodology) do not apply to advocacy documents: Classification Rigor and Case Capture. The remaining six dimensions carry the full weight of the score.

What We Found

Sourcing is the report’s most visible weakness. We scored Source Independence (which measures whether a report’s evidence comes from truly separate origins) at 4 out of 10. Of 1,538 citations, 84 percent came from advocacy organizations or non-academic outlets. Academic research accounted for 13 citations total. That is less than 1 percent. When nearly all of your sources share your mission, independent confirmation becomes hard to tell apart from repetition.

The report’s numbers are hard to check. We scored Verification Standards (which measures whether an outsider can confirm the report’s claims) at 4 out of 10. The report cites 1,538 sources across 242 websites — the largest citation count in our scored corpus. Volume is not the problem. What sits beneath it is. Sixty-four percent of the report’s statistical claims have missing or unclear denominators (the base number that gives a percentage meaning). The report includes expert surveys from Afghanistan, Pakistan, and Nepal. None publish the survey questions, the expert selection criteria, or the data processing method. One survey reports that 95 percent of respondents feel minority voices are inadequately represented. We cannot evaluate that claim because we cannot see the instrument that produced it.

Eight annual editions and not one limitations section. We scored Counter-Evidence (which measures whether a report acknowledges what it cannot prove) at 3 out of 10. This is a 420-page document covering seven countries. The South Asia Collective has published eight editions since 2016. None contains a section explaining the report’s limitations. A corrections policy exists — a positive signal. But eight years of publication with zero acknowledged limitations does not indicate a flawless method. It indicates that self-assessment is not happening.

Regional scope is the report’s strongest feature. We scored Coverage Symmetry (which measures whether a report’s coverage matches its stated mission) at 5 out of 10. Most reports in this space focus on one country and one direction. This report covers Hindu minorities in Pakistan, Muslim minorities in India, Tamil minorities in Sri Lanka, and Christian minorities across the region. That structure creates natural balance no single-country report can match. The score stops at 5 because the balance breaks down inside each country chapter. In the India chapter, every minority group appears almost exclusively as a victim. No chapter examines cases where minority groups act as agents rather than targets.

The Bottom Line

This report scored 4.19 out of 10. That places it in the Deficient band (scores from 4.0 to 5.9). Deficient means significant gaps in methodology (how the research was done) weaken the report’s reliability as independent research. No non-compensatory cap (an automatic score limit triggered by failure on a key dimension) was applied. The grade held steady under three different ways of weighting the dimensions — not a borderline case. The score reflects methodology only. The report’s conclusions about minority persecution in South Asia may be correct even though its published methods have gaps.

Citation Context

How this report's findings have been cited or applied after publication. Severity reflects the gap between what the report establishes and how it was represented.

ReliefWeb / OCHA Minor

What was claimed: ReliefWeb lists the SASoM 2022 as a resource on the Afghanistan country page, framing it alongside UN and government reporting on humanitarian conditions

What the report actually says: The SASoM 2022 report is an advocacy compilation synthesizing existing data, not primary research or government assessment. Its expert surveys use undisclosed convenience samples. The report itself states it is 'planned as a tool for advocacy.'

ReliefWeb (managed by UN OCHA) hosts the SASoM 2022 report at reliefweb.int/report/afghanistan/south-asia-state-minorities-report-2022. By listing it alongside humanitarian agency products and government reports, the UN platform confers institutional credibility that exceeds the report's methodological standing. The report's self-description as an advocacy tool is not surfaced in the ReliefWeb listing. This is scope escalation by context: placing an advocacy document in an institutional framework that implies it meets the evidentiary standards of its neighbors.

UN Special Rapporteur on Minority Issues Medium

What was claimed: SAC made a submission to the UN Special Rapporteur on institutional mechanisms for minorities, referenced in the SAC bulletin. The submission covers seven countries and draws on SASoM data.

What the report actually says: The SASoM report is an advocacy compilation with undocumented expert survey methodology. SAC's submission to the Special Rapporteur creates a pathway where advocacy data enters the UN reporting chain — potentially cited downstream as UN-validated findings.

SAC's bulletin (2024) documents a submission to the UN SR on institutional mechanisms for minorities 'in response to a call for inputs ahead of the SR's report to the General Assembly.' This creates a provenance loop: SAC produces report → SAC submits to UN SR → SR report may cite SAC data → SAC's subsequent reports cite the SR's report as independent institutional validation. The 2024 SASoM report itself cites ohchr.org 41 times, confirming heavy reliance on UN materials. The circularity is structural rather than intentional — civil society participation in UN processes is legitimate and expected — but the CID documents it because downstream actors may treat SR reports citing SAC data as independent corroboration of SAC's own findings.

4 additional citations tracked. View full citation context →

Organization Response

The South Asia Collective has been invited to respond to this assessment. If a response is received, it will be published here in full and without editing.

Status: Pending