Scoring Data

Indian American Attitudes Survey (IAAS 2020)

CID-0004 Carnegie Endowment for International Peace 2020 Survey Rubric v0.3.2

Dimension-by-dimension CID Rubric scores
Dim Dimension Score Weight Flag
D1 Definitional Precision 8 12%
D2 Classification Rigor 8 18%
D3 Case Capture & Sampling 9 15%
D4 Coverage Symmetry 8 15%
D5 Source Independence 7 10% csohate.org appears once in citations — provenance verification pending
D6 Verification Standards 5 18% ⚑ Scoring rule limits grade — no documented data access pathway
D7 Transparency & Governance 8 5%
D8 Counter-Evidence 8 7%
Composite Score 7.6 Adequate

Metrics

Denominator Rate
91%
87 of 96 numeric claims
Share of numeric claims that include a denominator or base rate. Low rates suggest missing context.
Self-Citation Rate
6%
citations from org or affiliates
How often the report cites its own organization or close affiliates. High rates reduce source independence.
Critical Flags
0
of 2 total flags
Flags at "high" or "severe" severity — methodological issues that materially affect the score.

Methodology Flags

Medium: D6 · Data Access

Scope: The survey data is not available for download and Carnegie does not document a formal research data request process. This distinguishes it from Pew, which maintains a publicly documented archive request process that satisfies the revised verification standard. If Carnegie documents an equivalent access pathway, this report would score approximately 8.2.

Low: D5 · Csohate Citation

Scope: csohate.org appears once in citations. Provenance and relationship to CSOH organizational structure requires verification before this is cleared.

Scoring Notes

D1

Definitional Precision

8/10 12% weight

Political and religious identity constructs operationalized through validated question batteries. Community-specific terminology defined with examples.


D2

Classification Rigor

Adapted
8/10 18% weight

YouGov panel with quality screening and panel-level demographic profiling. Weighting methodology documented against ACS benchmarks.


D3

Case Capture & Sampling

Adapted
9/10 15% weight

ACS-weighted YouGov panel. Denominator reporting at 236 and 225 flags — near-universal across survey items. Subgroup n's reported throughout.


D4

Coverage Symmetry

8/10 15% weight

Questions posed symmetrically across religious and political identity categories. Zero directional content in question framing.


D5

Source Independence

7/10 10% weight

csohate.org appears once in citations — provenance verification pending

Carnegie is an independent nonpartisan institution. No documented advocacy positions on Indian American identity politics.


D6

Verification Standards

Adapted
5/10 18% weight

⚑ Scoring rule limits grade — no documented data access pathway

Data not available for open download and no formal research request process is documented. Under the revised rule (v0.3.1), a documented formal request process would satisfy the standard — as it does for Pew. Carnegie does not currently document such a process.


D7

Transparency & Governance

8/10 5% weight

Carnegie institutional transparency. Funding disclosed. Authors named with affiliations.


D8

Counter-Evidence

8/10 7% weight

Footnote 29 constitutes affirmative counter-evidence engagement — explicit critique of a competing methodology. This is the highest D8 score in the corpus at this score range.

Citation Context

How this report's findings have been cited or applied after publication. Severity reflects the gap between what the report establishes and how it was represented.

2022–2024 U.S. election campaigns Significant

Claimed scope: Indian American partisan preferences as a community

Established scope: YouGov panel weighted to ACS — robust estimate, but panel methodology not disclosed in political citations

Partisan findings cited without disclosing the YouGov panel methodology or ACS weighting. Survey design is nonpartisan; the way it is cited in campaign materials is often not.

Additional Citations Tracked (1)

Equality Labs (response to fn. 29)

Scope: Defense of Equality Labs sampling approach without engaging the representativeness argument

The Equality Labs published response to footnote 29 does not address the core representativeness critique. The critique stands unrebutted on methodological grounds.