How Cognitive Interviewing can Provide Validity Evidence of the Response Processes to Scale Items
The current theory about validity reflected in the Standards for Educational and Psychological Testing (AERA et al. in Standards for educational and psychological testing, American Psychological Association, Washington, DC, <CitationRef CitationID="CR1">1999</CitationRef>), offers no clear indications about the methods for gathering validity evidence about the response processes. Cognitive interviewing (CI) can play an important role answering the current demand about empirical and theoretical analyses of the response processes as a source of validity evidence in psychological testing. CI can provide validity evidence for investigating substantive aspects of construct validity and for contributing to the explanations for item and test scores (Zumbo in Handbook of statistics, vol 26, Elsevier, Amsterdam, pp. 45–79, <CitationRef CitationID="CR39">2007</CitationRef>; The concept of validity: revisions, new directions and applications, IAP—Information Age Publishing Inc., Charlotte, NC, pp. 65–82, <CitationRef CitationID="CR40">2009</CitationRef>). The aim of the study was to illustrate the use of cognitive interviewing method for gathering validity evidence on response processes. The search for evidence about the “response process” was guided by an argument-based approach to validity (Kane in Psychological Bulletin <CitationRef CitationID="CR17">1992</CitationRef>; Educational measurement, American Council on Education/Praeger, Washington, DC, pp. 17–64, <CitationRef CitationID="CR18">2006</CitationRef>). 21 cognitive interviews were carried out during the cognitive testing of the APGAR psychological scale intended to measure the “family support” construct. Cognitive interviewing provided validity evidence that explains how respondents interpret and respond to the APGAR items. Respondents maintained a shared interpretation of “family concept” while answering the APGAR scale items. Nevertheless, they included in the concept of family not only family members they live with but also other family members and even friends. CI participants were also capable of classifying their answers about the family support perception following a polythomous response system. Lastly, the role of CI in the Kane’s argument-based approach and Zumbo’s contextualized view of validity will be discussed. Copyright Springer Science+Business Media Dordrecht 2013
Year of publication: |
2013
|
---|---|
Authors: | Castillo-Díaz, Miguel ; Padilla, José-Luis |
Published in: |
Social Indicators Research. - Springer. - Vol. 114.2013, 3, p. 963-975
|
Publisher: |
Springer |
Subject: | Cognitive interviewing | Construct validity | APGAR | Cognitive response processes |
Saved in:
Online Resource
Saved in favorites
Similar items by subject
-
Campanelli, Pamela, (2015)
-
Developing Survey Measures of Inequality of Autonomy in the UK
Burchardt, Tania, (2012)
-
Investigating Question Meaning and Context Through In-Depth Interviews
Hicks, Wendy Davis, (2004)
- More ...