Term
14 Threats to Construct Validity
|
|
Definition
1. Inadequate explication of construct 2. Construct Confounding 3. Mono-Operation Bias 4. Mono-Method Bias 5. Confounding Constructs with Levels of Constructs 6. Treatment Sensitive Factorial Structure 7. Reactive Self-Report Changes 8. Reactivity to the Experimental Situation 9. Experimenter Expectancies 10. Novelty and Disruption Effects 11. Compensatory Equalization 12. Compensatory Rivalry 13. Resentful Demoralization 14. Treatment Diffusion |
|
|
Term
| Inadequate Explication of Constructs |
|
Definition
Failure to adequately explicate a construct may lead to incorrect inferences about the relationship between the operation and construct. |
|
|
Term
|
Definition
Operations usually involve more than one construct, and failure to describe all the constructs may result in incomplete construct inferences. |
|
|
Term
|
Definition
Any one operationalization of a construct both underrepresents the construct of interest and measures irrelevant constructs,complication inference. |
|
|
Term
|
Definition
When all operationalizations use the same method (e.g., self-report), that method is part of the construct actually studied. |
|
|
Term
Confounding Constructs with Levels of Constructs
|
|
Definition
Inferences about the constructs that best represent study operations may fail to describe the limited levels of the construct that were actually studied.
|
|
|
Term
Treatment Sensitive Factorial Structure
|
|
Definition
The structure of a measure may change as a result of treatment, change that may be hidden if the same scoring is always used. |
|
|
Term
| Reactive Self-Report Changes |
|
Definition
Self-reports can be affected by participant motivation to be in a treatment condition, motivation that can change after assignment is made. |
|
|
Term
| Reactivity to the Experimental Situation |
|
Definition
Participant responses reflect not just treatments and measures but also participants' perceptions of the experimental situation, and those perceptions are part of the treatment construct actually tested. |
|
|
Term
Experimenter Expectancies
|
|
Definition
The experimenter can influence participant responses by conveying expectations about desirable responses, and those expectations are part of the treatment construct as actually tested.
|
|
|
Term
| Novelty and Disruption Effects |
|
Definition
Participants may respond unusually well to a novel innovation or unusually poorly to one that disrupts their routine, a response that must then be included as part of the treatment construct description. |
|
|
Term
Compensatory Equalization
|
|
Definition
When treatment provides desirable goods or services, administrators, staff, or constituents may provide compensatory goods or services to those not receiving treatment, and this action must then be included as part of the treatment construct description.
|
|
|
Term
|
Definition
Participants not receiving treatment may be motivated to show they can do as well as those receiving treatment, and this compensatory rivalry must then be included as part of the treatment construct description. |
|
|
Term
|
Definition
Participants not receiving a desirable treatment may be so resentful or demoralized that they may respond more negatively than otherwise, and this resentful demoralization must then be included as part of the treatment construct description.
|
|
|
Term
|
Definition
Participants may receive services from a condition to which they were not assigned, making construct descriptions of both conditions more difficult. |
|
|
