Shared Flashcard Set

Details

Methods
I/O Methods
50
Psychology
Graduate
09/02/2015
Click here to study/print these flashcards.

Create your own flash cards! Sign up here.

Additional Psychology Flashcards

 

 

Cards

Term
Have at least 2 times the number of items you plan to have in final scale
 Definition
Cascio & Aguinis (2005)
Term
Cross-cultural methods (back translation and measurement invariance)
 Definition
Schaffer & Riordan (2003)
Term

The Earth is Round, P< .05: Should rely on effect sizes and CIs

 Definition
Cohen (1995)
Term
Crud Factor: Null hypothesis will never actually = 0.
 Definition
Meehl (1979)
Term
The earth is NOT round, p = .00: NHST is still useful
 Definition
Cortina & Landis (2011)
Term
Controlling isn't a magical purification tool
 Definition
Spector & Brannick (2011)
Term
Difference scores? Use polynomial regression.
 Definition
Edwards (1995)
Term
Bootstrapping for mediation
 Definition
Preacher & Hayes (2004; 2008)
Term
Centering in HLM
 Definition
Enders & Tofighi (2007)
Term
HLM book
 Definition
Raudenbush & Bryk (2002)
Term

SEM fit indices benchmarks

  1. CFI/TLI = .95
  2. SRMR = .08
  3. RMSEA = .06
 Definition
Hu & Bentler (1999)
Term
P value is artibrary. We should rely on the practical importance of effect sizes
 Definition
Rosnow & Rosenthal (1989) - Also introduces Rosenthal's BESD, which is desigend to indicate practical importance of an effect size estimate.
Term
Meta Method: Use corrections to find Rho
 Definition
Hunter & Schmidt (1990)
Term
Meta Method; No corrections - use variance weight (and Q test to check for possibility of moderators)
 Definition
Hedges & Olkins (1985)
Term
Meta Method - Bare bones. Only deals with observables.
 Definition
Rosenthal (1991)
Term
P value (difficulty) should average .50 (and range between .1 and .9)
 Definition
Allen & Yen (2001)
Term
Item-total correlations should be at least .30 (otherwise they do not discriminate well).
 Definition
Nunnally (1978)
Term
Reverse coding can result in 2 artificial factors
 Definition
Spector et al (1997)
Term
Item Parceling
 Definition
Little et al. (2002)
Term
CMV isn't necessarily a big deal. we must look at it via a case by case basis
 Definition
Spector (2006)
Term
Provides recommendations to strengthen longitudinal studies
 Definition
Zapf et al. (1996)
Term
Overview of research design, validity, and reliability
 Definition
Shaddish et al. (2002)
Term
Mundane Realism (Stone-Romero, 2002)
 Definition
The degree to which the circumstances that research participants encounter in the lab are highly similar to the circumstances that would be found in settings in which the phenomenon occurs naturally
Term
Overreliance on theory stifles potential impact of interesting findings
 Definition
Hambrick et al. (2007)
Term
Theory is a thorough description of underlying processes that connect phenomena (not simply references, diagrams, or variables)
 Definition
Sutton & Staw (1995)
Term
There is no automatic inference machine. Statis cannot provide a test for causation, and you certainly can't just throw data into a computer and have it tell you the answer. You have to make inferences and decisions.
 Definition
Meehl (1971)
Term
The legitimacy of a mediation cliam depends on the study design and setting
 Definition
Stone-Romero and Rosopa (2008)
Term
Field and lab results often converge. Lab generally procduces psychological truths
 Definition
Anderson et al. (1999)
Term
Lab and field are complementary. Both should be equally respected.
 Definition
Dobbins et al. (1988)
Term
Randomized experiments can be generalizable; They serve as a potent design for causality
 Definition
Highhouse (2009)
Term
Review of Experience Sampling. Daily Diary Methods.
 Definition
Fisher & To (2012)
Term
Self-reports are good for certain purposes (e.g., when trying to assess how people feel about their jobs)
 Definition
Spector (1994)
Term
Ideal point models
 Definition
Stark et al. (2006)
Term
IRT Book
 Definition
Embretson & Reise (2000)
Term
When a construct is viewed as causing a measure
 Definition
Reflective measures (Edwards & Bagozzi, 2000)
Term
When a measure is viewed as causing a construct
 Definition
Formative measures (Edwards & Bagozzi, 2000)
Term
IRT parameters
 Definition

a = discrimination (slope)

b = difficulty (if easier, curves right further to the left)

c = guessing parameter (lower asymptote of IRC)
Term
Assumptions of ANOVA
 Definition

Independence of Observations

Normality

Homogeneity of Variances
Term
Artifacts
 Definition
  1. Unreliability
  2. Error in the Criterion
  3. Range Restriction/Range enhancement (S+H correction should be used for in any concurrent validity study)
Term
CTT
 Definition
X = T + E
Term
Reliability
 Definition
Square root of reliability is the upper bound on validity
Term
MTMM Matrix
 Definition
Campbell & Fiske (1959)
Term
Threats to Statistical Conclusion Validity
 Definition
  1. Statistical Power
  2. Violation of Independence
  3. Fishing/The Error Rate Problem
  4. Unreliability of Measures
  5. Reliability of Treatment Implementation
  6. Random Irrelevancies in the setting
  7. Heterogeneity of Respondents
  8. Restriction of Range
  9. Inaccurate Effect Size Estimation
Term
Threats to Internal Validity
 Definition
  1. Ambiguous Temporal Precedence
  2. Selection
  3. History
  4. Mortality
  5. Regression to the Mean
  6. Maturation
  7. Testing
  8. Instrumentation
  9. Additive and Interactive Effects (e.g., Selection x History)
  10. Ecological Fallacy
Term
Threats to External Validity
 Definition
  1. Units x Treatment
  2. Testing x Treatment
  3. Setting x Treatment
  4. Time x Treatment
  5. Different Treatment Interactions
Term
Schmidt & Hunter (1977)
 Definition
Validity Generalization
Term
Measurement Invariance
 Definition
  1. Configural
  2. Metric
  3. Scalar
  4. Error
Term
Steps for Survey Development
 Definition
  1. Conduct a Literature Review
  2. Operationally Define the Construct
  3. Ask Individuals to come up with CIs (Flanagan, 1954)
  4. Write Items
  5. Pilot Test the Items
  6. Delete Poor Items
  7. Administer the Survey to a Large Population
  8. Evaluate the Survey (Reliability, Criterion Validity, Statistical Artifacts, Construct Validity, Group Differences/Differential Prediction)

 
Term
DESIGNS!!
 Definition
Term
Threats to Construct Validity
 Definition
- Poorly defined or counfounded construct
- Mono-Operation bias (Single operationalization of construct)
- Mono-method bias
- Interaction of procedure and treatment
- Diffusion/imitation of treatment (tx contamination from tx to control group)
- Experimenter expectancies (experimenter provides clues about how to act/react)
- Confounding levels of constructs with other constructs
- Compensatory equalization of treatment (we may compensate control group in other ways bc it is inherently unfair to deny tx)
- Compensatory rivalry: Control works hard to seem as good as tx group
- Resentful demoralization of respondents receiving less desirable tx
- Hypothesis guessing
Supporting users have an ad free experience!