Shared Flashcard Set

Details

Quantitative Research Methods
Final
162
Other
Undergraduate 1
02/04/2012

Additional Other Flashcards

 


 

Cards

Term
Pearson r
Definition

 is a statistic that helps you understand the strength of the linear relationship between two variables.

Term
scientific method
Definition

essence all propositions are subjected to an empirical (scientific) test   

Term

Empiricism

Definition

practice based on experiment and observation; doctrine that all knowledge is derived from sense-experience

Term

Goals of Behavioral Science (DEPF):

Definition

 description, prediction, finding causes, explanation

Term

Basic Research

Definition

 fundamental questions about nature of behavior, often tests theories of behavior

Term

Applied Research

Definition

issues in which there are practical problems/potential solutions; often guided by basic theory and research

Term

Hypothesis

Definition

 statement that asserts about what is true in particular situation, often a statement asserting that two or more variables are related to each other

Term

Prediction

Definition

 statement that asserts concerning what will occur in particular research investigation – ex/ schizophrenia is caused by a virus

Term
Theory
Definition

 set of explanatory statements about behavior that can be tested through empirical research organize/explain existing data, leads to new insight, supported when data consistent with theory, revised when new data are collected that reveal weaknesses, replaced by newer theories that provide better explanations – ex/ Darwin's theory of evolution

Term
 Abstract
Definition

 provides an overview of the whole article

Term
 Intro 
Definition

general overview of literature with specific research questions/expectations

Term
 Method
Definition

This section provides the reader with detailed information about how your study was conducted.

Includes:  participants, research design, procedure

Term
No risk research
Definition

exempt from IRB review, studying normal educational practices, use of educational tests (ex/ aptitude/achievement measuring), survey and observation of public behavior except when subject might be identified/sensitive behavior studied, archival research using existing data

Term
Minimal risk research
Definition

standard psych measures and voice recordings, studies of cognition/perception, full informed consent is not generally necessary, but debriefing/other ethical concerns important

Term
Full review research
Definition

 research that may involve physical/psychological stress, invasion of privacy, measure of sensitive info where subject may be identified requires full review by IRB

Term
Cost-Benefit Analysis
Definition

 cost=potential risk to participants, benefit=participants, science, society 

Term
Informed Consent
Definition

participants agree to participate after being informed about purpose of study, potential risks/benefits, rights to refuse/terminate participation importance increases with increasing risk to participant

Term
Debriefing
Definition

after study, inform participants about research questions being addressed, and why deception, if used, was needed

Term
Variable
Definition

any event, situation, behavior, or individual characteristic that varies, has at least two values ex/ gender: male or female

Term
Operational Definition
Definition

definition of variable in terms of operations/techniques the researcher uses to measure/manipulate it

Term
Non-experimental method
Definition

 behavior is observed as it naturally occurs, variables are only measured  problems: direction of cause and effect (ex/ does x cause y?), uncontrolled third variable (ex/ maybe z causes x and y?) 

Term
Causal Sequence
Definition

 first IV then DV measured (cause effect) x causes y, not y causes x

Term
 Construct Validity
Definition

 

 were variables adequately measured/manipulated? look at operational definition of variables that were studied

 

Term
 Internal Validity
Definition

 can I infer that x caused y?  Higher in experimental method



 is all about cause and effect. X causes Y. 

Term
 External Validity
Definition

can I generalize beyond the study? Other types of participants and ways of studying variables

Term
True Score Theory
Definition

 obtained score reflects true score and measurement error – ex/ 0.04 seconds = true score and any measurement error reliable measures have little measurement error

Term
Measurement Error
Definition

 a single score reflects true score but ex/ a bit faster today because good night's sleep, a bit slower cause you missed lunch

Term
The Best Measure
Definition

 multiple measures to average measurement error, not possible for most research  use measures that have little measurement error = reliability 

Term
Test-Retest Reliability
Definition

 take measure twice, reliability=when two scores are similar

Term
internal consistency reliability 
Definition

estimation we use our single measurement instrument administered to a group of people on one occasion to estimate reliability. In effect we judge the reliability of the instrument by estimating how well the items that reflect the same construct yield similar results. We are looking at how consistent the results are for different items for the same construct within the measure. There are a wide variety of internal consistency measures that can be used.

Term
Inter-Rater Reliability
Definition

 sometimes rater/judge can make an observation of behavior examines agreement of observations made by two or more raters/judges

Term
Increasing Reliability (CCC)
Definition

 combine multiple measures, careful recording procedures, clear and unambiguous questions

Term
Face 
Definition

degree to which measurement device appears to accurately measure a variable 

Term
CONVERGENT Validity
Definition

... do scores on measure relate to other measures in expected ways? – Ex/ do people with high self efficacy predict that they will perform better on task?

... is the actual general agreement among ratings, gathered independently of one another, where measures should be theoretically related.

Term
 Criterion 
Definition

degree to which a measurement device accurately depicts behavior on criterion measure – ex/ paper and pencil measure of leadership – ability predicts actual leadership behavior 

Term
Reactivity
Definition

 a measure is reactive if it changes the behavior being measured, useful to use unobtrusive measures to complement studies using more reactive measures

Term
 Nominal: 
Definition

variables that have two or more categories, no numeric scales – ex/ male/female

Term
Ordinal 
Definition

rank order points on scale, numeric values limited – ex/ 2, 3, or 4-start restaurants  intervals between items are unknown and are not equa

Term
 Interval 
Definition

numeric properties are important, values such as 1, 2, 3… used in calculations. ex/ score on personality test & assume equal amounts between numbers & no true zero amount

Term
Ration Scale
Definition

 has true zero point (absence of variable) use more sophisticated statistical tests for ration and interval scales 

Term
Triangulation of methodologies 
Definition
In-depth interview, surveys, lab studies
Term
Partial concealment 
Definition

 the subject knows they are being observed and measured but they do not know for what 

Term
survey research 
Definition

Employs questionnaires and interviews to ask people to provide information about themselves - their attitudes, beliefs,  demographics, etc...

Term
response set
Definition

 A pattern of individual response to questions on a self-report measure that is not related to the content of the question.

Term
population
Definition

The defined group of individuals from which a sample is drawn

Term
probability sampling
Definition

You can specify the probability that any member of the population will be included in the sample

Term
cluster sampling
Definition

Used when you can’t identify individuals

Randomly sample clusters of people in identifiable groups, e.g., classes in a school


Used when the difference between groups is not relevant 

Term
non probability sampling
Definition

A type of sampling procedure in which one cannot specify the probability that any member of the population will be included in the sample

Term
response rate
Definition

Percentage of those sampled that complete the survey

Term
panel study
Definition

Study the sample people at two or more points in time

Term
confederate
Definition

 the participants that are in the study that know what is going on and manipulate the real participant.

Term
true experiments
Definition

 really good valid, external and internal good validities.


Posttest-only design

Pretest-Posttest design

Random assignment to conditions

Experimental control of all other variables

Term
posttest
Definition

 we manipulate independent variable and test the dependent variable.

Term
pretest-posttest
Definition

 when they come in they are tested. (within subject or repeated measures design)

Term
between subject
Definition

 compare the control group from the experimental group . 

Term
within subject
Definition

 testing the same group or person 

Term
repeated measure 
Definition

 same individuals in all conditions 

Term

1: prevent researchers from subconsciously letting their opinions or preferences affect their decisions about what participants gets exposed to what

2: even distribution on that normal curve on our individual participants. SO we won’t end up with same characteristics we want an equal chance.

3: lets us derive probabilities . It is the probability that if i go look at the people in the real world they would act the same way that responded in the experiment. 

Definition

three reasons why we randomize our designs:

Term
sampling
Definition

The process of choosing members of a population of interest

Term
population
Definition

The defined group of individuals that the researcher is interested in.

Term
relational hypothesis
Definition

When we have a ___________: survey, systematic observation, archival research 

Term
causal hypothesis
Definition

When we have a _____________: experimental design (usually with a manipulation)

Term
arhcival research
Definition

analyzing an existing data.

Term
Experimental method
Definition

The researcher manipulates the independent variable, to create groups, that differ in the levels of the dependent variable.


 addresses problems of inferring cause and effect, manipulate the first variable and observe the effect on the second variable, control for all other variables

Term
simple random sample
Definition

 allows a known probability that each potential participant will be chosen. 

Term
stratified random sampling
Definition

Divide population into strata

Term
nonprobability sampling
Definition

A type of sampling procedure in which one cannot specify the probability that any member of the population will be included in the sample

Term
Opportunity sampling (convenience sampling).
Definition

 

Whoever you can get to take part in your study.  You don’t use any special techniques to find your subjects.

Term
judgment sampling 
Definition


 

is obtained according to the discretion of someone who is familiar with the relevant characteristics of the population. 

Term

Naturalistic observation- also called “field observation”

Definition

In this method, the researcher collect data over long period of time using variety of techniques. 

Term
case study
Definition

provides a description of an individual (person, business, neighborhood…) that is of some kind of importance.

Term
coding system
Definition

When we need to find out information without asking the subjects directly or when the subjects are not people (like movies, texts etc.), we must use  (used with systematic observation or archival research)

Term
systematic observation
Definition

Focuses on specific behaviors in a narrow context, which the researcher is interested in










already developed prior hypotheses about the behaviors.

Term
archival research
Definition

Existing data sources such as:

Statistical records

Survey 

Written and mass communications

 

Term
case study
Definition

Researchers conducted an in-depth study with certain 9/11 victims to understand the psychological impact of the attack on the World Trade Center in 2001

Term
systematic observation
Definition

Researchers recorded the time it took drivers in college parking lots, to back out of a parking stall and compared the time when another car was waiting to the time when another car was not waiting for the space

Term
archival research
Definition

Researchers examined unemployment rates and the incidence of domestic violence police calls in six cities

Term
archival research
Definition

Contents of mate-wanted personal ads in three major cities were coded, to determine whether men and women differ in terms of their self-description

Term
case study
Definition

The researcher spent over a year meeting with and interviewing Aileen Wuomos, the infamous female serial killer who was the subject of the film Monster, to construct a psychobiography

Term
confounding variable
Definition

a variable that varies along with the independent variable, so it is not possible to determine which of the variables is responsible for the observed effect!

Term
carry over effects
Definition

After reading about a less severe crime the more severe crime might seem much worse

Term
order effects
Definition

1. practice 

2. fatigue

Term
Complete counterbalancing
Definition

 all possible order of conditions are included in the experiment

Term
Latin squares
Definition

a limited set of orders constructed to ensure that: 1. each condition appears in each ordinal position 2. each condition preceded and follow each condition at least one time (number of orders is equal to number of positions)

Term
matched pair design
Definition

the subjects are matched according to important variable and then the couples are divided equally among conditions. 

Term
repeated measure design
Definition

Assign to all levels of the independent variable

Term
independent group design
Definition

Randomly assign to only one level of the independent variable

Term
counterbalancing
Definition
 a method of controlling for the effects of an extraneous variable by ensuring that its effects are equal in all treatment conditions. 
Term
content analysis
Definition

count on occurrences of phenomenon (ex/ examining pictures in children's books- boys/girls and what categories of activities they are engaging in)

Term
systematic error
Definition

distance between the true population value and the mid-point (mean) of the sampling unit indicates the amount of bias in the sample 

Term
2 X 2 design
Definition

 two independent variables with two levels of each variable. One dependent variable

Term

 

Main effect of first IV

Main effect of second IV

Interaction effect

 

Definition

What are the outcomes in a 2 by 2?

Term
ANOVA
Definition

 tests whether a categorical independent variable has an effect on some continuous dependent variable

Term
covariance
Definition

that the independent variable and the dependent variable are mutually related 

Term

Temporal precedence

Definition

Did X come before Y?  Did our independent variable occur before our dependent variable? 

Term
When there is correlation there must be covariance, temporal precedence, internal validity.
Definition
How to infer causality ?
Term
To make sure x causes y to occur. If we have a control group then they dont have x so y must not occur in order to make sure our study is accurate.
Definition
Why have control group?
Term
non equivalent group design
Definition

this is when you non-randomly assign participants to an experimental condition and a control condition.  It is a between-subjects kind of study.

Term

Interrupted Time Series Design

Definition

 

 

 

•A single group of participants is tested repeatedly both before and after a manipulation or a natural event

◦Essentially a single-group, pretest-posttest design with multiple before and after measures

•The multiple measures allow us to detect many confounding variables

 

 

Term
control series design
Definition

multiple pre- and post measures are taken and compared.  However, a control group is also tracked, allowing for a “between groups” comparison

Term
multiple baseline design
Definition

similar to plain reversal designs, except that the treatment is introduced at different times for different subjects or targeting different behaviors for a single subject

Term
reversal design
Definition

Comparison of multiple periods, designated by letters (A, B, C) in which treatment is alternatively either absent or present.  

The design attempts to establish the link between the administration of the treatment and a specific behavior change

 

Term
cross sectional
Definition

Study people of different ages at one time


Problem: cohort effects may explain age differences

Term
longitudinal
Definition

Study the same people as they grow older

Examine changes with age

Expensive and difficult

Term
sequential method
Definition

Combine cross-sectional and longitudinal approaches

Take cross-sectional approach at time 1 but follow up the same people for a longitudinal study at time 2

Provides immediate age difference information

Term
mode
Definition

 simplest indicator, the most frequent score

Term
Median 
Definition

the middle score in a distribution, very useful if scores are skewed in one direction

Term
Mean
Definition

 arithmetic average dividing the sum by the number of scores

Term
correlation
Definition

Refers to relationship between two variables

Term
correlation coefficient
Definition

A statistic that describes how strongly variables are related

Term
statitical significance test
Definition

 provide a way of making a decision about the population means

Term
t-test
Definition

A statistical significance test to evaluate the null hypothesis of no difference in the population means of two groups

Term
type 1 error or Alpha error
Definition
probability of rejecting a null hypothesis that is actually true
Term
type II error or Beta Error
Definition

probability of failing to reject the null hypotehsis that is actually false

 

Incorrectly accepting the null hypothesis when there really is a difference

Term
Statistical power or power
Definition

Probability of correctly rejecting the null hypothesis


1-Beta

Term
for 3 groups or more 
Definition
When do we use a ANOVA?
Term
for 2 groups
Definition
When do we use a T-test?
Term

young

high in cognitive skill

high in need for peer approval

and are easy to obtain

Definition
college student tent to be:
Term

Rats are hardy, cheap, easy to rear, and well adapted to laboratory existence

Easy to obtain

Definition
White rats are:
Term

social

highly educated

in need of approval

Definition

Volunteers differ from nonvolunteers in that volunteers tend to be more:

Term
solomon four-group design
Definition

Half of the participants are given the pretest; the other half receive the posttest only

Term
experimental realism
Definition

The extent to which the experiment has an impact on the participants, involves them, and makes them take the experiment seriously.

Term
mundane realism 
Definition

The extent to which the independent variable manipulation is similar to events that occur in the real world.

Term
replication
Definition

Repeating a research study to determine whether the results can be duplicated

Term
exact replication
Definition

Replication of research using the same procedures for manipulating and measuring the variables that were used in the original study

Term
conceptual replications
Definition

Replication of research using different  procedures for manipulating and measuring the variables that were used in the original study

Term
meta-analysis
Definition

A set of statistical procedures for combining the results of a number of studies in order to provide general assessment of the relationships between variables

Term
observer bias
Definition

researchers can overestimate/underestimate how often something happens – tend to confuse what they believe they see and what they want to see with what actually happened 

Term
confidence interval
Definition

specify where the population value probably lies

Term
instability
Definition

the spread (variability) of your sampling responses  

Term

Non-Equivalent Control Group Design

Definition

 participants are not randomly assigned -> usually self-selected groups -> problems of selection differences 

Term
floor effect
Definition

task if so hard that almost no one can perform well

Term
 ceiling effect
Definition

 participants quickly reach maximum performance level since task was too easy

Term
interaction effect
Definition

 does the effect of the IV depend on the particular level of the other IV? – Ex/ distraction while standing is bad for introverts, however, distraction does not bother extravert

Term
Moderating variables
Definition

 a variable moderates the effect of an IV

Term
expectancy effect
Definition

 may occur whenever the experimenter knows which condition the participants are in 

Term
straightforward manipulation
Definition

Presenting written, verbal or visual material

Instructions or stimulus presentation

Term
staged/event manipulation
Definition

most common with social psychology 

Use of confederates, usually appears to be another participant in the experiment.

Term
self reports measures
Definition

attitudes, liking, intended behavior, emotions….


Term
physiologocial measures
Definition

 recording of responses of the body

Term
behavioral measures
Definition

 direct observations of behaviors


Term
deception
Definition

 make participants think that the experiment is studying one thing when actually it is studying something else (for example – Asch’s study)

Term
pilot studies
Definition

 a “trial run” with a small number of participants

Term
facts & demographics, attitude & belief, and behaviors
Definition
constructing question has to include:
Term
open-ended question
Definition
Where are you originally from 
Term
close ended question
Definition

 “Where are you originally from?”

North America

South America

Europe

Africa

Other

Term
direct vs. indirect questions
Definition

When the topic being asked is too personal or sensitive, we try to ask the questions in a projective way 

Term
face-to-face administration
Definition

Rare, expensive adminstration

Term
Telephone interview administration
Definition

 

Most common for large surveys 

Term
focus group interviews administration
Definition

Tend to be qualitative and open-ended

Term
procedure
Definition

Explain exactly how the study was conducted. 

Maintain the temporal sequence of events so the reader is able to visualize what the participants experienced.

This section tells the reader what instructions was (or wasn’t) given to the participants. 

Include any detail that might be important in a replication of the study 

Term

Common sense

Observation of things happening in the world

Past research

Practical problems

Theories

Definition

The research process->

sources of ideas:

Term

Research question

Hypothesis

Prediction

Hypothesis testing, results and discussion

Definition

Four steps of scientific research in social sciences:

Term

Introduction - Literature review

Introduction – Hypotheses

Prediction

Research method

Results

Discussion and conclusions

Reference list

Definition

Sections in a journal article:

Term

A statement about 2 or more variables

A clear phrasing that can be understandable in one way only

Can have only 2 outcomes: true or false

Must be studied empirically

Definition

4 conditions for hypothesis

 

Term

Time organization: what happened before what?

Dismissing alternative explanations

There is a strong statistical connection between the variables

Definition

3 conditions for causality

Term

The problem under study- 2-3 sentences: broad context and significance of the topic being study

The literature review- a description of past research and theory. The basis of what we’ll investigate.

The rational (connects between the literature review and the hypothesis), hypothesis and prediction of the study 

Definition
Introduction has 3 components:
Term
placebo effect
Definition

Just getting a treatment may be sufficient to cause an observed change in behavior/feeling

Term

Consistency of behavior

Run all conditions simultaneously

Automated producers (computers)

Experimenters who are unaware of the hypothesis

Definition
solutions for expectance effect:
Term

The method of tenacity –or the ostrich method

Definition

Clinging to beliefs that have been around for a long while and excluding anything that might alter or challenge those beliefs

Term

The method of authority

Definition

 believing something because someone with “authority” tells you it is so.

Term
The a priori method 
Definition

relying on individual powers of reasoning and logic to make sense of the world and to explain it to others

Supporting users have an ad free experience!