Shared Flashcard Set

Details

Ch. 5 Cooper (2nd ed)
Improving and assessing the quality of behavior measurement
26
Psychology
Graduate
05/06/2020

Additional Psychology Flashcards

 


 

Cards

Term
Accuracy (of measurement)
Definition
the extent to which observed values, (the data produced by measuring an event), match the true state, or true values, of the event as it exists in nature
Term
Believability
Definition
the extent to which the researcher convinces herself and others that the data are trustworthy and deserve interpretation (IOA)
Term
Calibration
Definition
The process of comparing the data produced by a measurement system to a known standard or true value and, when sources of error are found, using that information to correct or improve the measurement system.
Term
Continuous Measurement
Definition
all instances of the response class(es) of interest are detected during the observation period
Term
Direct Measurement
Definition
when the behavior that is measured is the same as the behavior that is the focus of the investigation
Term
Discontinuous Measurement
Definition
conducted in a matter such that some instances of the response class(es) of interest may not be detected
Term
Exact Count-Per-Interval IOA
Definition
the percentage of total intervals in which 2 observers record the same count
Term
Indirect Measurement
Definition
when the behavior that is measured is in some way different from the behavior of interest; considered less valid than direct b/c it inters about relations between the data obtained and the actual behavior of interest
Term
interobserver agreement (IOA)
Definition
the degree to which two or more independent observers report the same observed values after measuring the same events.
Term
Interval-by-Interval IOA
Definition
an index of agreement between observers for data obtained by interval recording or time sampling measurement; compare the 2 observers recordings of the occurrence or non-occurrence of the behavior in each observation interval and dividing the number of intervals of agreement by the total number of intervals and multiplying by 100
Term
Mean Count-Per-Interval IOA
Definition
the average percentage of agreement between the counts reported by 2 observers in a measurement period comprised of a series of smaller counting times, more conservative measure than total count IOA
Term
Mean Duration-Per-Occurrence IOA
Definition
calculated by average percentage of agreement of the durations, more conservative and meaningful assessment
Term
measurement bias
Definition
Nonrandom measurement error; a form of inaccurate measurement in which the data consistently either overestimated or underestimated the true value of an event.
Term
observed value
Definition
A measure produced by an observation and measurement system. Observed values serve as the data that the researcher and others will interpret to form conclusions about an investigation.The quantitative label produced by measuring an event
Term
observer drift
Definition
Any unintended change in the way an observer uses a measurement system over the course of an investigation that results in measurement error; often entails a shift in the observers interpretation of the definition of the target behavior from that used in training.
Term
observer reactivity
Definition
influence on the data reported by an observer that results from the observers awareness that others are evaluating the data he reports
Term
Trial-by-Trial IOA
Definition
for discrete trial data based on comparing the observers' count (0 or 1) on a trial-by-trial, or item-by-item, basis
Term
Validity (of measurement)
Definition
the extent to which data obtained from measurement are directly relevant to the target behavior of interest and to the reason(s) for measuring it
Term
Unscored-interval IOA
Definition
An interobserver agreement index based only on the intervals in which either observer recorded the nonoccurence of the behavior, calculated by dividing the number of intervals in which the two observers agreed that the behavior did not occur, by the number of intervals in which either or both observers recorded the nonoccurence of the behavior, and multiplying by 100. Use for high rates of behavior, because the behavior happening all the time makes it likely that agreement for scored will happen. by looking at just the unscored ones, you eliminate the possibility of extra agreement skewing your IOA
Term
true value (of measurement)
Definition
A measure accepted as a quantitative description of the true state of some dimensional quantity of an event as it exists in nature. Obtaining ____ requires "special or extraordinary precautions to ensure that all possible sources of error have been avoided or removed." Requires comparing an observed value to an independent standard.
Term
total duration IOA
Definition
A relevant index of IOA for total duration measurement; computed by dividing the shorter of the two durations reported by the observers by the longer duration and multiplying by 100
Term
total count IOA
Definition
the simplest indicator of IOA for event recording data; based on comparing the total count recorded by each observer, per measurement period; calculated by dividing the smaller of the two observers counts by the larger and multiplying by 100
Term
scored interval IOA
Definition
an intraobserver agreement index based only on the intervals in which either observer recorded the occurrence of the behavior, calculated by dividing the number of intervals in which the two observers agreed that the behavior occurred by the number of intervals that either or both observers recorded the occurrence of the behavior and dividing it by 100. Apply to low rates of behavior, because it is likely that there are many unscored intervals that agree.
Term
reliability (of measurement)
Definition
the extent to which a measurement procedure yields the same value when brought into contact with the same state of nature.
Term
naive observer
Definition
trained observer who is unaware of the study's purpose and/or the experimental conditions in effect during a given phase or observation period.
Term
Purpose for assessing accuracy of measurement
Definition
1. Are the data good enough to base Decision-making on?
2. discover and correct errors
3. detect patterns of measurement error
4. assure consumers of the accuracy of the data
Supporting users have an ad free experience!