Shared Flashcard Set

Details

CH 05
Summary
49
Psychology
Graduate
02/25/2015

Additional Psychology Flashcards

 


 

Cards

Term
valid, accurate & reliable
Definition
To be most useful for science, measurement must be _____.
Term
Three Element of Valid Measurement in ABA
Definition
- measuring directly a socially significant target behavior
- measuring a dimension of the target behavior relevant to the question or concern about the behavior
- Ensuring that the data are representative of the behavior under conditions and during times most relevant to the reason for measuring it.
Term
accurate
Definition
Measurement is _____ when observed values, the data produced by measuring an event, match the true state, or true values, of the event.
Term
reliable
Definition
Measurement is _____ when it yields the same values across repeated measurement of the same event.
Term
different
Definition
Indirect Measurement involves measuring behavior that is _____ from the behavior of interest.
Term
make inferences
Definition
Indirect Measurement threatens validity because it requires the researcher or practitioner to _____ about the relationship between the measures obtained and the actual behavior of interest.
Term
indirect measurement
Definition
A researcher who uses _____ must provide evidence that the behavior measured directly reflects, in some reliable and meaningful way, something about the behavior for which the researcher wishes to draw conclusions.
Term
validity
Definition
Measuring a dimension of the behavior that is ill suited for, or irrelevant to, the reason for measuring the behavior compromises validity
Term
the way the measurement was conducted
Definition
Measurement artifacts are data that give an unwarranted or misleading picture of the behavior because of ______.
Term
measurement artifacts
Definition
Discontinuous measurement, poorly scheduled observations, and insensitive or limiting measurement scales are common causes of _____.
Term
human error
Definition
Most investigations in applied behavior analysis use human observers to measure behavior, and _____ is the biggest threat to the accuracy and reliability of data.
Term
measurement error
Definition
Factors that contribute to _____ include poorly designed measurement systems, inadequate observer training, and expectations about what the data should look like.
Term
before
Definition
Observers should receive systematic training and practice with the measurement system and meet predetermined accuracy and reliability criteria ____ collecting data.
Term
unintended changes
Definition
Observer Drift involves _____ in the way an observer uses a measurement system over the course of an investigation.
Term
Observer Drift
Definition
____ can be minimized by booster training sessions and feedback on the accuracy and reliability of measurement.
Term
expectations or knowledge
Definition
An observer's _____ about predicted or desired results can impair the accuracy and reliability of data.
Term
should not
Definition
Observers ____ receive feedback about the extent to which their data confirm or run counter to hypothesized results or treatment goals.
Term
naive
Definition
Measurement bias caused by observer expectations can be avoided by using ____ observers.
Term
awareness
Definition
Observer reactivity is measurement error caused by an observer's _____ that others are evaluating the data he reports.
Term
Benefits of assessing the accuracy of data
Definition
- Determine early in an analysis whether the data are usable for making experimental or treatment decisions
- Discover and correct measurement error
- Detect consistent patterns of measurement error that can lead to the overall improvement or calibration of the measurement system
- Communicate to others the relative trustworthiness of the data.
Term
correspondence
Definition
Assessing the accuracy of measurement is a straightforward process of calculating the _____ of each measure, or datum, assessed to its true value.
Term
different
Definition
Ture values for some behaviors (e.g., cooperative play) are difficult because the process for determining a true value must be different from the measurement procedures used to obtain the data one wishes to compare to the true value.
Term
evident and universally accepted
Definition
True values for many behaviors of interest are _____ or can be established conditionally by local context.
Term
trustworthiness
Definition
Assessing the extent to which observers are reliably applying a valid and accurate measurement system provides a useful indicator of the overall _____ of the data
Term
natural or contrived permanent product
Definition
Assessing the reliability of measurement requires a _____ so the observer can re-meaure the same behavioral events.
Term
high accuracy
Definition
Although high reliability does not confirm _____, discovering a low level of reliability signals that the data are suspect enough to be disregarded until problems in the measurement system can be determined and repaired.
Term
interobserver agreement (IOA)
Definition
The most commonly used indicator of measurement quality in ABA is _____.
Term
independent
Definition
IOA is the degree to which two or more _____ observers report the same observed values after measuring the same events.
Term
The use of IOA by researchers & practitioners
Definition
- Determine the competence of new observers
- Detect observer drift
- judge whether the definition of the target behavior is clear and the system is not too difficult to use
- convince others of the relative believability of the data
Term
Requirements of IOA
Definition
- two or more observers
- use the same observation code and measurement system
- observe and measure the same participant and events
- observe and record the behavior independent of influence b other observers.
Term
numerous
Definition
There are ____ techniques for calculation IOA, each of which provides a somewhat different view of the extent and nature of agreement and disagreement between observers.
Term
Percentage of Agreement
Definition
____ between observers is the most common convention for reporting IOA in ABA.
Term
Calculating IOA data from Event Recording
Definition
- Total count recorded by each observer per measurement period
- the counts tallied by each observer during each of a series of smaller intervals of time within the measurement period
- each observer's count of 1 or 0 on a trial-by-trial basis.
Term
Total Count IOA
Definition
____ is the simplest and crudest indicator of IOA for event recording data.
Term
Exact Count-per-interval
Definition
____ is the most stringent indicator for most dada sets obtained by event recorded.
Term
essentially The same ways
Definition
IOA for data obtained by timing duration, response latency, or inter response time (IRT) can be calculated in _____ as for event recording data.
Term
Total Duration IOA
Definition
Computed by dividing the shorter of the two durations reported by the observers by the longer duration.
Term
Mean Duration IOA
Definition
A more conservative and usually more meaningful assessment of IOA for total duration data and it should always be calculated for duration-per-occurance data.
Term
Three Techniques to calculate IOA for Interval Data
Definition
- Interval-by-Interval IOA
- Scored-Interval IOA
- Unscored-Interval IOA
Term
overestimate
Definition
Because it is subject to random or accidental agreement between observers, Interval-by-Interval IOA is likely to ____ the degree of agreement between observers measuring behaviors at very low or very high rates.
Term
low frequencies
Definition
Scored-Interval IOA is recommended for behaviors that occur at relatively _____.
Term
high frequencies
Definition
Unscored-Interval IOA is recommended for behaviors that occur at relatively _____.
Term
each condition and phase
Definition
IOA assessments should occur during _____ of a study and be distributed across days of the week, times of day, setting, observers.
Term
IOA
Definition
Researchers should obtain and report ___ at the same level at which they report and discuss the results of their study.
Term
stringent and conservative
Definition
More _____ IOA methods should be used over methods that may overestimate agreement as a result of change.
Term
80%
Definition
The convention for acceptable IOA has been a minimum of ____, but there can be no set criterion.
Term
acceptable
Definition
The nature of the behavior being measured and the degree of behavior change revealed by the data must be considered when determining an acceptable level of IOA.
Term
IOA scores
Definition
_____ can be reported in table, narrative and graphic form.
Term
multiple indices
Definition
Researchers can use _____ to asses the quality of their data (e.g., accuracy plus IOA, reliability plus IOA).
Supporting users have an ad free experience!