Term
|
Definition
the animal's behavior has no consequence
ex. Pavlov's dog, FPS, taste aversion learning, place conditioning, behavioral sensitization |
|
|
Term
| instrumental conditioning |
|
Definition
the animal's behavior does not actually alter the environment, "instrumental" in obtaining a reward
ex. maze, runway, monkey reaching into blind box |
|
|
Term
| Schultz showed that dopamine neurons increase their burst firing of action potentials for |
|
Definition
a. unexpected rewards
b. cues predicting reward after learning but not for expected rewards or cues that were overlearned |
|
|
Term
| Schultz found that tonic firing diminishes when... |
|
Definition
| reward is expected but not presented |
|
|
Term
| reward predictions (RP) increase |
|
Definition
| phasic dopamine neuronal firing |
|
|
Term
| reward prediction errors (RPE) decrease |
|
Definition
| tonic dopamine neuron firing |
|
|
Term
|
Definition
when consequences condition the behavior
- reinforcing stimuli increase the probability of the behavior |
|
|
Term
|
Definition
| behavior that alters the stimuli in the environment |
|
|
Term
| what are the five schedules of reinforcement? |
|
Definition
fixed ratio (FR)
fixed interval (FI)
variable ratio (VR)
variable interval (VI)
progressive ratio (PR) |
|
|
Term
|
Definition
high rates of behavior
ex. how many garments made during work shift |
|
|
Term
|
Definition
reliable even if low rate
ex. checking mailbox once per day |
|
|
Term
|
Definition
steady rates
ex. slot machine |
|
|
Term
|
Definition
steady rates
ex. fox hunts but doesn't know when it will come upon prey |
|
|
Term
|
Definition
number of responses required increments with each reinforcer
ex. psych 101 requires 1 hour per week of studying to get an A
psych 234 requires 2 hours per week of studying to get an A
psych 333 requires 3 hours per week of studying to get an A |
|
|
Term
|
Definition
the ratio that is never completed
ex. get an A in psych 101 and 234 but you got a B in psych 333 because you weren't willing to study 3 hours for that class. your breaking point was 3 hours of studying for a psych course |
|
|
Term
| second order conditioning |
|
Definition
| the CS is presented on one schedule of reinforcement that is embedded within another schedule of UCS reinforcement |
|
|
Term
|
Definition
multiple concurrent schedules of reinforcement
ex. FR 5 FR 5 schedule of cocaine and food reinforcement |
|
|
Term
| cumulative response record axes |
|
Definition
y-axis: cumulative responses
x-axis: time |
|
|
Term
| cumulative response record: pen draws line |
|
Definition
when line is flat, no responses accruing
when line is vertical, responses are accruing quickly
the steeper the slope, the faster the rate of responding |
|
|
Term
| operant conditioning techniques used to evaluate abuse potential of drugs |
|
Definition
intravenous drug self administration (IVSA)
drug discrimination (DD) |
|
|
Term
| intravenous drug self-administration (IVSA) |
|
Definition
positive reinforcer: intravenous drug administration
measures positive reinforcing effects of a drug
predicts abuse potential of a drug in humans
accurately predicts the abuse potential of over 20 drugs in humans |
|
|
Term
|
Definition
food pellets are commonly used in rodents as the positive reinforcer (UCS/S^R)
money is commonly used in humans as the positive reinforcer (UCS/S^R)
either saline or a training drug is administered before each training session |
|
|
Term
| drug discrimination training session |
|
Definition
- during training, only one lever is reinforced if saline was administered, and only the other lever is reinforced if the training drug was administered
- the subject becomes conditioned to use the "interoceptive stimulus" for which the lever is reinforced on any given training session |
|
|
Term
| drug discrimination test session |
|
Definition
- during test sessions, any dose of any drug can be administered and both levers are reinforced and two measures are taken
- percent rug appropriate responding
- response rate on both levers combined |
|
|
Term
| discriminative stimulus/cue in drug discrimination |
|
Definition
|
|
Term
| conclusions of drug self-administration and drug discrimination |
|
Definition
1. cocaine functioned as an S^R suggesting abuse potential under 3 conditions
(1. acquisition of IVSA under a FR 1 schedule of reinforcement
2. self-administration maintained under an FR 5 schedule of reinforcement
3. breaking points under a PR schedule of IVSA
2. cocaine functioned as an S^D, and d-amphetamine but not U50,488 generalized to the cocaine S^D, as expected when comparing another psychomotor stimulant (amphetamine) and a non-stimulant (U50,488, a saliva-like hallucinogen) to cocaine |
|
|
Term
| conclusion of dopamine D2/D3 |
|
Definition
| D3 selective drug produced no cocaine-like effects. D3 selective drugs will lack abuse potential in humans |
|
|
Term
| the reinforcing effects of cocaine but not food depend upon ____ |
|
Definition
|
|
Term
| what is dopamine really for? |
|
Definition
voluntary action (movement, dorsal striatum)
reward predictions (ventral striatum also called nucleus accumbens) |
|
|
Term
| what is learning really for? |
|
Definition
| much of it is for acting upon accurate reward predictions |
|
|
Term
| concurrent schedules of reinforcement |
|
Definition
Herrnstein's Matching Law
- when concurrent behaviors are available, relative rates of behavior will match relative rates of reinforcement |
|
|
Term
| DRO schedules of reinforcement |
|
Definition
differential reinforcement of other behavior
reinforcement only int he absence of a specified behavior
used in some contingency management therapist |
|
|
Term
| concurrent choice schedules or reinforcement |
|
Definition
choice - usually a limited amount of rewards, so choosing one means you lose the other
subjects often exhibit delay discounting where they choose a small immediate reward over a delayed larger reward
- thought to predict self control and impulsivity |
|
|
Term
| choice schedules of reinforcement: medication |
|
Definition
| medications may affect the choice between drugs and healthier alternatives, but they tend to be relatively ineffective both in the lab and in the real world |
|
|
Term
| choice schedules of reinforcement: environmental variables |
|
Definition
| choice behavior tends to be more amenable to environmental variables such as price of each choice rather than to some other treatment, such as medications or promise of better health in the long run |
|
|
Term
| DRO & choice schedules of reinforcement: contingency management |
|
Definition
| contingency management refers to therapy for impulsive behaviors such as drug abuse and gambling |
|
|
