Shared Flashcard Set

Details

Exam 1 Learning Theory II
Operant Conditioning
64
Psychology
Undergraduate 3
09/26/2011

Additional Psychology Flashcards

 


 

Cards

Term
Voluntary:
Involuntary:
Definition
Operant Conditiong: R -> S(c)
Respondent Conditioning S -> R
Term
Operant Conditioning
3 Laws of Association
Definition
Contiguity
Frequency
Effect (Most Important for Skinner)
Term
Hendonism/ Epicurus
Hendonistic Principle
Definition
An organism will do whatever necessary to max pleasure and min pain.

Pleasure-Reinforcer (skinner)
Pain-Punisher (Skinner)
Term
Respondent Conditining (1)
Definition
Involuntary Behavior
Term
Respondent Conditioning (2)
Definition
Elicited by environment S-(elicits)->R
Tap on knee -(elicits)-> knee jerk
Term
Respondent Conditioning (3)
Definition
Fixed Topography "Form or shape of behavior" "reflexive/stereyotypical"
Term
Respondent Conditioning (4)
Definition
MEASURED BY:
1.Amplitude- More Practice=LGR amp
2.Latency- Rx time- Time between presentation of stimulus and the appearence of the S-(RT)-> R
3. Resistence to extinction (US)- Once CR is formed, we can drop the US but we have to occasionlly use the US to avoid extinction
Term
Respondent Conditioning (5)
Definition
Origins of Unconditioned Reflex (food producing salvation is built in reflex)
Term
Operant Conditioning (1)
Definition
Voluntary Behavior (Skinner does not believe in INvol behavior)
Term
Operant Conditioning (2)
Definition
Emitted by environment
R-(emits)-> S(c) (operating on environment) (max pleasure min consequences of pain)
Term
Operant Conditioning (3)
Definition
Variable Topography
personal- Skinner box
Variable- critera has to be met- push button to get food
Term
Operant Conditioning (4)
Definition
MEASURED BY:
Frequency- # of responses per unit of time
Punish- freq low//reward freq high
Term
Operant Conditioning (5)
Definition
Origins of:
Skinner "Pool of random behavior" Thorndike "Law of mult responses"
*Organism has to be active (Salvatic bables)
*environment has to reinforce/punish
Term
Edward Lee Thorndike
Definition
Father of Educational Psychology
1.Applied things to real world
2. Connectionist (opposite Skinner) looked into the brain to see whats happening during S->R connections.
3.Trail and Error Learning
Term
E L T: 3. Trial and Error learning
Definition
Keep trying until it works 99/100% of time will not work
Term
Puzzle Box (E L T)
Definition
Trial and Error Learning
Trap cat in box, cat has to experiment with things in the box until they found a way out.. milk outside door (reinforcer)
Term
Trial and Error Learning
1.Law of Mult Responses
Definition
Cat starts becoming very active- multiple actions = "Pool of random behavior"
Term
Trial and Error Learning (ELT)
2.Law of Effect
Definition
(Emphasis on Error) Behaviorist that didn't open the door caused the cats NOT to repeat the same behavior
ANNOYER/SATISFYER
Term
Annoyer
Definition
Anything an organism actively tries to avoid and does nothing to maintain (Skinner calls Punishers) "STAMP OUT"
S->R connections
Term
SATISFIER
Definition
Anything an organism does nothing to avoid often doing things to obtain or preserve it. (Reinforcer) (Cat finds something to make door open) "STAMP IN" S->R connections
Term
1929 ELT
Definition
"I WAS WRONG" annoyers do not weaken S->R relationships and do not STAMP OUT S->Connections
Term
Trial and Error Learning (ELT)
3.Law of Frequency/Exercise
Definition
Probability of behavior will increase over trials or exercise, practice (More cat tries to get out, he will know by 3rd or 4th time)
Term
Skinner Operant Laws
Definition
1.contiguity
2.Frequency
3.Effect
Term
Skinner Operant Laws
1.Contiguity
Definition
Stimulus and Response that occur together tend to form a relationship. Skinner says this should be implied
Term
Skinner Operant Laws
2.Frequency
Definition
Practice is not enough. S->R needs to be a REINFORCED practice
Term
Skinner Operant Laws:
3.Effect - Maintains escape and avoidance behavior
Definition
1.Reinforcer- Any stimulus Consequence that INCREASES the frequency of the response that follows S->R :)(satisfier)
2.Punisher- Any stimulus consequence that DECREASES the frequency of the response that follows. S->R :( (annoyers)
Term
Punisher (Skinner) S(TO)
Definition
Time out S(TO) the removal of all potentional reinforcers from the environment
Term
Contingent Withdrawl (or response cost)
S(CW)
Definition
The removal of a specific reinforcer, but not the one that is maintaining the behavior.
DIFFERENT FROM EXTINCTION- removal that IS maintaining the behavior.
Term
Punishment S(P)
Definition
Presenting an aversive stimulus
Term
Skinners beliefs:
Definition
SRT(pos reinforcers), when we use neg reinforcers we do not feel good about what we are doing, even though its effective.
Skinner AVOIDS punishers because they do not weaken S->R relationships, all they do is supress behavior (speeding-cop-slam on breaks-speed back up)
Term
Levels of reinforcement
Definition
1.primary reinforcer (SRT)- naturally occuring reinforcers (Food, Sex, Drink, Touch **most common)
2.secondary rein- Srt (CONDITIONED reinforcer) a prev. neutral stimulus that takes on reinforcing properties because it can be EXCHANGED for a PRIMARY reinforcer
Term
Schedules of Pos.Reinforcement (Skinner)
Definition
indicates how often a correct response is followed by a reinforcing consequence.
Term
1.Continuous Schedule- CRF
Definition
an organism that is reinforced after every correct response (important when estab. a new behavior)
Term
2.Intermittent schedule
Definition
Only reinforced occasionally. Once CRF- we estab.
1.more practical and less $$
2.Satiation- only reward so much, before gets old
3.Partial reinforcement effect (PRE)**
Term
PRE- Partial Reinforcement effect
Definition
a behavior maintained by an intermittent schedule is more resistent to extinction
Term
Cumulative recorder
Definition
Skinner used to measure change in frequency of behavior
Term
Cumulative Recorder
Shallow slope
Steeper slope
Pos skewed line
Neg skewed line
Definition
slower response
faster response
reinforcement/organ is responding more and more frequent
punishers or extinction
Term
Ratio Sch. Type of Int. Sch
Definition
Reinforcement is based on the number of correct responses
1.Fixed ratio- (FR_)_=# of responses- Organism is reinforced after a fized # of correct responses. FR#=stair step pattern in cumulative record
Term
Post reinforcement pause- Strongest
Definition
Time out betwen reinforcment (time inbetween steps)
Term
Ratio Strain
Definition
Move too quickly from a small to large fixed ratio sch= Extinction
Term
(VR) Variable Ratio- Int sch- Most effective
Definition
The organism is reinforced after a variable # of correct responses (never knows when reinforcer is going to come)
3 + 6 + 4 + 7/4 = 20/4= 5
Most effective
Cumulative recorder- very steep slope showing rapid responses- very consistent
Term
Interval Schedules
Definition
Reinforcement is based on passage of time.
1.Fixed Interval (FI)
2.Variable Interval (VI)
Term
Fixed interval (FI) interval sch.
Definition
the organism is reinfroced for the first correct response after a fixed amount of time has passed
Term
Variable interval (VI) Interval sch
Definition
Organism is reinforced for the first correct response after a variable amount of time has passed
Cumalative recorder- Consistent but not as rapid
Term
Transfer- Identical elements model used
Definition
Prompting and Fading Prompting is the act of helping a behavior to occur. This is a useful way to start teaching a behavior. A coach who helps a small child hold a baseball bat, to teach a proper swing, is using prompting. Fading is said to occur when the trainer gradually withdraws the prompt.
Term
Law of associative Shifting (Thorndike)- Prompting and fading
Definition
A transfer of responses to new stimuli takes place by their pairing with stimuli already connected to those responses.
Term
ERRORLESS LEARNING- Terrace
Definition
is a procedure introduced by Herbert Terrace (1963) which allows discrimination learning to occur with few or even with no responses to the negative stimulus (abbreviated S−). A negative stimulus is a stimulus associated with undesirable consequences (e.g., absence of reinforcement). In discrimination learning, an error is a response to the S−, and according to Terrace errors are not required for successful discrimination performance.
Term
Loss Types:
Definition
1.Extinction (Pavolv)
2.Response Competition
3.Situational variation
4.Disuse/Decay - Ruled out
Term
Loss Skinner- Extinction
Definition
The removal of a specific reinforcer that IS maintaining the behavior (you have to find out what is the reinforcer to modify behavior)
Term
Response Cost
Definition
Removal but not the one maintaining the behavior (we dont know what the reinforcer is so we take the indirect approach)
Term
Response Cost
Definition
Removal but not the one maintaining the behavior (we dont know what the reinforcer is so we take the indirect approach)
Term
Loss:Extinction:
Baseline/Operant behavior
Definition
Pre reinforcement frequency of behavior (can be 0)(ex.shoe tieing)
Rats in Skinner box lever pressing 3x before reinforcement- So frequency=3
Term
Loss:extinction
Frustration Effect (FE)
Definition
A temporary rise in the frequency of a response along with emotional concomitonts that occurs immediatley following the onset of extinction (a tempertantrum) (breaking up)
Term
Discrimination Learning
Definition
The ability to respond to stimuli differently S(d/delta)->R->S(c)
Term
Discrimination stimulus
Definition
S(D) A stimulus that proceeds a response and in the case that a specific consequence will follow.
If S(d)-(u can expect->R- this will happen S(C)
Term
Stimulus Control
Definition
When you understand the consequences of the S(D) you are under....
Whatever it takes to max pleasure and min pain- avoid punishers gain reinforcers
Term
S-Delta S(traingle)
Definition
A stimulus that proceeds a response in the case that NO consequence will follow. Associated with Extinction.

S(delta)->R->No consequence=extinction
Potentional Stimulus...
Term
Chaining
Definition
Two or more responses held together by common stimulus. A series of S->R->S components
Term
3 types of Chaining
Definition
Horizontal
Vertical- SD and S(delta) are sensory verbs (sees,hears) and R should be action verbs (walk, look, tell)
Reciprocal "2 person" chain
Term
Contengencies of (POS) reinforcement
Definition
the realtionship between a behavior and the reinforcer that follows it.
Term
temporal contiguity
Definition
must immediatley follow the response R occurs and immediatley following S(RT) must occur
Term
Planned contengencies
Definition
design the environment to pair with the response in a stimulus.
Skinner box:Rat presses button and immediatley following, gets a pellot of food.
Term
Accidental Contengencies
Definition
Did something and out of nowhere you are reinforced. R will increase in frequency. (Bowling, Pitching a strike)
Term
Accidental contengencies leads to...
Definition
Superstitious behavior- behaviors established thru accidental contengecies of reinforcement. "Miracles"
Supporting users have an ad free experience!