Term
|
Definition
| The reinforcement of successive approximations of a desired behavior. |
|
|
Term
| naturally occurring phenomenon |
|
Definition
| Shaping is not just an instructional tool, it is also a ______. |
|
|
Term
|
Definition
| In both natural selection and shaping, new forms evolve through _____. |
|
|
Term
|
Definition
| A series of related behaviors, the last of which produces reinforcement. |
|
|
Term
|
Definition
| Teaching a person or an animal to perform a behavior chain is called _____. |
|
|
Term
|
Definition
| The first step in chaining is to break the task down into its component elements, a procedure called _____. |
|
|
Term
|
Definition
| A chaining procedure in which training begins with the first link in the chain and adds subsequent links in order. |
|
|
Term
|
Definition
| A chaining procedure in which training begins with the last link in the chain and adds preceding links in reverse order. |
|
|
Term
|
Definition
| Note that in backward chaining, the chain is never _____. |
|
|
Term
| the opportunity to perform the next step in the chain. |
|
Definition
| An interesting thing about chaining is that each link in the chain is reinforced, at least in part, by _____. |
|
|
Term
|
Definition
| Only the _____ in a chain typically produces a reinforcer that is not part of the chain. |
|
|
Term
|
Definition
| A ____ is a situation in which reinforcement is available, but the behavior necessary to produce it is not. |
|
|
Term
|
Definition
| Creativity has been defined in many way, but one feature that is always mentioned is ____. |
|
|
Term
|
Definition
| When original behavior has positive consequences, people are more likely to be _____. |
|
|
Term
|
Definition
| Any behavior that occurs repeatedly even though it does not produce the reinforcers that maintain it. |
|
|
Term
|
Definition
| Superstitious behavior is the product of _____ reinforcement. |
|
|
Term
|
Definition
| The tendency to give up on a problem as a result of previous exposure to insoluble problems. In experiments the problem usually involves escape learning. |
|
|
Term
|
Definition
| The tendency to persist at a problem as a result of previous reinforcement of persistence at difficult problems. |
|
|
Term
|
Definition
| Thorndike studied animal learning as a way of measuring animal _____. |
|
|
Term
|
Definition
| The horse that could apparently do math, but which was really reacting to subtleties in its owner. |
|
|
Term
|
Definition
| Thorndike liked to say that learning was the result of trial and _____. |
|
|
Term
|
Definition
| The statement that behavior is a function of its consequences. |
|
|
Term
- the environment (situation or context) in which a behavior occurs
- the behavior that occurs
- the change in the environment following the behavior
- change in behavior produced by its consequences |
|
Definition
| Four key elements of Thorndike's law of Effect |
|
|
Term
- can measure rate of response
- changed wording from "satisfaction" to increase decrease in behavior |
|
Definition
| 2 ways Skinner improved Thorndike's work. |
|
|
Term
| Operant Learning/ Instrumental Learning |
|
Definition
| Any procedure or experience in which a behavior becomes stronger or weaker depending on its consequences. |
|
|
Term
- Positive Reinforcement
- Negative Reinforcement
- Positive Punishment
- Negative Punishment |
|
Definition
| Four types of operant procedures. |
|
|
Term
| Positive and Negative Reinforcement |
|
Definition
| Operant procedures that increase the strength of behavior. |
|
|
Term
| Positive and Negative Punishment |
|
Definition
| Operant procedures that decrease the strength of behavior. |
|
|
Term
|
Definition
| An increase in the strength of behavior due to its consequences. |
|
|
Term
|
Definition
| the consequence of a behavior is the appearance of, or an increase in the intensity of, a stimulus. |
|
|
Term
|
Definition
| the stimulus in positive reinforcement, which is ordinarily something the individual seeks out |
|
|
Term
|
Definition
| Positive Reinforcement is sometimes called ____. |
|
|
Term
|
Definition
| A behavior is strengthened by the removal, or a decrease in the intensity of a stimulus. |
|
|
Term
|
Definition
| The stimulus in Negative Reinforcement, which is ordinarily something that the individual tries to escape or avoid. |
|
|
Term
| Escape learning or Escape-avoidance learning |
|
Definition
| Negative Reinforcement is sometimes called ____. |
|
|
Term
|
Definition
| A term used to refer to the strength of a reinforced behavior. |
|
|
Term
- Primary
- Secondary
- Natural
- Contrived |
|
Definition
| Four kinds of Reinforcers |
|
|
Term
|
Definition
| Reinforcers that appear to be innately effective. |
|
|
Term
| Unconditioned reinforcers |
|
Definition
| Primary reinforcers are often called ____ because they are not dependent on learning experiences. |
|
|
Term
|
Definition
| The loss of effectiveness of primary reinforcers due to their repeated use. |
|
|
Term
|
Definition
| Those reinforcers that are not innate, but the result of learning experiences. |
|
|
Term
|
Definition
| Secondary reinforcers are often called _____. |
|
|
Term
|
Definition
| Any secondary reinforcer that has been paired with several different reinforcers and is effective in a wide variety of situations. |
|
|
Term
|
Definition
| Those reinforcers that follow spontaneously from a behavior. |
|
|
Term
|
Definition
| Natural reinforcers are sometimes called _____ because each reinforcing event is an automatic consequence of an action. |
|
|
Term
|
Definition
| Those reinforcers that are provided by someone for the purposes of modifying behavior. |
|
|
Term
|
Definition
| ____ refers to the likelihood that a reinforcer will follow a behavior. |
|
|
Term
- Contingency
- Contiguity
- Reinforcer Characteristics
- Behavior Characteristics
- Motivating Operations |
|
Definition
| Variables affecting operant learning. |
|
|
Term
|
Definition
| _____ refers to the gap in time between a behavior and its reinforcing consequences. In general, the ___ the interval, the faster learning occurs. |
|
|
Term
|
Definition
| One important characteristic of a reinforcer its its size or strength (sometimes referred to as _____). |
|
|
Term
|
Definition
| In general, the more you increase the amount of a reinforcer, the ____ benefit you get from the increase. |
|
|
Term
|
Definition
| Identifying ____ can improve the effectiveness of a reinforcement procedure in applied settings. |
|
|
Term
| smooth muscles and glands |
|
Definition
| Behavior that depends on _____________ is harder to reinforce than behavior that depends on skeletal muscles. |
|
|
Term
|
Definition
| Anything that changes to effectiveness of a consequence. |
|
|
Term
-Establishing operations
-Abolishing operations |
|
Definition
| Two kinds of motivating operations |
|
|
Term
|
Definition
| Increase the effectiveness of a consequence |
|
|
Term
|
Definition
| Decrease the effectiveness of a consequence |
|
|
Term
| Previous learning Experience |
|
Definition
| An "other variable" that is particularly important is ______. |
|
|
Term
| Electrical Stimulation of the Brain |
|
Definition
|
|
Term
|
Definition
| A neurotransmitter that produces a natural "high" and is thought to play a major role in reinforcement |
|
|
Term
|
Definition
| An area of the brain that, when stimulated reinforces behavior. It is thought to be key to the neurological basis of reinforcement. |
|
|
Term
|
Definition
| Unexpected reinforcers produce ____ dopamine than expected reinforcers. |
|
|
Term
|
Definition
| Dopamine is a precursor for ___, better known as _____, another important neurotransmitter in learning. |
|
|
Term
- Hull's Drive-Reduction Theory
- Relative Value Theory and the Premack Principle
- Response-Deprivation Theory |
|
Definition
| 3 theories of Positive Reinforcement |
|
|
Term
|
Definition
| Hull's Drive-reduction theory did not seem to account (well) for ______. |
|
|
Term
|
Definition
| In Hull's theory of reinforcement, a motivational state (such as hunger) caused by a period of deprivation (as of food). |
|
|
Term
|
Definition
| the theory of reinforcement that attributes a reinforcer's effectiveness to the reduction of a drive. |
|
|
Term
|
Definition
| The observation that high-probability behavior reinforcers low-probability behavior. |
|
|
Term
|
Definition
| Theory of reinforcement that considers reinforcers to be behaviors rather than stimuli and that attributes a reinforcer's effectiveness to its probability relative to other behaviors. |
|
|
Term
|
Definition
| Response-deprivation theory predicts that the opportunity to engage in any behavior that has _____ the baseline level will be reinforcing. |
|
|
Term
| Response-Deprivation Theory |
|
Definition
| The theory of reinforcement that says behavior is reinforcing to the extent that the organism has been deprived (relative to its baseline frequency) of performing that behavior. |
|
|
Term
| Equilibrium theory or Response Restriction theory |
|
Definition
| Response-Deprivation theory is also called ____. |
|
|
Term
- Two-Process Theory
- One- Process Theory |
|
Definition
|
|
Term
|
Definition
| The view that avoidance and punishment involve two procedures: Pavlovian and Operant learning. |
|
|
Term
|
Definition
| Fear of the CS ____ as the animal learns to avoid shock. |
|
|
Term
| Sidman avoidance procedure |
|
Definition
| An escape-avoidance training procedure in which no stimulus regularly precedes the aversive stimulus. Also called unsignaled avoidance. |
|
|
Term
|
Definition
| the view that avoidance and punishment involve only one procedure: operant learning |
|
|
