Difficulty: Intermediate | Prerequisites: Chapter 4 (brain anatomy, amygdala, limbic system).
This chapter covers the three major forms of learning: classical conditioning (Pavlov), operant conditioning (Skinner, Thorndike), and observational learning (Bandura). It sits at the core of behavioural psychology and connects forward to memory (Ch. 7), cognition (Ch. 8), and emotions/health (Ch. 10). Understanding how associations form, how consequences shape behaviour, and how we learn from watching others is essential for virtually every later topic in the course. You should already know what the amygdala and limbic system do.
Learning is an enduring change in behaviour resulting from experience. Classical conditioning pairs a neutral stimulus with one that naturally triggers a response until the neutral stimulus alone triggers the response. Operant conditioning shapes behaviour through consequences: reinforcement increases behaviour, punishment decreases it. Observational learning lets us acquire behaviours by watching others without direct experience ourselves.
Learning
An enduring change in behaviour that results from experience.
Behaviourism
The school of psychology (founded by Watson) that focuses on observable aspects of learning. Verbal accounts of thoughts were considered unscientific.
Tabula rasa
John Locke's idea that all humans are born as a "blank slate," able to be shaped entirely by experience. Watson adopted this view.
Neutral stimulus (NS)
A stimulus unrelated to a biological response. In simple terms, it does not naturally trigger any particular reaction.
Unconditioned stimulus (US)
A stimulus with inherent properties that elicit a response without any prior learning. Food eliciting salivation in dogs, or shock eliciting freezing in rats.
Conditioned stimulus (CS)
A previously neutral stimulus that has acquired the properties of an unconditioned stimulus through association. The bell, after pairing with food, triggers salivation.
Unconditioned response (UR)
The natural response elicited by an unconditioned stimulus. Salivating when food appears, freezing when shocked.
Conditioned response (CR)
The response elicited by the conditioned stimulus. Differs from the UR in intensity and duration.
Classical conditioning
The process by which a neutral stimulus comes to elicit a reflexive response after being paired with a stimulus that naturally produces that response. Think of it as learning by association.
Acquisition
The initial learning of a behaviour or association. Contiguity is critical: the CS and US must occur close together in time.
Extinction
Learning that an association has ceased to exist. The bell stops being followed by food, and salivation gradually stops.
Spontaneous recovery
The re-emergence of a conditioned response after extinction and a rest period. Dies out quickly unless re-paired with the US.
Generalisation
When a stimulus similar (but not identical) to the CS elicits the same response.
Discrimination
The ability to differentiate between two similar stimuli when one is consistently associated with the US and the other is not.
Second-order conditioning
A neutral stimulus acquires a conditioned response through association with another conditioned stimulus (not the US directly). Celebrity endorsements work on this principle.
Phobia
An acquired fear that is out of proportion to the real threat. Develops through classical conditioning and generalisation.
Counterconditioning
Exposing a person to small doses of a feared stimulus while pairing it with a pleasurable experience, to replace the fear response.
Systematic desensitisation
Patients are taught to relax their muscles and then gradually exposed to increasingly intense versions of the feared stimulus while remaining relaxed.
Tolerance (drug)
Needing more of a drug to achieve the same effect. Increases when the drug is used repeatedly in the same environment (context becomes a CS).
Equipotentiality (in conditioning)
The (incorrect) idea that all stimuli are equally capable of producing conditioning. In reality, animals learn taste-illness associations faster than sound-illness ones.
Biological preparedness
Animals are genetically programmed to fear specific objects (e.g. easier to condition fear of snakes than flowers). An evolutionary advantage.
Rescorla-Wagner model
The strength of a CS-US association is determined by how unexpected the US is. Novel, surprising stimuli produce stronger conditioning.
Blocking effect
When one established CS prevents new neutral stimuli from becoming conditioned, because the animal stops looking for additional predictors.
Occasion setter
A CS predicts the US only under certain conditions. Conditioning occurs only when a prerequisite condition is met.
Operant (instrumental) conditioning
Learning through consequences. The individual "operates" on the environment; actions that produce good outcomes are repeated, actions that produce bad outcomes are not.
Law of effect (Thorndike)
Behaviour that leads to a satisfying outcome is more likely to occur again, and vice versa. The intellectual precursor of operant conditioning.
Reinforcer
Skinner's term for a stimulus following a response that increases the likelihood of that response being repeated.
Shaping / successive approximation
Reinforcing progressively closer approximations of a desired behaviour until the full behaviour is achieved.
Primary reinforcer
Serves a biological need (food, water).
Secondary reinforcer
Does not serve a biological need; acquires reinforcing properties through classical conditioning (e.g. money).
Premack's theory
Some reinforcers are more powerful than others because we want them more.
Positive reinforcement
Increases behaviour by delivering a reward after the behaviour.
Negative reinforcement
Increases behaviour by removing an aversive stimulus after the behaviour. Think of it as relief.
Positive punishment
Decreases behaviour by delivering an aversive stimulus.
Negative punishment
Decreases behaviour by removing a pleasurable stimulus.
Schedules of reinforcement
Patterns of when reinforcement is delivered. Continuous (every time) vs. partial/intermittent. Ratio (based on number of responses) vs. interval (based on time). Fixed (predictable) vs. variable (unpredictable).
Partial-reinforcement extinction effect
Behaviours maintained by partial reinforcement are harder to extinguish because the organism cannot easily detect when reinforcement has stopped.
Token economy
A system where tokens are earned for desired behaviours and exchanged for rewards. Used in schools and psychiatric facilities.
Latent learning
Learning that occurs without reinforcement and becomes apparent only when the situation demands it.
Cognitive maps
Mental representations of spatial layouts, formed when exploring an environment even without visible behavioural changes.
Optimal foraging theory
Describes how animals choose their own reinforcement schedules in the wild, sometimes taking apparently risky actions when the assessment favours it.
Meme
A unit of cultural learning passed from one generation to the next, analogous to a gene. Unimportant ones fade over time.
Observational learning
Learning by watching what others do. Powerfully adaptive.
Modelling
Imitation of observed behaviour. More likely when the model is attractive, high-status, and similar to the observer.
Vicarious reinforcement
Learning from seeing someone else reinforced or punished for a behaviour, without experiencing the consequence yourself.
Mirror neurons
Neurons that fire both when an animal performs a behaviour and when it observes another performing that behaviour. May underlie empathy, learning, and communication.
Watson founded behaviourism: only observable behaviour matters; adopted Locke's tabula rasa
Pavlov's paradigm: Food (US) produces salivation (UR). Pair bell (NS) with food. Eventually bell (now CS) produces salivation (CR) alone
The CR is not always as strong as the UR
Acquisition: contiguity is critical; CS and US must occur close together; the closer, the stronger
Extinction: association ceases when CS is no longer paired with US
Spontaneous recovery: after extinction and a rest, the CR can briefly re-emerge
Generalisation: similar stimuli elicit the same response
Discrimination: distinguishing between stimuli when one predicts the US and the other does not
Second-order conditioning: a new NS acquires a CR through pairing with an existing CS (not the US); explains why money and celebrity endorsements work
Phobia: an acquired fear out of proportion to the real threat
Fear conditioning involves the amygdala (shock produces freezing; light paired with shock leads to light producing freezing)
Phobias develop through generalisation (fear of wasps generalises to all flying insects)
Counterconditioning: pair the feared stimulus with a pleasant experience in small doses
Systematic desensitisation: progressive relaxation paired with gradual exposure to the feared stimulus
Little Albert (Watson's study): conditioned a child to fear rats by pairing them with a loud noise; never got to uncondition him because his mother withdrew him
The context surrounding drug use becomes a CS, which is why addicts relapse when they return to familiar environments
Tolerance increases when a drug is used repeatedly in the same place
The limbic system is involved because it handles emotion and motivation
Equipotentiality is wrong: not all stimuli are equally conditionable; taste-illness associations form faster than sound-illness ones because taste is more directly involved
Biological preparedness: animals are genetically primed to fear certain things (snakes more easily than flowers); an evolutionary advantage
Species differ in which modality they condition to (rats rise on hind legs for visual cues, freeze for auditory ones; taste conditioning is easy in rats but difficult in birds)
Stimuli are easier to condition when they come before (not after) the US because they predict it
Rescorla-Wagner model: surprise drives learning; the more unexpected the US, the stronger the association; novel stimuli are more influential
Blocking effect: an established CS blocks new stimuli from becoming conditioned
Occasion setter: a CS predicts the US only under specific conditions
Classical conditioning is passive (mental associations form regardless of your actions); operant conditioning is active (you "operate" on the environment)
Thorndike's puzzle box: cats learned to escape faster with each trial; led to the law of effect (satisfying outcomes increase repetition)
Skinner coined "reinforcer" (satisfaction was too subjective); used the Skinner box to demonstrate shaping (successive approximation)
Reinforcers: primary (biological need) vs. secondary (learned via classical conditioning, e.g. money)
Premack's theory: some reinforcers are more potent because we want them more
Reinforcement increases the probability of behaviour; punishment decreases it
Both can be positive (adding something) or negative (removing something)
Positive reinforcement: add a reward after behaviour (ice cream for finishing homework)
Negative reinforcement: remove an aversive stimulus after behaviour (no vegetables if homework is done); still increases behaviour
Positive punishment: add an aversive stimulus (smacking a child who crosses the road alone)
Negative punishment: remove a pleasurable stimulus (taking away ice cream)
Punishment is risky: people learn to avoid the punisher rather than the behaviour; must be immediate, proportionate, and directly tied to the unwanted behaviour; can cause fear and anxiety toward the person administering it; corporeal punishment teaches children that violence is acceptable
Reinforcement is generally more effective than punishment because it tells the child what to do rather than what not to do
Continuous: reinforcement after every response; fast learning but rare in the real world
Partial/intermittent: more common; behaviour reinforced only sometimes
Ratio schedules: based on number of responses; produce fast learning
Interval schedules: based on time; produce slower learning
Fixed schedules: predictable (hourly pay); lead to high response levels
Variable schedules: unpredictable (sales commissions, pop quizzes); produce persistent behaviour
Partial-reinforcement extinction effect: behaviour maintained by partial reinforcement is harder to extinguish (technique: start continuous, shift to partial, e.g. toilet training)
Token economies: tokens earned for good behaviour, exchanged for future rewards; used in schools and psychiatric facilities
Conditioning fails when it conflicts with an animal's evolutionary nature; different brain regions solve different problems
Tolman: reinforcement affects performance more than learning; latent learning (rats form cognitive maps of mazes without reinforcement, revealed when food is introduced)
Behavioural economics: people choose between reinforcers; personal worth affected by delay to reinforcement and probability of payoff; addicts discount future rewards more than non-addicts
Optimal foraging theory: animals choose their own reinforcement schedules in the wild, sometimes taking apparently risky actions
Memes: cultural learning units passed across generations (analogous to genes)
Bandura's Bobo doll studies: children who watched adults behave aggressively were twice as likely to act aggressively themselves; suggestive of media violence effects
Animals acquire fear through observation (wild monkeys fear snakes; lab-raised monkeys learn to fear snakes by watching wild ones)
Teaching through demonstration occurs in animals (cheetahs injure prey and let cubs finish) and humans
Modelling: imitation of observed behaviour; more likely when the model is attractive, high-status, and similar to the observer; must be physically capable of imitating
Vicarious reinforcement: observing outcomes for others influences whether we imitate; Bandura's three-ending Bobo study showed all children learned how to beat the doll, but whether they performed the behaviour depended on whether the adult was rewarded or punished
Mirror neurons: fire both when performing and when observing a behaviour; found in humans and other animals; may underlie empathy, learning, and communication
Media violence: psychologists and paediatricians have concluded a causal connection exists between media violence and aggressive behaviour, though validating the longitudinal studies is difficult without proper control groups
Systematic desensitisation is used clinically to treat phobias and anxiety disorders. Token economies are applied in classrooms and psychiatric wards to shape behaviour. Advertisers rely on second-order conditioning (pairing a product with a celebrity) and operant principles (loyalty reward programmes) to drive consumer behaviour.
Students often confuse negative reinforcement with punishment. Negative reinforcement increases behaviour by removing something unpleasant; punishment decreases behaviour.
Students think classical and operant conditioning are the same. Classical is passive (associations form between stimuli); operant is active (consequences shape voluntary behaviour).
Students assume all stimuli are equally conditionable. Biological preparedness means some associations (e.g. taste with illness) form far more readily than others.
Students confuse extinction with forgetting. Extinction is active learning that the association no longer holds; spontaneous recovery proves the original learning still exists.
⚠️ The four-box grid of reinforcement and punishment (positive/negative x reinforcement/punishment) is a near-certain exam topic. Be able to classify any example.
⚠️ Know the difference between classical and operant conditioning: passive vs. active, association vs. consequence.
⚠️ Understand the Rescorla-Wagner model: surprise drives conditioning, not mere contiguity.
⚠️ Bandura's Bobo doll studies are classic exam material: what they showed about observational learning, modelling, and vicarious reinforcement.
⚠️ Be able to explain biological preparedness and why equipotentiality (in conditioning) is wrong.
True or False: Negative reinforcement decreases behaviour. (False. It increases behaviour by removing an aversive stimulus.)
Fill in the blank: A previously neutral stimulus that now triggers a conditioned response is called a __________. (Conditioned stimulus / CS)
True or False: In second-order conditioning, the new stimulus is paired directly with the unconditioned stimulus. (False. It is paired with another conditioned stimulus.)
Fill in the blank: The __________ effect means that behaviours maintained by partial reinforcement are harder to extinguish. (Partial-reinforcement extinction)
True or False: Mirror neurons fire only when an animal performs a behaviour, not when it observes one. (False. They fire in both cases.)
Q: Explain the difference between positive punishment and negative reinforcement, using an example for each.
A: Positive punishment decreases behaviour by adding an aversive stimulus (e.g. a child is scolded for running into the road). Negative reinforcement increases behaviour by removing an aversive stimulus (e.g. a child is excused from chores for finishing homework on time). The key distinction is direction: punishment reduces behaviour, reinforcement increases it.
Q: What is the Rescorla-Wagner model, and how does it improve on the simple contiguity account of classical conditioning?
A: The Rescorla-Wagner model states that the strength of a CS-US association depends on how unexpected the US is. Simple contiguity says that any pairing will produce conditioning, but Rescorla-Wagner explains why novel stimuli condition more readily (surprise leads to attention) and why the blocking effect occurs (an established CS prevents new stimuli from becoming conditioned because the US is no longer surprising).
Q: Describe Bandura's Bobo doll experiment and explain what it demonstrates about observational learning and vicarious reinforcement.
A: Children watched adults interact with a Bobo doll either aggressively or calmly. Those who saw aggression were twice as likely to act aggressively. In a follow-up, the adult was either rewarded or punished after hitting the doll. All children learned how to beat the doll, but whether they performed the behaviour depended on the observed consequence. This shows that observational learning affects what is learned, while vicarious reinforcement affects what is performed.
Q: Why is punishment considered "risky" as a behavioural tool compared to reinforcement?
A: Punishment teaches what not to do rather than what to do. People often learn to avoid the punisher rather than the behaviour itself. It must be immediate, proportionate, and directly linked to the unwanted behaviour to work. It can cause fear and anxiety directed at the person administering it. Corporeal punishment may teach children that violence is acceptable. Reinforcement is generally more effective because it provides a clear signal about desired behaviour.
Classical conditioning of fear connects directly to Chapter 4 (amygdala) and Chapter 10 (emotions, stress, and phobias). Operant conditioning principles underlie Chapter 10's discussion of health behaviours (smoking, eating, exercise). Observational learning and mirror neurons connect to the social and developmental material later in the course. Schedules of reinforcement are relevant to understanding addiction (Ch. 10) and behavioural economics.
learning, classical conditioning, Pavlovian conditioning, operant conditioning, instrumental conditioning, behaviourism, Watson, Pavlov, Skinner, Thorndike, reinforcement, punishment, positive reinforcement, negative reinforcement, positive punishment, negative punishment, law of effect, shaping, successive approximation, schedules of reinforcement, continuous reinforcement, partial reinforcement, ratio schedule, interval schedule, fixed schedule, variable schedule, partial-reinforcement extinction effect, token economy, CS, US, CR, UR, neutral stimulus, acquisition, extinction, spontaneous recovery, generalisation, discrimination, second-order conditioning, phobia, counterconditioning, systematic desensitisation, fear conditioning, tolerance, biological preparedness, equipotentiality, Rescorla-Wagner model, blocking effect, occasion setter, latent learning, cognitive maps, Tolman, optimal foraging theory, meme, observational learning, Bandura, Bobo doll, modelling, vicarious reinforcement, vicarious learning, mirror neurons, Albert B, Little Albert, drug addiction conditioning, PSY 320, health psychology