ArticlePublisher preview available

Effects on performance of placing a visual cue at different temporal locations within a constant delay interval

Authors:
To read the full-text of this research, you can request a copy directly from the authors.

Abstract

Studied the effects of presenting cues at different times within a 7.5-sec delay of reinforcement interval during the acquisition and extinction of a bar-press response by 72 naive female albino Sprague-Dawley rats. In acquisition, the 3 following types of temporal placements were used: (a) a cue presented only at the beginning of the delay interval, (b) a cue occurring throughout the duration of the delay interval, and (c) a cue which was presented only at the end of the interval. In extinction, each group was divided so that 1/2 of the group received the cue condition and 1/2 did not. In addition, a no-cue control group was employed in both acquisition and extinction. In acquisition and extinction, the cue conditions tended to produce shorter latencies than did the no-cue conditions. Extinction data further indicate that the greatest resistance to extinction was produced when the offset of the cue was associated with the end of the delay interval. A secondary reinforcement interpretation is advanced to explain these results. (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Journal
oj
Experimental
Psychology
1971,
Vol.
87, No. 2,
220-224
EFFECTS
ON
PERFORMANCE
OF
PLACING
A
VISUAL
CUE AT
DIFFERENT
TEMPORAL LOCATIONS WITHIN
A
CONSTANT DELAY
INTERVAL1
J. W.
TOMBAUGH
AND
T. N.
TOMBAUGH2
Carleton
University,
Ottawa,
Ontario
The
effects
of
presenting cues
at
different
times within
a
7.5-sec.
delay
of
reinforcement
interval were studied during
the
acquisition
and
extinction
of a
bar-press response
by
rats.
In
acquisition,
the
three
following
types
of
tem-
poral
placements were
used:
(a) a cue
presented only
at the
beginning
of the
delay
interval;
(6) a cue
occurring throughout
the
duration
of the
delay inter-
val,
and
(c)
a cue
which
was
presented only
at the end of the
interval.
In
extinc-
tion,
each group
was
divided
so
that
half
of the
group received
the cue
condition
and
half
did
not.
In
addition,
a
no-cue control group
was
employed
in
both
acquisition
and
extinction.
In
acquisition
and
extinction,
the cue
conditions
tended
to
produce shorter latencies than
did the
no-cue conditions.
The
extinction
data
further
indicated
that
the
greatest
resistance
to
extinction
was
produced
when
the
offset
of the cue was
associated with
the end of the
delay
interval.
A
secondary reinforcement interpretation
was
advanced
to
explain
these results.
Acquisition
results
from
studies
which
have employed
constant
delay
of
rein-
forcement
consistently have demonstrated
the
following
relationships:
(a)
Perform-
ance
is
inversely
related
to the
length
of
the
delay interval;
(&)
delay-associated
cues
extend
the
temporal gradient
by
increasing
the
maximum length
of the
delay
that
can be
used
effectively
to
establish
a
response;
and (c)
cues tend
to
interact
with
the
length
of the
delay interval
so
that
performance
is
improved more during
long delays
than
with
short
delays (Ren-
ner,
1964). Renner (1964)
has
suggested
that
delay-associated cues should also
lead
to
superior performance
in
extinction.
However, results
from
experiments
which
have
used extinction
data
to
assess
the
delay-cue
relationship have
failed
to
sub-
stantiate
this
prediction when
the
tem-
poral positioning
of the cue has not
been
altered
from
acquisition
to
extinction
(Renner,
1963, 1965).
The
precise temporal location
which
the cue
occupies within
the
delay interval
1
This research
was
supported
by
Grant APA-
0265
from
the
National Research Council
of
Canada.
The
author
gratefully
acknowledges
the
assistance
of
Heather Lindsay
for
running
5s.
2
Requests
for
reprints
should
be
sent
to Tom
Tombaugh,
Psychology Department, Carleton Uni-
versity,
Ottawa, Ontario, Canada.
represents
one
variable
which
may be
critical
in
determining
the
degree
to
which
cues
will
influence
extinction performance.
For
example,
a cue of
short duration placed
at the
beginning
of the
delay interval might
be
expected
to
produce
a
different
effect
from
the
same
cue
occurring
at the end of
the
delay interval. Since
no
experiment
has
attempted
a
comparative
investigation
of
the
effects
of
placing cues
at
different
locations
in the
delay interval,
the
present
study
was
designed
to
perform such
a
comparison.
METHOD
Subjects
Seventy-two nai've
female
albino
rats
of the
Sprague-Dawley
strain purchased
from
the
Holtz-
man
Company were used
as 5s.
They were approxi-
mately
90
days
old at the
beginning
of the
experi-
ment.
Apparatus
Eight experimental chambers were used.
Each
chamber (60.16
cm
long
X
71.12
cm.
wide
X
73.66
cm.
high)
was
constructed
of
1.91-cm.
plywood
and
sound
insulated with acoustical ceiling tile.
A
100-cfm
Dayton blower, located
in the
upper
left-
hand corner
of the
back
wall,
was
used
for
ventila-
tion
and
masking noise.
The 5s
were
tested
in a
Hoeltge HB-11A cage
(24.76
cm.
long
X
20.32
cm.
wide
X
18.41
cm.
high)
mounted
in the
center
of the
chamber.
Illumination
was
provided
by a
12-vdc.
6-w.
lamp
(house
light)
positioned behind
an
opaque
220
... Their presentation is relevant because they permit the reader to follow the experimental manipulation across different experimental procedures and assess the different results and interpretations associated with the independent variable. Tombaugh and Tombaugh (1971) exposed naïve rats to a fixed-ratio (FR) 1, fixed-time (FT) 7.5-s chained schedule and varied the placement of a 1.5-s visual cue across the delay interval. Their results showed that response latency was high when no cue was present and low with a continuous signal; intermediate and very similar results were found when the signals were located at the beginning or end of the delay interval. ...
... Taken together, the studies designed to evaluate the effects of responsesignal temporal separation in reinforcement schedules are difficult to assess. The Royalty et al. (1987) study shows that separation of the response from the signal has clear detrimental effects on response rate maintenance; however, the Tombaugh and Tombaugh (1971) study suggests that a late signal may enhance resistance to extinction, and the Lieberman et al. (1985) study shows that delayed cue presentation may not affect acquisition of a discrimination response. The Williams et al. (1990) study appears to make a clear case in replicating the Royalty et al. findings; however, the effects of response-signal temporal separation differ (especially when comparing Experiments 1 and 2, where the first experiment suggests that the independent variable may have a graded effect and the second suggests that it may produce a steep decline in response rate), and it is impossible to determine why they differ because experimental procedures vary considerably across the three experiments. ...
... In both the present study and the Royalty et al. (1987) experiment, relatively long interreinforcer intervals were used (32 s and 99 s, respectively). In contrast, interreinforcer intervals in both the Tombaugh and Tombaugh (1971) study and the Lieberman et al. (1985) experiment were comparatively brief (7.5 s and 6 s, respectively). Thus the possibility that response-signal separation effects on operant behavior depend on the specific temporal parameters of the interreinforcer interval cannot be excluded. ...
Article
Full-text available
The present study assessed the effects of systematically separating the cue from the response in temporally defined schedules of delayed signaled reinforcement. Identical schedules were used to study the effects of the independent variable on response acquisition and response maintenance. In the first experiment, 8 groups of 3 naïve rats were exposed to 1 of 8 temporally defined schedules that differed in both the duration of a response opportunity and response-signal temporal separation. In the second experiment, 3 rats were exposed to the previously described schedules using a within-subjects design. Results in both experiments showed response rate as a decreasing function of response-signal temporal separation. The findings could be the result of the combination of delaying conditioned reinforcement and blocking the response selected for reinforcement.
... Their presentation is relevant because they permit the reader to follow the experimental manipulation across different experimental procedures; additionally they permit the reader to assess different results and interpretations associated with the independent variable. Tombaugh & Tombaugh (1971), exposed naïve rats to a chained FR 1 FT 7.5-s schedule and varied the placement of a 1.5-s visual cue across the delay interval. Their results showed response latency was high when no cue was present, and low with a continuous signal; intermediate latencies were found when the signals were located at the beginning or end of the delay interval. ...
... The Royalty et al. (1987) study shows separation of the response from the signal has clear detrimental effects on response rate maintenance. The Tombaugh & Tombaugh (1971) study suggests a late signal may enhance resistance to extinction. Finally, the Lieberman, Davidson & Thomas (1985) study shows delayed cue presentation may not affect acquisition of a discrimination response. ...
Article
Full-text available
The present study assessed the possibility that lever pressing by rats, will increase, if this response is correlated with the presentation of exteroceptive stimuli, previously paired with primary reinforcement. Naïve rats were exposed to ten 30 minute sessions where a FT 60-s schedule presented food correlated with a 3-s blackout and the operation of the food delivery magazine. After the training phase was over, an acquisition phase began, subjects could receive one of four different schedules for twenty consecutive sessions: 1) CRF; 2) FR1, FT 2-s; 3) FR1, FT 5-s or 4) FR1, FT 10-s; nine subjects were exposed to each schedule. Results produced by the conditioned reinforcement conditions were compared with conditions where: 1) primary reinforcement was delivered during the acquisition phase, 2) blackout and magazine operation occurred during the training phase but in the absence of food, and 3) subjects remained in the experimental chamber without any programmed stimulus presentation during the training phase. Both the primary reinforcement and the conditioned reinforcement conditions produced delay gradients; the latter was considerably steeper than the former. Results were discussed in terms of their similarity with previous studies; they were also discussed in terms of the ongoing debate regarding the empirical validity of the conditioned reinforcement concept.
... Their presentation is relevant because they permit the reader to follow the experimental manipulation across different experimental procedures; additionally they permit the reader to assess different results and interpretations associated with the independent variable. Tombaugh & Tombaugh (1971), exposed naïve rats to a chained FR 1 FT 7.5-s schedule and varied the placement of a 1.5-s visual cue across the delay interval. Their results showed response latency was high when no cue was present, and low with a continuous signal; intermediate latencies were found when the signals were located at the beginning or end of the delay interval. ...
... The Royalty et al. (1987) study shows separation of the response from the signal has clear detrimental effects on response rate maintenance. The Tombaugh & Tombaugh (1971) study suggests a late signal may enhance resistance to extinction. Finally, the Lieberman, Davidson & Thomas (1985) study shows delayed cue presentation may not affect acquisition of a discrimination response. ...
... Their presentation is relevant because they permit the reader to follow the experimental manipulation across different experimental procedures; additionally they permit the reader to assess different results and interpretations associated with the independent variable. Tombaugh & Tombaugh (1971), exposed naïve rats to a chained FR 1 FT 7.5-s schedule and varied the placement of a 1.5-s visual cue across the delay interval. Their results showed response latency was high when no cue was present, and low with a continuous signal; intermediate latencies were found when the signals were located at the beginning or end of the delay interval. ...
... The Royalty et al. (1987) study shows separation of the response from the signal has clear detrimental effects on response rate maintenance. The Tombaugh & Tombaugh (1971) study suggests a late signal may enhance resistance to extinction. Finally, the Lieberman, Davidson & Thomas (1985) study shows delayed cue presentation may not affect acquisition of a discrimination response. ...
Article
Full-text available
The present study assessed the possibility that lever pressing by rats, will increase,if this response is correlated with the presentation of exteroceptive stimuli, reviously paired with primary reinforcement. Naïve rats were exposed to ten 30 minute sessions where a FT 60-s schedule presented food correlated with a 3-s blackout and the operation of the food delivery magazine. After the training phase was over, an acquisition phase began, subjects could receive one of four different schedules for twenty consecutive sessions: 1) CRF; 2) FR1, FT 2-s; 3) FR1, FT 5-s or 4) FR1, FT 10-s; nine subjects were exposed to each schedule. Results produced by the conditioned reinforcement conditions were compared with conditions where: 1) primary reinforcement was delivered during the acquisition phase, 2) blackout and magazine operation occurred during the training phase but in the absence of food, and 3) subjects remained in the experimental chamber without any programmed stimulus presentation during the training phase. Both the primary reinforcement and the conditioned reinforcement conditions produced delay gradients; the latter was considerably steeper than the former. Results were discussed in terms of their similarity with previous studies; they were also discussed in terms of the ongoing debate regarding the empirical validity of the conditioned reinforcement concept.
Article
College students (72 male, 72 female) expected that parents would be more likely to follow children's behaving as requested with contact comfort, smiling, and pleasant tone of voice than children's not behaving as requested. If students' expectations reflect reality, then the results, in combination with previous ones, suggest that parents instrumentally condition children to behave appropriately in part by following children's appropriate behaviors with conditioned reinforcers (smiling, pleasant tone of voice) and then a primary reinforcer (contact comfort). This reinforcement situation should be particularly conducive to both the acquisition of appropriate behaviors and the continued maintenance of these behaviors in the face of long delays of contact comfort.
Article
Rats were given 30 shock escape trials with a 3-sec delay of shock offset. A light cue presented during the delay facilitated performance significantly more when the light was located over the lever as opposed to being located on the opposite wall. It was concluded that orientation, in part, plays a significant role in determining the extent to which cues facilitate delayed-reward performance.
Article
Three experiments examined the extent to which a differential outcome effect controlled performance in a two-choice instrumental discrimination. In Experiment 1, hungry rats responded on a concurrent variable interval (VI) 60-s extinction (ext) schedule; food reinforcement was presented for responses to the VI 60-s component after a 5-s delay. When a 2-s localized visual stimulus (illumination of the response lever) was presented after the to-be-reinforced response on the VI lever, improved discrimination performance (i.e., more responding to the VI than the ext lever) compared to an unsignaled control condition was noted. In Experiment 2, the same visual stimulus presented after responses to the extinction lever retarded emergence of the discrimination compared to an unsignaled condition (Phase 1). A similar retardation of responding to the correct lever was noted in Phase 2 when the stimulus was a 2-s overhead light flash. In Experiment 3, rats with a 2-s response-contingent overhead light flash associated with the VI component learned to discriminate the VI from the ext component more readily than did a group of rats with no stimulus. However, a group of rats with the overhead light presented after incorrect responses to the ext component demonstrated retarded discrimination learning. These results suggest that a differential outcome effect does not control performance in a delayed reward discrimination task when visual stimuli are employed.
Article
Four experiments used hungry rats leverpressing for food reinforcement. The effects of different stimuli serving to signal a delay of reinforcement on responding maintained by a variable interval (VI) 60-s schedule with a 5-s delay of reward were studied. In the initial two experiments, groups of rats responded faster with a discrete visual stimulus (Experiment 1) or diffuse auditory stimulus (Experiment 2) that either signalled the whole delay period or signalled the first part of the delay period relative to groups with an unsignalled delay. If only the second half of the delay period was signalled with the visual stimulus, then performance relative to the unsignalled condition was attenuated (Experiment 1). In contrast, performance with the diffuse auditory signal in the second half of the delay period was similar to that with no stimulus (Experiment 2). The results obtained with a stimulus filling the second half of the delay period were confirmed in Experiments 3 and 4. These data suggest that the effect of signalling reinforcement delays will depend upon the degree of interference produced by sign-tracking behaviors, and not on the blocking of response-reinforcer associations by intervening stimuli.
Article
In four experiments human subjects pressed the space bar of a computer keyboard to make a triangle displayed on the monitor of the computer flash. The subjects then rated the causal effectiveness of the response under a number of conditions. In Experiments 1 and 2, subjects experienced four conditions: response immediately followed by outcome; outcome unrelated to response, outcome 5 s after response, and outcome 5 s after response, but in which a 2-s stimulus filled part of the delay. In all experiments responses emitted in the uncorrelated and unsignaled delay conditions were rated as less effective than those in the immediate condition. In Experiment 1, when the stimulus filled the first part of the delay, ratings of causal effectiveness of the response were elevated relative to a condition with no stimulus in the outcome delay. In Experiments 2a and 2b, when the delay stimulus filled the latter part of the delay, ratings of the causal effectiveness of responses in this condition were no different than in the unsignaled delay condition. In Experiments 3 and 4, responses during the delay but prior to the stimulus reset the delay period (ensuring a 3-s delay between response and delay stimulus), and ratings were higher in a condition with a delay stimulus prior to the outcome than without a stimulus. These results are similar to those noted for response rates in non-human conditioning experiments and further extend the parallel between the results from such studies and those from experiments on human causality judgment.
Article
Full-text available
The independent variable of delay of reinforcement is traced from its early empirical history through the systematic treatment provided by Hull and Spence. The empirical findings and theoretical implications of recent experimental studies are noted. The effects of delay of reward and delay of punishment on the learning process are considered, the comparative studies with human Ss are reported, and the relevance of delay of reinforcement to abnormal behavior and personality is summarized. (103 ref.) (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Article
Full-text available
A factorial design, using 3 intervals of delay, 2 levels of food deprivation, and presence or absence of goal related stimuli in the delay chamber, was employed to study acquisition and extinction performance of rats in a straight alley runway. The well established temporal gradient of reinforcement was obtained; this gradient was affected by drive level and availability of goal box cues, with drive level and delay combining additively, and with the cues facilitating performance only when reinforcement was delayed. High drive animals extinguished faster than low drive animals. The acquisition and extinction performance of the animals was discussed in terms of delay of reward as a frustration. (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Article
Full-text available
The problem is considered of comparing resistance to extinction when a "correction" for systematic differences in initial extinction response level is required. It is shown that the most commonly used correction procedures have limited merit. 2 other approaches are taken up. A specific mathematical model may be employed and some parameter of the model used as a measure of resistance to extinction. The advantages of this approach are balanced by its limited applicability. The shape function method, which has considerable generality, is presented and statistical test procedures are derived for it. Some applications are also pointed out for other areas of learning. (33 ref.)
Article
A comprehensive review and discussion of conditioning and learning. When the present revision is compared to the 1940 Hilgard and Marquis "Conditioning and Learning," 4 chapters concerned with the nature of reinforcement, generalization, and discrimination are found to have replaced chapters on serial learning, problem solving, voluntary action, and neurophysiological mechanisms. Chapters in the present work include "The Definition of Learning," "Conditioning in Historical Perspective," "Classical and Instrumental Conditioning Experiments," "Classical and Instrumental Conditioning Compared," "Practice and Strength of Conditioning," "Parameters of Reinforcement," "Secondary Reinforcement," "General Theories of Reinforcement," "Mechanisms of Reward," "The Nature of Extinction," "Generalization," "Discrimination," "Motivation and Learning," and "Applications to Personality." The extensive treatment given these topics is indicated by the fact that 1391 articles and books are referenced. A glossary is included. From Psyc Abstracts 36:04:4EH90K. (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Article
The effects of deprivation level, goal-related cues, and delay of reinforcement on the extinction of a position discrimination response were observed. Deprivation level and cues did not differentially affect rate of extinction or the number of perseveration responses. Delay of reinforcement resulted in a lower level of performance at the end of acquisition and during extinction, and for immediate reinforcement Ss, the rate of decline during extinction was faster although they showed greater initial perseveration.
Resistance to extinction as a function of the length of the delay interval. Unpublished manuscript
  • T N Tombaugh
TOMBAUGH, T. N. Resistance to extinction as a function of the length of the delay interval. Unpublished manuscript, Carleton University, 1969.
Statistical principles in experimental sign
  • B J Winer
WINER, B. J. Statistical principles in experimental sign. New York: McGraw-Hill, 1962. (Received July 9, 1970)