Skip Navigation


Brain Advance Access originally published online on July 11, 2007
Brain 2007 130(9):2412-2424; doi:10.1093/brain/awm147
This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrowOA All Versions of this Article:
130/9/2412    most recent
awm147v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (14)
Right arrow Disclaimer
Google Scholar
Right arrow Articles by Schott, B. H.
Right arrow Articles by Düzel, E.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Schott, B. H.
Right arrow Articles by Düzel, E.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

© 2007 The Author(s)
This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/2.0/uk/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Ageing and early-stage Parkinson's disease affect separable neural mechanisms of mesolimbic reward processing

Björn H. Schott1,2, Ludwig Niehaus2, Bianca C. Wittmann3, Hartmut Schütze2, Constanze I. Seidenbecher1, Hans-Jochen Heinze1,2 and Emrah Düzel2,4

1Leibniz-Institute for Neurobiology, Brenneckestr. 6, Magdeburg 39118 2Department of Neurology II and Center for Advanced Imaging, Otto von Guericke University, Magdeburg, Germany 3Wellcome Department of Imaging Neuroscience, Institute of Neurology, University College London and 4Institute of Cognitive Neuroscience, University College London, London, UK

Correspondence to: Emrah Düzel, Institute of Cognitive Neuroscience, University College London, Alexandra House, Queen Square, London, UK E-mail: e.duzel{at}icn.ucl.ac.uk


    Summary
 Top
 Summary
 Introduction
 Material and methods
 Results
 Discussion
 Conclusions
 References
 
The ability to learn stimulus-reward associations on the basis of reward prediction errors critically depends on the mesolimbic dopaminergic system including the dopaminergic midbrain and the ventral striatum. It is known that healthy elderly and patients with Parkinson's disease are less proficient than healthy young adults in learning stimulus-reward contingencies, but it is unclear whether this is due to dysfunctional mesolimbic reward prediction or due to deficiency in processing the rewards per se. We used a well-established event-related fMRI reward-prediction paradigm to address this question. Young adults showed the well-replicated pattern of midbrain and ventral striatal activation for stimuli that predicted monetary reward when compared with stimuli that predicted neutral feedback. Also, as expected, the predicted reward feedback itself did not elicit a mesolimbic response. Healthy elderly subjects and unmedicated early-stage idiopathic Parkinson's disease patients showed the opposite pattern with an absent mesolimbic reward prediction response, but mesolimbic activation to the reward feedback itself. This suggests that the healthy elderly and Parkinson's disease patients were less proficient in learning the predictive value of the reward cues despite preserved mesolimbic processing of reward prediction errors. Parkinson's disease patients additionally displayed a relatively increased response of the anterior cingulate during reward feedback processing and diminished functional connectivity of the midbrain and ventral striatum. Our results are compatible with existing behavioural evidence that both groups exhibit a particularly pronounced deficit in learning from positive feedback and support the view that a tendency to underestimate expected values of reward cues might underlie this deficit. Furthermore, alterations in reward processing in Parkinson's disease extend beyond accelerated ageing effects and include altered connectivity within the mesolimbic system.

Key Words: ageing; Parkinson's disease; reward; expected value; accumbens; fMRI; functional connectivity

Abbreviations: CS+, conditioned (i.e. reward-predicting) stimulus; DA, dopamine; NAcc, nucleus accumbens; PD, Parkinson's disease; PFC, prefrontal cortex; SN, substantia nigra; VTA, ventral tegmental area

Received January 8, 2007. Revised April 29, 2007. Accepted May 30, 2007.


    Introduction
 Top
 Summary
 Introduction
 Material and methods
 Results
 Discussion
 Conclusions
 References
 
The ability to learn stimulus-reward associations on the basis of reward prediction errors is generally believed to depend critically upon the functional interplay of the ventral striatum, particularly the nucleus accumbens (NAcc), and the midbrain dopaminergic system. A key mechanism in mesolimbic reward processing is phasic activity of dopamine (DA)-containing neurons in the ventral tegmental area (VTA) and the medial substantia nigra (SN; for a review see Schultz, 2004Go). During unexpected primary (e.g. food) or secondary (e.g. money) rewards, the NAcc receives dopaminergic signals from these midbrain structures. Once a reward becomes predictable by a conditioned (i.e. reward-predicting) stimulus (CS+), the dopaminergic signal in the NAcc shifts forward from the time of reward outcome to the presentation of the CS+. Conversely, omission of a reward after presentation of a CS+ leads to decrease of DA signalling below baseline. It has thus been hypothesized that the DA signal in the NAcc codes for both reward prediction and prediction error. In accordance with these findings in animals, human functional neuroimaging studies have reliably shown activation of the dopaminergic midbrain and the ventral striatum during reward anticipation (Knutson and Cooper, 2005Go). Studies using delayed monetary incentive tasks have essentially shown that the mesolimbic response codes both the unexpected reward (i.e. prediction error) and the prediction of an expected reward upon presentation of a cue (i.e. reward anticipation) (Knutson et al., 2001Go; O’Doherty et al., 2003Go; Wittmann et al., 2005Go, Yacubian et al., 2006Go). More specifically, the ventral striatal response shift from the time of the reward to the time of the presentation of the CS+ depends upon successful learning of a stimulus-reward relationship (O’Doherty et al., 2003Go) and increases with the amount of the expected value (Knutson et al., 2005Go). Several studies have also shown a co-activation of the medial dopaminergic midbrain, i.e. the medial SN and the VTA along with the ventral striatal response to reward prediction (Wittmann et al., 2005Go; Adcock et al., 2006Go; O’Doherty et al., 2006Go). While the fMRI correlates of reward anticipation in the ventral striatum have been relatively well established, the contributions of the medial prefrontal cortex (PFC) and the anterior cingulate are less clear. Activations in these regions have been observed during positive reward outcome of expected rewards (Knutson et al., 2001Go; Wittmann et al., 2005Go), but also as a function of reward probability during the anticipation phase (Critchley et al., 2001Go; Knutson et al., 2005Go), and it has been suggested that the anterior cingulate/medial PFC might code for the probability component of expected values (Knutson et al., 2005Go).

These earlier studies had been carried out in healthy, young adults. It is thus far unknown how reductions in dopaminergic neurotransmission, as they occur, for example, in normal ageing or in Parkinson's disease, affect the neural correlates of human reward anticipation and outcome processing. The human dopaminergic system is subject to physiological changes during ageing. PET has revealed loss of both pre- and post-synaptic marker molecules involved in dopaminergic neurotransmission during ageing (Volkow et al., 1998bGo), which has been associated with psychomotor, cognitive and behavioural parameters (Volkow et al., 1998aGo; Bäckman et al., 2000Go; Kaasinen and Rinne, 2002Go; Erixon-Lindroth et al., 2005Go; Bäckman et al., 2006Go).

An extreme case of loss of pre-synaptic dopaminergic function is found in Parkinson's disease (PD), a condition characterized by relatively selective loss of dopaminergic neurons in the SN. While motor symptoms related to degeneration of the nigro-striatal DA pathway dominate the clinical picture in PD, cognitive alterations (Carbon and Marie, 2003Go) and depressive symptoms (Ishihara and Brayne, 2006Go) are not uncommon, and converging evidence from behavioural pharmacology and neuroimaging suggests that these findings could at least in part relate to impairment of the mesolimbic and mesocortical DA pathways (Ito et al., 2002Go; Mattay et al., 2002Go). While most neuroimaging studies on cognitive dysfunction in PD have focused on frontal-lobe-dependent processes such as working memory and executive function (Cools et al., 2002Go; Mattay et al., 2002Go; Rowe et al., 2002Go), accumulating behavioural evidence suggests that another cognitive process frequently affected in PD is reward-related learning. In a recent study impaired reward-related learning was observed in unmedicated PD patients, that is, under conditions of DA depletion. However, in medicated PD patients, it improved significantly above the level of the healthy age-matched elderly (Frank et al., 2004Go). Other recent behavioural findings show that normal ageing itself is also associated with a deficit in stimulus-reward learning, which is dissociable from performance in tests assessing executive function (Marschner et al., 2005Go; Mell et al., 2005Go).

While both normal ageing and PD have been associated with reduced performance in reward-related learning, little is known about how the neural mechanisms of DA-dependent reward processing in the ventral striatum are affected by ageing or PD. Particularly, it is unclear whether impaired reward-related learning in ageing and PD is related to an impairment in computing dopaminergic prediction errors or to a reduced ability to utilize these prediction errors in computing expected values—a critical mechanism for the generation of future reward predictions. It is also unclear whether alterations of reward-related mesolimbic processing in healthy ageing and PD qualitatively differ from each other.

Here we used event-related functional magnetic resonance imaging (fMRI) to investigate the neural mechanisms underlying reward prediction and reward outcome processing in a cohort consisting of young and elderly healthy subjects and of unmedicated patients with early, unilateral Parkinson's disease. We used a delayed monetary incentive task that has previously been shown in young adults to allow a dissociation of brain activity related to reward prediction and outcome (Wittmann et al., 2005Go). We reasoned that an impairment in learning stimulus-reward associations and the resulting problem to correctly predict rewards would be associated with reduced mesolimbic reward prediction response. A combination of a reduced prediction response with a preserved response to the reward feedback would show that reward processing and prediction error of reward is preserved which, in turn, would indicate an impairment to use reward prediction errors as learning signals for stimulus-reward associations. A reduced response to the reward feedback itself, on the other hand, would indicate a fundamental dysfunction in mesolimbic reward processing. We conceptualized mesolimbic dysfunction not only as reduction in activity levels but also considered the possibility of altered functional coupling of the SN/VTA and the NAcc.


    Material and methods
 Top
 Summary
 Introduction
 Material and methods
 Results
 Discussion
 Conclusions
 References
 
Participants
A total of 48 subjects participated in the study, including 18 young, healthy adults (mean age 23.3 years, range 19–28, three left-handed, nine females), 19 healthy elderly adults (mean age 69.0 years, range 62–78, one left-handed, nine females) and 11 elderly patients with early-stage idiopathic Parkinson's disease (mean age 66.4 years, range 62–72 years, all right-handed, three females). Diagnosis of idiopathic PD was confirmed by thorough clinical investigation, asymmetric dopamine transporter reduction in [123I]-FP-CIT single photon emission computed tomography (SPECT) and a positive clinical response to the dopamine precursor L-dopa. Asymmetric hyperechogenicity of the SN as assessed by brain parenchyma sonography was used as a complementary tool to further support diagnosis (Becker et al., 1995Go; Walter et al., 2003Go). At the time of participation, all patients had mild, lateralized disease without relevant disability (Hoehn and Yahr stage I), and carried out button press responses with their unaffected side (see later). All patients had been unmedicated for at least 48 h before participation (three patients had previously used L-dopa or a dopamine agonist for no longer than 3 months; all others had never been medicated). All participants gave written informed consent to participate in accordance with the Declaration of Helsinki, and the study was approved by the ethics committee of the University of Magdeburg, Faculty of Medicine.

Experimental paradigm
The experimental paradigm has previously been shown to allow a dissociation of reward anticipation and outcome (Wittmann et al., 2005Go). This dissociation was achieved by first presenting a cue picture that predicted a potential reward—or the absence of a reward—in a following simple arithmetic task. Reward outcome was then instrumental upon the response in this arithmetic task rather than the response to the cue itself (Kirsch et al., 2003Go; Wittmann et al., 2005Go). Before entering the scanner, participants were given a short demonstration of the task and completed a practice version lasting 3.5 min, which was already rewarded. This practice session was intended to reduce learning effects during functional data acquisition and thereby lead to a switching of reward responses from the moment of reward receipt to the time of reward anticipation (Knutson et al., 2001Go; Wittmann et al., 2005Go). Furthermore, the reaction times of the subjects obtained from the practice session were used to define individual response deadlines (see later). Once in the scanner, anatomical and functional scans were collected. Participants engaged in two 8-min sessions of the reward task.

Each of the two rewarded sessions consisted of 60 trials lasting 4.6–8.6 s (Fig. 1). During each reward trial, participants saw a grey-scale cue picture (Rossion and Pourtois, 2004Go) for 1500 ms, responded to it with a button press (index or middle finger) indicating whether they expected a reward or not, waited a variable interval (delay, 500–4500 ms) and then responded to a target number (target, 100 ms) with a button press. 1000 ms after the presentation of the target, a visual feedback (1500 ms) was given. The intertrial interval was jittered from 500 to 4500 ms independently of the jitter between the cue picture and the target number, thus leading to a temporal decorrelation of reward anticipation and reward outcome. The trial sequence and temporal jitter had been optimized for a maximally efficient estimation of the hemodynamic response function (HRF) to the different trial types (Hinrichs et al., 2000Go).


Figure 1
View larger version (10K):
[in this window]
[in a new window]
[Download PowerPoint slide]
 
Fig. 1 Trial structure of the reward paradigm, exemplarily shown for a reward trial. On neutral trials, a question mark appeared instead of the green or red arrow.

 

Figure 2
View larger version (65K):
[in this window]
[in a new window]
[Download PowerPoint slide]
 
Fig. 2 Neural correlates of reward anticipation and reward outcome in young, healthy subjects. Top: reward anticipation was associated with increased activation of the ventral striatum (left panel) and a midbrain region encompassing the VTA and the medial SN (right panel). Bottom: reward outcome was associated with activation of a large cluster encompassing portions of the anterior cingulate and the medial prefrontal cortex. All coordinates are given in Talairach space. Clusters of activation are shown at P < 0.001, uncorrected, with an extent threshold of k = 5 adjacent voxels.

 
On rewarded trials, 0.50 {euro} reward feedback was represented by a green arrow pointing upward, and loss of 0.20 {euro} was represented by a red arrow pointing downward. On non-rewarded trials, a question mark was shown regardless of outcome. Approximately half of the participants (9 young, 9 elderly, 8 patients) were told that they could gain money in the reaction time task following a picture depicting a living thing or part of a living thing (animal, plant, fruit, vegetable or human body part), the other half rewarded in trials following the presentation of a man-made object. Each category constituted half of the cues.

The number comparison task (Pappata et al., 2002Go) required participants to decide whether the target number (1, 4, 6 or 9) was larger or smaller than 5. They responded as quickly as possible by a button press with their index or middle finger. Whenever participants responded incorrectly or too slowly for the response deadline in the rewarded trials, a negative feedback was given, otherwise they received a positive feedback. The response deadline was adjusted individually based on reaction times in the immediately preceding session (the training session outside the scanner for the first session) to attain a correct response rate of ~80%, thereby leading to an 80% contingency in rewarded trials. In unrewarded trials, contingency was 100%, as neutral cues were never followed by a rewarded outcome in the number comparison task.

The times of occurrence of target buttons as well as numbers were counterbalanced for each session. To reduce confounding effects of PD-related impairment of motor function on behaviour and fMRI activations, all patients responded with their unaffected hand (as assessed by clinical examination and SPECT), and response hands were counterbalanced for young and elderly healthy controls, so that half of the participants responded with their dominant or non-dominant hand, respectively.

MRI acquisition
Two sessions of 240 T2*-weighted echo-planar images (EPIs) were acquired on a GE Medical Systems Signa 1.5 T MRI scanner at a TR of 2 s and a TE of 35 ms. Images consisted of 23 axial slices [64 x 64, voxel size = 3.13 x 3.13 x 6 mm3 (slice thickness = 5 mm with 1 mm gap)] and were acquired in an interleaved manner (1 to 23 in steps of 2, 2 to 22 in steps of 2, from bottom to top). Prior to data collection of each session, six EPI volumes were acquired to allow for magnetic field stabilization; these volumes were discarded from the analysis.

Data processing and analysis
Data analysis was performed using Statistical Parametric Mapping (SPM2, Wellcome Department of Imaging Neuroscience, Institute of Neurology, London, UK). EPI images were corrected for acquisition delay, realigned to the first image of the session, normalized (voxel size: 3 x 3 x 3 mm3) into a common reference frame (Montreal Neurological Institute, MNI) and smoothed using a Gaussian kernel of 8 x 8 x 8 mm3. A high-pass filter with a cut-off of 128 s was applied to the data.

Statistical analysis was carried out using a two-stage mixed effects model. In the first stage, the hemodynamic response was modelled by convolving a delta function at stimulus onset with a canonical HRF (Friston et al., 1998Go). The resulting time courses were downsampled for each scan to form covariates of a general linear model (GLM). The model included separate covariates for each of the conditions of interest (reward-predicting cues, neutral cues, feedback to correct and false responses to reward-predicting and neutral cues, respectively). The six rigid-body movement parameters determined from realignment were included in the GLM as covariates of no interest. In the second stage of the model, contrasts of the parameter estimates for each covariate were submitted to a random-effects analysis, with each participant being treated as a random effect. Specifically, one-sample t-tests were computed over images of each contrast of interest (anticipate reward vs. anticipate neutral outcome; positive reward feedback versus neutral feedback to a correct response in the non-rewarded condition) to test overall effects of reward anticipation and reward outcome in the three subject groups. To test for between-group differences, a one-way analysis of variance (ANOVA) was computed over the same contrast images for the three groups, followed by post hoc t-tests (young versus elderly adults and patients; healthy elderly adults versus patients), using the ANOVA results as an inclusive mask, thresholded at 0.05 (uncorrected). The a priori statistical threshold was set to P = 0.001 (uncorrected) for all comparisons, with an extent threshold of five adjacent voxels. For anatomical localization all coordinates were transformed into a common stereotactic reference frame (Talairach and Tournoux, 1988Go).

To investigate the relationship between the response in the NAcc during reward anticipation versus outcome and the behavioural benefit in the rewarded relative to the neutral condition, we computed the relative reaction time (RT) advantages [(RTno_reward – RTreward)/RTno_reward] for all subjects, separately for responses to cues and to target numbers. Pearson's correlation coefficients were computed between the thus obtained reaction time advantages and the differences of the fitted and adjusted responses in the NAcc during reward anticipation and outcome, respectively (Fig. 3B). Since we hypothesized that reaction time advantages would correlate positively with ventral striatal activation during reward anticipation rather than reward outcome, the significance level for the correlations was set to P = 0.05, one-tailed.


Figure 3
View larger version (28K):
[in this window]
[in a new window]
[Download PowerPoint slide]
 
Fig. 3 Age-related alterations of brain responses to reward anticipation and reward outcome. (A) Activation of the ventral striatum during reward anticipation (reward cues vs. neutral cues) was significantly higher in the young relative to the healthy elderly and to Parkinson's patients (top). A reverse pattern was observed during reward outcome (positive feedback versus neutral feedback) (bottom). Y coordinates in top and middle panel depict the fitted and adjusted response at the denoted peak voxels. See Fig. 4 for more legends. (B) The response difference in the ventral striatum (reward anticipation—outcome) was significantly correlated with the reaction time advantage for responses to target numbers, but not to cues. X coordinate denotes differences of the fitted responses for reward anticipation versus outcome, y coordinate denotes composite ranks of reaction time advantages. Fitted regression lines and 95% confidence intervals of the mean are shown. **: P < 0.001.

 

Figure 4
View larger version (44K):
[in this window]
[in a new window]
[Download PowerPoint slide]
 
Fig. 4 Increased response to reward outcome in the anterior cingulate/medial PFC (left panel) and in the right midbrain (right panel) in Parkinson's patients relative to healthy elderly subjects. See Fig. 2 for more legends.

 
Functional connectivity analysis
To investigate the effects of healthy ageing and Parkinson's disease on the neural circuitries between the ventral striatum, the midbrain and the anterior cingulate/medial PFC, functional connectivity analyses were performed. Guided by our results suggesting a right lateralization of the reward anticipation and outcome effects, we selected the right NAcc, a right medial midbrain region (containing the VTA and the right medial SN) and the right rostral anterior cingulate as seed regions. Spheres (radius = 6 mm; containing up to 33 super-threshold voxels) were centered on the individual local maxima of activation within the right NAcc and anterior cingulate, respectively, for each subject; another sphere (radius = 5 mm; containing up to 19 voxels) was centred on the suprathreshold voxel closest to [x y z] = [6 –18 –15] with the lowest z value being –24. The seed voxels belonged to different clusters of activation in all subjects. Representative volumes of interest (VOIs) are depicted in Fig. 5A. The first eigenvariate time series from these VOIs were extracted and adjusted for the effects of interest (Menon and Levitin, 2005Go). Pearson's correlation coefficients of the resulting time courses in the three VOIs were computed for all subjects. To allow further statistical testing, Fisher's z-transform, an inverse hyperbolic tangent transform was applied to the correlation coefficients to make them approach normal distribution (Fisher, 1921Go). Whenever the correlation between the time courses of two regions was significantly different from 0 across the entire cohort, between-group comparisons were carried out by computing one-way ANOVAs, followed by post hoc t-tests when significant effects of subject group were found. The thusly obtained connectivity measures were also submitted to correlation analyses with the overall reaction time advantages for the cue and target responses, as described above for the response differences.


Figure 5
View larger version (25K):
[in this window]
[in a new window]
[Download PowerPoint slide]
 
Fig. 5 Effects of healthy ageing and Parkinson's disease on midbrain-striatal functional connectivity. (A) Representative VOIs in the right nucleus accumbens (top), the right medial midbrain/VTA (middle) and the anterior cingulate (bottom). (B) Functional connectivity of the ventral striatum with the midbrain (top), of the ventral striatum and the anterior cingulate (middle) and of the midbrain and the anterior cingulate (bottom) in young subjects, healthy elderly subjects and patients (Fisher-z-transformed correlation coefficients). Mean values ± standard error are shown. Asterisk denotes a significant between-group difference in NAcc-VTA functional connectivity for patients relative to young subjects (P < 0.01). (C) Functional connectivity of the midbrain and ventral striatum was positively correlated with the reaction time advantages for responses to cues and target numbers, respectively. X coordinate denotes Fisher-z-transformed correlation coefficients of the time courses in the VOIs, y coordinate denotes composite ranks of reaction time advantages. Fitted regression lines and 95% confidence intervals of the mean are shown. *: P < 0.01; (*): P < 0.1.

 

    Results
 Top
 Summary
 Introduction
 Material and methods
 Results
 Discussion
 Conclusions
 References
 
Behavioural results
Table 1 displays demographic data and behavioural results for the three subject groups (young, elderly, PD patients). All participants correctly recognized the cues signalling rewarded or neutral trials, with the recognition rate being highest in young subjects [main effect of subject group: F(2,45) = 5.34, P = 0.008; ANOVA for repeated measures (per cent correct responses to reward cues versus neutral cues) with subject group as between-subjects factor]. Post hoc t-tests revealed that recognition of reward-predicting cues was slightly lower in patients relative to young subjects [t(27) = 2.57, P = 0.016], and recognition of neutral cues was slightly lower in the healthy elderly relative to the young [t(35) = 2.40, P = 0.022]. No significant differences were observed in a direct comparison of recognition rates for healthy elderly subjects and patients. Young subjects had shorter reaction times (RTs) to both reward-predicting and neutral cues than elderly subjects or patients, but RTs to reward-predicting cues were shorter than for neutral cues in all subject groups [main effect of reward: F(2,45) = 6.61, P = 0.014; main effect of subject group: F(2,45) = 11.23, P < 0.001; no interaction (P = 0.39); one-way ANOVA for repeated measures (RT reward cue versus RT neutral cue) with subject group as between-subjects factor].


View this table:
[in this window]
[in a new window]

 
Table 1 Demographic and behavioural data of young healthy subjects, elderly healthy subjects and Parkinson's patients

 
The average correct response rate to the target cue was higher in rewarded as compared with non-rewarded trials, but there was no difference in response accuracy between the groups, reflecting that individual response timeouts were correctly set by the experimenter [main effect of reward: F(2,45) = 12.89, P = 0.001; no main effect of subject group or interaction (all P > 0.17); ANOVA for repeated measures (per cent correct responses to rewarded vs. non-rewarded trials) with subject group as between-subjects factor]. Reaction times to the target numbers were significantly shorter in rewarded trials than in non-rewarded trials across the entire cohort, with young subjects showing the largest reaction time advantage [main effect of reward: F(2,45) = 17.17, P < 0.001; interaction reward x subject group: F(2,45) = 5.46, P = 0.008; the main effect of subject group approached significance [F(2,45) = 2.94, P = 0.063); one-way ANOVA for repeated measures (RT rewarded trial versus RT non-rewarded trial) with subject group as between-subjects factor]. Post hoc t-tests comparing reaction times for rewarded and neutral trials within the three groups revealed significant reaction time improvements for rewarded trials only in young healthy subjects [reward anticipation: t(17) = 5.26 P < 0.0001; reward outcome: t(17) = 5.76, P < 0.0001], but not in either healthy elderly subjects or patients (all P > 0.210).

Neural correlates of reward processing in young subjects
As expected, the reward anticipation contrast which compared reward predicting cues with neutral cues revealed significant activations (P < 0.001, k = 5 voxels) of several brain regions known to be activated during reward anticipation, including large portions of the dorsal and ventral striatum (bilateral putamen, right caudate, bilateral NAcc), a midbrain region encompassing the VTA and the right SN (Fig. 2, top), the bilateral insula, portions of the medial PFC and the anterior cingulate and the thalamus. Also as expected, reward outcome (reward versus neutral feedback) was not associated with activation of the striatum or midbrain in young subjects. On the other hand, portions of the medial PFC and anterior cingulate were also activated during positive reward outcome in young subjects (Fig. 2, bottom).

Effects of normal ageing and Parkinson's disease on reward-related fMRI activation
Unlike the young, the healthy elderly showed no activation of the ventral striatum and midbrain during reward anticipation. A one-sample t-test directed at the neural correlates of reward anticipation in elderly subjects revealed a cluster of activation in the thalamus and a smaller cluster in the right cerebellum at P < 0.001 (at P < 0.005 additional clusters were observed in the left prefrontal cortex, right precuneus, left amygdala and bilateral dorsal, but not ventral striatum). In contrast to their lack of activation at the time of reward anticipation, elderly subjects showed a robust activation of the ventral striatum during reward outcome (reward feedback versus neutral feedback), as revealed by a one-sample t-test.

The pattern of ventral striatal activation during reward anticipation versus outcome was essentially similar in patients and in the healthy elderly. While no ventral striatal activation was observed during reward anticipation, the nucleus accumbens was activated bilaterally during reward outcome, i.e. during presentation of the reward feedback image.

To test for the between-group differences, we first computed a one-way ANOVA over the contrast images for reward anticipation and outcome, respectively, followed by post hoc two-sample t-tests, masked for the ANOVA contrasts. The ANOVA contrasts revealed robust between-group differences in the bilateral ventral striatum during both reward anticipation and outcome. A two-sample t-test comparing the brain responses to reward anticipation (reward cues versus neutral cues) in young subjects and healthy elderly subjects revealed significantly higher activations (P < 0.001, k = 5 voxels) of the ventral and dorsal striatum in young relative to elderly subjects (Fig. 3A, top; Table 2). In a t-test statistic of the reward anticipation contrasts of young subjects and patients we observed that patients, similar to the healthy elderly, exhibited a similarly reduced reward anticipation response in the ventral striatum (Fig. 3A, top). There were no significant activation differences between patients and healthy elderly subjects during reward anticipation.


View this table:
[in this window]
[in a new window]

 
Table 2 Brain regions that showed higher activations for young relative to elderly subjects during reward anticipation

 
When we directly compared the reward outcome contrasts in young versus healthy elderly subjects and patients, we noted significantly higher activation of several brain regions, including the ventral and dorsal striatum and the insula, in the healthy elderly relative to young subjects (Fig. 3A, bottom; Table 3). Like the healthy elderly, patients also showed significantly stronger activation of the ventral striatum during positive reward feedback when compared with young subjects (Fig. 3A, bottom).


View this table:
[in this window]
[in a new window]

 
Table 3 Brain regions that showed higher activations for elderly relative to young subjects during reward outcome (positive reward versus neutral outcome)

 
Relatively to the healthy elderly subjects, patients showed clusters of relatively stronger activation in the medial prefrontal cortex/anterior cingulate and also in a midbrain region encompassing the right SN (two-sample t-test comparison; Fig. 4; Table 4). Because of the unequal gender distribution in the healthy elderly and patients, an additional t-test statistic was computed between the patients and a subgroup of the healthy elderly cohort (N = 15, 5 females, mean age = 68.3 years, the largest possible subgroup allowing for similar mean age and gender distribution), showing essentially the same differences as a comparison of the entire cohorts.


View this table:
[in this window]
[in a new window]

 
Table 4 Brain regions that showed higher activations for patients relative to healthy elderly subjects during reward outcome (positive reward versus neutral outcome)

 
Because the response accuracy to reward-predicting cues was slightly, but significantly lower in both patients and healthy elderly, analysis of covariance (ANCOVA) contrasts including the response accuracy to the reward-predicting and neutral cues as covariates of no interest were computed across the entire cohorts. Including these covariates in our model had no notable influence on any of the observed between-group differences during reward anticipation and outcome; most importantly, the observed lack of a response shift from reward outcome to anticipation in the elderly and patients was still observed when controlling for response accuracy.

To investigate the relationship of the responses in the NAcc during reward anticipation and outcome, Pearson's correlation coefficient was computed for the fitted responses to reward anticipation and outcome at the respective local maxima (Fig. 3). The responses showed a strong negative correlation across the entire cohort (r = –0.649, P < 0.0001), suggesting that subjects who showed a ventral striatal response during reward anticipation tended not to activate the striatum during reward outcome and vice versa. This negative correlation between anticipation and outcome is compatible with the view that the mesolimbic system computes a prediction error of reward, with the error at reward outcome being largest if the reward was not predicted. According to this view, the reduction of reward prediction responses should correlate with reduced reaction time advantage from reward anticipation. We assessed the behavioural reward benefit by computing the relative reaction time advantages for reward cues relative to neutral cues and for rewarded target numbers relative to non-rewarded target numbers, respectively. Pearson's correlation coefficients were computed for these reaction time measures and the hemodynamic response differences (fitted response to reward anticipation – fitted response to reward outcome, at their respective local maxima). There was a positive, but non-significant correlation (r = 0.123, P = 0.202) between the ventral striatal response difference and the RT advantage to the reward cues. The reward-related reaction time advantage in the response to the target numbers showed a strong significant positive correlation with the striatal response difference, which was highly significant (r = 0.572, P < 0.001, one-tailed), suggesting that the mesolimbic shift of activation from reward outcome to anticipation is associated with a higher reward-related reaction time advantage in tasks upon which reward is instrumental (Fig. 3B, bottom).

Changes in functional connectivity related to ageing and Parkinson's disease
Figure 5B depicts the degrees of functional connectivity between the right nucleus accumbens and the medial midbrain (top) and between the right NAcc and the anterior cingulate/medial PFC (bottom) (Fisher-z-transformed correlation coefficients of the time courses in the VOIs, see Fig. 5A) in young and elderly healthy subjects and in the patients. Across the entire cohort, the functional connectivity of the ventral striatum and the midbrain was significantly positive [t(47) = 6.48, P < 0.001]. A one-way ANOVA over the connectivity values of the three groups revealed a significant effect of subject group [F(2,45) = 4.91, P = 0.012], and post hoc t-test statistics showed a reduction of functional connectivity in patients relative to young subjects [t(27) = 3.12, P = 0.004], but no other significant between-group differences (all P > 0.098] (Fig. 5B, top).

To test whether the apparent reduction of midbrain-striatal functional connectivity in the patients was related to reward-related reaction time advantages, Pearson's correlation coefficients were computed for the Fisher-z-transformed correlation coefficients of the time courses in the midbrain and ventral striatum and the relative reaction time advantages to the reward cues and to the target numbers (see earlier). There was a positive correlation between the functional coupling of the VTA and the NAcc and the reaction time advantage to reward-predicting cues that approached significance (r = 0.228, P = 0.059) (Fig. 5C, top). The reaction time advantage to the target numbers was also positively correlated with the functional connectivity of the VTA and the NAcc (r = 0.337, P = 0.010) (Fig. 5C, bottom). In a partial correlation analysis controlling for the mesolimbic response difference during reward anticipation versus outcome, the correlation of the functional connectivity between the midbrain and ventral striatum with the reaction time advantage to target numbers remained positive, but failed to reach significance at P < 0.05 (r = 0.167, P = 0.267).

The functional connectivity between the NAcc and the anterior cingulate was significantly positive in our study cohort [t(47) = 9.61, P < 0.001], but there were no between-group differences in functional coupling between these brain structures [F(2,45) = 0.608, P = 0.512] (Fig. 5B, middle). There was also no correlation of the functional connectivity between the NAcc and the anterior cingulate and the reward-related reaction time advantages (all P > 0.274). We further observed a weak (mean r = 0.13), but significant [t(47) = 5.49, P < 0.001] level of functional connectivity between the midbrain/VTA and the anterior cingulate (Fig. 5B, bottom) which did also not show any between-group differences [F(2,45) = 0.301, P = 0.742]. Despite the lack of between-group differences, the functional connectivity of the midbrain with the anterior cingulate was positively correlated with the reaction time advantages for cues (r = 0.293, P = 0.022) and for target numbers (r = 0.352, P = 0.007).


    Discussion
 Top
 Summary
 Introduction
 Material and methods
 Results
 Discussion
 Conclusions
 References
 
In young adults, pictures of object drawings that predicted monetary reward in 75% of trials, but a (smaller) monetary loss in 25% of trials, were associated with stronger fMRI activity in the ventral striatum and in the midbrain than drawings that predicted the absence of reward-related feedback. As expected from previous studies, this reward prediction response was not followed by a mesolimbic response when the predicted reward was signalled via a positive feedback. Healthy elderly subjects and patients showed the opposite pattern: While no ventral striatal reward prediction responses were observed, the NAcc responded reliably to the positive reward feedback itself, suggesting that elderly subjects made positive prediction errors of reward. This finding makes the possibility that prediction error processing was impaired in the healthy elderly and patients very unlikely, but instead suggests alterations in the mesolimbic prediction of future rewards.

Mesolimbic reward prediction error processing in ageing and Parkinson's disease
The impaired shift of the mesolimbic response from reward outcome to anticipation in the healthy elderly and patients suggests an age-related impairment of reward prediction. It seems unlikely that this impairment was due to a poor performance in the number comparison task. All groups performed similarly on this task and hence the gain probability was comparable across groups. Deficits in cue processing are also unlikely to have caused the impairment as the observed pattern was robust even after covarying out the recognition rates for cues. Finally, an age-related delay of the BOLD response is also unlikely to explain this finding, as the onsets of reward anticipation and outcome were temporally decorrelated, and, moreover, age-related changes in neurovascular coupling have been associated with an earlier rather than later peak of the BOLD response (Huettel et al., 2001Go). A more plausible explanation for the lack of a mesolimbic reward prediction response might be that older adults and PD patients have underestimated the expected value of predicted rewards—which would be compatible with their known tendency to overestimate aversive outcomes (Frank et al., 2004Go). Expected values are the summed products of the values of possible outcome times their probabilities (Knutson et al., 2005Go). As reward trials had a 25% risk of losing a small amount of money, accurate learning of expected values was required for correct reward prediction. Overestimating the probability of aversive outcomes (losing money) could have led to an underestimation of expected values in reward trials.

Values and probabilities of reward outcomes are coded in a medial prefrontal-mesolimbic network (Knutson et al., 2005Go) and a deficit in learning expected values might either be a result of age-related deficiency in dopamine signalling, or medial prefrontal dysfunction or possibly a combination of both factors. One explanation for the reduced ability of elderly people to accurately estimate expected values might be a dopamine-dependent decrease of signal-to-noise ratio in the mesolimbic system, as predicted by a computational model of paired-associate learning under age-related DA deficiency (Bäckman et al., 2006Go; Li et al., 2006Go). This explanation is supported by the previously reported age-related pre- and post-synaptic attenuation of dopamine signaling (Volkow et al., 1998aGo, bGo; Bäckman et al., 2000Go; Kaasinen and Rinne, 2002Go). Our findings are compatible with the possibility of a medial prefrontal dysfunction. The older adults exhibited reliable activation of the medial PFC during reward outcome only, while young subjects showed medial PFC activation during both reward anticipation and outcome. As the medial PFC plays a role in computing the probability component of the expected value (Knutson et al., 2005Go), age-related structural or functional alterations in this region might also contribute to the inability of elderly people to accurately predict rewards. Compatible with this view, normal ageing has been associated with grey matter reductions in the prefrontal and temporal cortices, including the medial PFC (Tisserand et al., 2004Go; Gong et al., 2005Go). Interestingly, the medial PFC/anterior cingulate cortex (ACC) showed an even stronger activation during reward outcome in the patients as compared to the healthy elderly. Increased activity in the ACC during an attention task has been related to reduced processing efficiency under conditions of relative dopamine deficiency (Blasi et al., 2005Go) and a similar mechanism might contribute to the increased ACC activation in the patients. However, reaction times in the number comparison task, one potential measure of processing efficiency in our experiment, were not correlated with the ACC activation during reward outcome (data not shown), leaving the functional significance of increased ACC activation in PD patients uncertain.

The right medial midbrain also showed a stronger activation during reward outcome in the patients compared to the healthy elderly. We tentatively suggest that this might indicate a stronger prediction error in PD patients than in the healthy elderly. However, the observation of higher midbrain activation in patients must be interpreted with caution. Overactivation of brain regions affected by neurodegenerative disease has been observed previously, for example in pre-clinical Alzheimer's disease (Bookheimer et al., 2000Go), and the possibility thus remains that the increased activation of the midbrain in PD patients is also contaminated by disease-related dysregulation of neural circuits and therefore not a pure reflection of a cognitive problem.

Decreased midbrain-striatal connectivity in Parkinson's disease
In addition to the overall brain activity patterns related to reward anticipation and outcome we also investigated the functional connectivity between the medial midbrain and the ventral striatum. Young subjects showed a moderate degree of functional connectivity between these brain areas similar to that observed previously (Menon and Levitin, 2005Go). While functional coupling of the VTA and the NAcc was not significantly reduced in the healthy elderly, it showed a pronounced, significant, reduction in PD patients. This finding is compatible with the almost exclusively pre-synaptic degeneration of the dopamine system in Parkinson's disease as opposed to age-related changes, which—apart from being far less drastic in nature—affect both the pre- and post-synaptic elements of DA neurotransmission to a similar degree (Volkow et al., 1998bGo) and indicates qualitative pathophysiological differences between healthy elderly and PD patients. Notably, there was a trend for a positive correlation of the mesolimbic functional connectivity [NAcc-VTA] and the reaction times to reward cues, not only to target numbers. The relationship between dopaminergic neurotransmission and functional connectivity within dopaminergic circuitry is complex (Ruskin et al., 1999Go; Brown et al., 2001Go; Rowe et al., 2002Go; Williams et al., 2002Go; Honey et al., 2003Go; Hutchison et al., 2004Go) and depends on the balance between D1 and D2/D3 stimulation (Rahman et al., 2001Go). It is therefore not clear whether reduced functional connectivity in our study is directly related to reduced dopaminergic neurotransmission or possibly related to compensatory mechanisms observed in early stages of the disease (Cropley et al., 2006Go).

The observation that patients showed additional functional alterations in reward cue processing qualitatively different from those observed in the elderly is generally in line with a recent electrophysiological study on reward-motivated probabilistic classification learning (Mattox et al., 2006), in which PD patients performed more poorly than healthy elderly subjects. In that study, performance reduction was related to a reduced stimulus-preceding anticipatory negative slow wave in PD patients. Whether reduced anticipatory slow waves and reduced subcortical connectivity in PD patients are functionally related phenomena will need to be addressed using multimodal approaches.


    Conclusions
 Top
 Summary
 Introduction
 Material and methods
 Results
 Discussion
 Conclusions
 References
 
Taken together, our results show that both normal ageing and Parkinson's disease are associated with deficits in reward prediction despite preserved prediction error processing. They also demonstrate that alterations in reward processing in Parkinson's disease extend at least partly beyond accelerated ageing effects and suggest mesolimbic dysfunction as a promising neural candidate mechanism for further research on depression and cognitive deficits in Parkinsonian type disorders.

The lack of a consistent ventral striatal response to reward anticipation in the healthy elderly and patients might also have clinical implications. Dopaminergic circuitry has been shown to play a role in a variety of cognitive processes that are affected by age-related decline, including attention (Fan et al., 2003Go; Blasi et al., 2005Go), working memory (Mattay et al., 2002Go; Aalto et al., 2005Go) and episodic memory (Knecht et al., 2004Go; Lisman and Grace, 2005Go; Adcock et al., 2006Go; Schott et al., 2006Go). Although it is clear that dopamine makes regionally specific contributions to these cognitive processes, our results also raise the possibility that impaired predictions of positive outcomes and related motivational deficits might indirectly contribute to age-related cognitive decline.


    Acknowledgements
 
This work was supported by the Deutsche Forschungsgemeinschaft (KFG 161-3), the Helmholtz-Gemeinschaft (VH-VI 125) and the state of Saxony-Anhalt (L.N., B.H.S.). We thank all participants for making this study possible. We also thank Michael Scholz for help with the stimulus timing, Sandra Düzel and Sabine Lindquist for help with recruiting participants, Kerstin Möhring and Ilona Wiedenhöft for assistance with MRI acquisition and two anonymous reviewers for their helpful comments on an earlier version of the manuscript. Funding to pay the Open Access publication charges for this article was provided by the State of Saxony-Anhalt.


    References
 Top
 Summary
 Introduction
 Material and methods
 Results
 Discussion
 Conclusions
 References
 
Aalto S, Bruck A, Laine M, Nagren K, Rinne JO. Frontal and temporal dopamine release during working memory and attention tasks in healthy humans: a positron emission tomography study using the high-affinity dopamine D2 receptor ligand [11C]FLB 457. J Neurosci (2005) 25:2471–7.[Abstract/Free Full Text]

Adcock RA, Thangavel A, Whitfield-Gabrieli S, Knutson B, Gabrieli JD. Reward-motivated learning: mesolimbic activation precedes memory formation. Neuron (2006) 50:507–17.[CrossRef][Web of Science][Medline]

Bäckman L, Ginovart N, Dixon AR, Wahlin TBR, Wahlin SA, Halldin C, et al. Age-related cognitive deficits mediated by changes in the striatal dopamine system. Am J Psychiatry (2000) 157:635–7.[Abstract/Free Full Text]

Bäckman L, Nyberg L, Lindenberger U, Li SC, Farde L. The correlative triad among aging, dopamine, and cognition: current status and future prospects. Neurosci Biobehav Rev (2006) 30:791–807.[CrossRef][Web of Science][Medline]

Becker G, Seufert J, Bogdahn U, Reichmann H, Reiners K. Degeneration of substantia nigra in chronic Parkinson's disease visualized by transcranial color-coded real-time sonography. Neurology (1995) 45:182–4.[Abstract/Free Full Text]

Blasi G, Mattay VS, Bertolino A, Elvevag B, Callicott JH, Das S, et al. Effect of catechol-O-methyltransferase val158met genotype on attentional control. J Neurosci (2005) 25:5038–45.[Abstract/Free Full Text]

Bookheimer SY, Strojwas MH, Cohen MS, Saunders AM, Pericak-Vance MA, Mazziotta JC, et al. Patterns of brain activation in people at risk for Alzheimer's disease. N Engl J Med (2000) 343:450–6.[Abstract/Free Full Text]

Brown P, Oliviero A, Mazzone P, Insola A, Tonali P, Di Lazzaro V. Dopamine dependency of oscillations between subthalamic nucleus and pallidum in Parkinson's disease. J Neurosci (2001) 21:1033–8.[Abstract/Free Full Text]

Carbon M, Marie RM. Functional imaging of cognition in Parkinson's disease. Curr Opin Neurol (2003) 16:475–80.[CrossRef][Web of Science][Medline]

Cools R, Stefanova E, Barker R, Robbins T, Owen A. Dopaminergic modulation of high-level cognition in Parkinson's disease: the role of the prefrontal cortex revealed by PET. Brain (2002) 125:584–94.[Abstract/Free Full Text]

Critchley HD, Mathias CJ, Dolan RJ. Neural activity in the human brain relating to uncertainty and arousal during anticipation. Neuron (2001) 29:537–45.[CrossRef][Web of Science][Medline]

Cropley VL, Fujita M, Innis RB, Nathan PJ. Molecular imaging of the dopaminergic system and its association with human cognitive function. Biol Psychiatry (2006) 59:898–907.[CrossRef][Web of Science][Medline]

Erixon-Lindroth N, Farde L, Wahlin TB, Sovago J, Halldin C, Bäckman L. The role of the striatal dopamine transporter in cognitive aging. Psychiatry Res (2005) 138:1–12.[Web of Science][Medline]

Fan J, Fossella J, Sommer T, Wu Y, Posner MI. Mapping the genetic variation of executive attention onto brain activity. Proc Natl Acad Sci USA (2003) 100:7406–11.[Abstract/Free Full Text]

Fisher R. On the ‘‘probable error’’ of a coefficient of correlation deduced from a small sample. Metron (1921) 1:3–32.

Frank MJ, Seeberger LC, O'Reilly RC. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science (2004) 306:1940–3.[Abstract/Free Full Text]

Friston KJ, Fletcher P, Josephs O, Holmes A, Rugg MD, Turner R. Event-related fMRI: characterizing differential responses. Neuroimage (1998) 7:30–40.[CrossRef][Web of Science][Medline]

Gong QY, Sluming V, Mayes A, Keller S, Barrick T, Cezayirli E, et al. Voxel-based morphometry and stereology provide convergent evidence of the importance of medial prefrontal cortex for fluid intelligence in healthy adults. Neuroimage (2005) 25:1175–86.[CrossRef][Web of Science][Medline]

Hinrichs H, Scholz M, Tempelmann C, Woldorff MG, Dale AM, Heinze HJ. Deconvolution of event-related fMRI responses in fast-rate experimental designs: tracking amplitude variations. J Cogn Neurosci (2000) 12(Suppl 2):76–89.[CrossRef][Web of Science][Medline]

Honey GD, Suckling J, Zelaya F, Long C, Routledge C, Jackson S, et al. Dopaminergic drug effects on physiological connectivity in a human cortico-striato-thalamic system. Brain (2003) 126:1767–81.[Abstract/Free Full Text]

Huettel SA, Singerman JD, McCarthy G. The effects of aging upon the hemodynamic response measured by functional MRI. Neuroimage (2001) 13:161–75.[Web of Science][Medline]

Hutchison WD, Dostrovsky JO, Walters JR, Courtemanche R, Boraud T, Goldberg J, et al. Neuronal oscillations in the basal ganglia and movement disorders: evidence from whole animal and human recordings. J Neurosci (2004) 24:9240–3.[Free Full Text]

Ishihara L, Brayne C. A systematic review of depression and mental illness preceding Parkinson's disease. Acta Neurol Scand (2006) 113:211–20.[CrossRef][Web of Science][Medline]

Ito K, Nagano-Saito A, Kato T, Arahata Y, Nakamura A, Kawasumi Y, et al. Striatal and extrastriatal dysfunction in Parkinson's disease with dementia: a 6-[18F]fluoro-L-dopa PET study. Brain (2002) 125:1358–65.[Abstract/Free Full Text]

Kaasinen V, Rinne JO. Functional imaging studies of dopamine system and cognition in normal aging and Parkinson's disease. Neurosci Biobehav Rev (2002) 26:785–93.[CrossRef][Web of Science][Medline]

Kirsch P, Schienle A, Stark R, Sammer G, Blecker C, Walter B, et al. Anticipation of reward in a nonaversive differential conditioning paradigm and the brain reward system: an event-related fMRI study. Neuroimage (2003) 20:1086–95.[CrossRef][Web of Science][Medline]

Knecht S, Breitenstein C, Bushuven S, Wailke S, Kamping S, Floel A, et al. Levodopa: faster and better word learning in normal humans. Ann Neurol (2004) 56:20–6.[CrossRef][Web of Science][Medline]

Knutson B, Fong GW, Adams CM, Varner JL, Hommer D. Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport (2001) 12:3683–7.[CrossRef][Web of Science][Medline]

Knutson B, Cooper JC. Functional magnetic resonance imaging of reward prediction. Curr Opin Neurol (2005) 18:411–7.[Web of Science][Medline]

Knutson B, Taylor J, Kaufman M, Peterson R, Glover G. Distributed neural representation of expected value. J Neurosci (2005) 25:4806–12.[Abstract/Free Full Text]

Li SC, Brehmer Y, Shing YL, Werkle-Bergner M, Lindenberger U. Neuromodulation of associative and organizational plasticity across the life span: empirical evidence and neurocomputational modeling. Neurosci Biobehav Rev (2006) 30:775–790.[CrossRef][Web of Science][Medline]

Lisman JE, Grace AA. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron (2005) 46:703–13.[CrossRef][Web of Science][Medline]

Marschner A, Mell T, Wartenburger I, Villringer A, Reischies FM, Heekeren HR. Reward-based decision-making and aging. Brain Res Bull (2005) 67:382–90.[CrossRef][Web of Science][Medline]

Mattay VS, Tessitore A, Callicott JH, Bertolino A, Goldberg TE, Chase TN, et al. Dopaminergic modulation of cortical function in patients with Parkinson's disease. Ann Neurol (2002) 51:156–64.[CrossRef][Web of Science][Medline]

Mell T, Heekeren HR, Marschner A, Wartenburger I, Villringer A, Reischies FM. Effect of aging on stimulus-reward association learning. Neuropsychologia (2005) 43:554–63.[CrossRef][Web of Science][Medline]

Menon V, Levitin DJ. The rewards of music listening: response and physiological connectivity of the mesolimbic system. Neuroimage (2005) 28:175–84.[CrossRef][Web of Science][Medline]

O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ. Temporal difference models and reward-related learning in the human brain. Neuron (2003) 38:329–37.[CrossRef][Web of Science][Medline]

O'Doherty JP, Buchanan TW, Seymour B, Dolan RJ. Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum. Neuron (2006) 49:157–66.[CrossRef][Web of Science][Medline]

Pappata S, Dehaene S, Poline JB, Gregoire MC, Jobert A, Delforge J, et al. In vivo detection of striatal dopamine release during reward: a PET study with [(11)C]raclopride and a single dynamic scan approach. Neuroimage (2002) 16:1015–27.[CrossRef][Web of Science][Medline]

Rahman S, McBride WJ. D1-D2 dopamine receptor interaction within the nucleus accumbens mediates long-loop negative feedback to the ventral tegmental area (VTA). J Neurochem (2001) 77:1248–55.[CrossRef][Web of Science][Medline]

Rossion B, Pourtois G. Revisiting Snodgrass and Vanderwart's object pictorial set: the role of surface detail in basiclevel object recognition. Perception (2004) 33:217–36.[CrossRef][Web of Science][Medline]

Rowe J, Stephan KE, Friston K, Frackowiak R, Lees A, Passingham R. Attention to action in Parkinson's disease: impaired effective connectivity among frontal cortical regions. Brain (2002) 125:276–89.[Abstract/Free Full Text]

Ruskin DN, Bergstrom DA, Kaneoke Y, Patel BN, Twery MJ, Walters JR. Multisecond oscillations in firing rate in the basal ganglia: robust modulation by dopamine receptor activation and anesthesia. J Neurophysiol (1999) 81:2046–55.[Abstract/Free Full Text]

Schott BH, Seidenbecher CI, Fenker DB, Lauer CJ, Bunzeck N, Bernstein HG, et al. The dopaminergic midbrain participates in human episodic memory formation: evidence from genetic imaging. J Neurosci (2006) 26:1407–17.[Abstract/Free Full Text]

Schultz W. Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology. Curr Opin Neurobiol (2004) 14:139–47.[CrossRef][Web of Science][Medline]

Talairach J, Tournoux P. Co-planar stereotaxic atlas of the human brain (1988) New York: Thieme Medical.

Tisserand DJ, van Boxtel MP, Pruessner JC, Hofman P, Evans AC, Jolles J. A voxel-based morphometric study to determine individual differences in gray matter density associated with age and cognitive change over time. Cereb Cortex (2004) 14:966–73.[Abstract/Free Full Text]

Volkow ND, Gur RC, Wang GJ, Fowler JS, Moberg PJ, Ding YS, et al. Association between decline in brain dopamine activity with age and cognitive and motor impairment in healthy individuals. Am J Psychiatry (1998a) 155:344–9.[Abstract/Free Full Text]

Volkow ND, Wang GJ, Fowler JS, Ding YS, Gur RC, Gatley J, et al. Parallel loss of presynaptic and postsynaptic dopamine markers in normal aging. Ann Neurol (1998b) 44:143–7.[CrossRef][Web of Science][Medline]

Walter U, Niehaus L, Probst T, Benecke R, Meyer BU, Dressler D. Brain parenchyma sonography discriminates Parkinson's disease and atypical parkinsonian syndromes. Neurology (2003) 60:74–7.[Abstract/Free Full Text]

Williams D, Tijssen M, Van Bruggen G, Bosch A, Insola A, Di Lazzaro V, et al. Dopamine-dependent changes in the functional connectivity between basal ganglia and cerebral cortex in humans. Brain (2002) 125:1558–69.[Abstract/Free Full Text]

Wittmann BC, Schott BH, Guderian S, Frey JU, Heinze HJ, Duzel E. Reward-related FMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron (2005) 45:459–67.[CrossRef][Web of Science][Medline]

Yacubian J, Glascher J, Schroeder K, Sommer T, Braus DF, Büchel C. Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain. J Neurosci (2006) 26:9530–7.[Abstract/Free Full Text]


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?


This article has been cited by other articles:


Home page
J. Neurosci.Home page
B. H. Schott, L. Minuzzi, R. M. Krebs, D. Elmenhorst, M. Lang, O. H. Winz, C. I. Seidenbecher, H. H. Coenen, H.-J. Heinze, K. Zilles, et al.
Mesolimbic Functional Magnetic Resonance Imaging Activations during Reward Anticipation Correlate with Reward-Related Ventral Striatal Dopamine Release
J. Neurosci., December 24, 2008; 28(52): 14311 - 14319.
[Abstract] [Full Text] [PDF]


Home page
Cogn Affect Behav NeurosciHome page
K. M. COX, H. J. AIZENSTEIN, and J. A. FIEZ
Striatal outcome processing in healthy aging
Cogn Affect Behav Neurosci, September 1, 2008; 8(3): 304 - 317.
[Abstract] [PDF]


Home page
Exp. Biol. Med.Home page
S. Vale
Current Management of the Cognitive Dysfunction in Parkinson's Disease: How Far Have We Come?
Experimental Biology and Medicine, August 1, 2008; 233(8): 941 - 951.
[Abstract] [Full Text] [PDF]


Home page
BrainHome page
J. B. Rowe, L. Hughes, B. C. P. Ghosh, D. Eckstein, C. H. Williams-Gray, S. Fallon, R. A. Barker, and A. M. Owen
Parkinson's disease and dopaminergic therapy--differential effects on movement, reward and cognition
Brain, August 1, 2008; 131(8): 2094 - 2105.
[Abstract] [Full Text] [PDF]


Home page
ScienceHome page
E. Dahlin, A. S. Neely, A. Larsson, L. Backman, and L. Nyberg
Transfer of Learning After Updating Training Mediated by the Striatum
Science, June 13, 2008; 320(5882): 1510 - 1512.
[Abstract] [Full Text] [PDF]


Home page
Learn. Mem.Home page
J. A. Weiler, C. Bellebaum, and I. Daum
Aging affects acquisition and reversal of reward-based associative learning
Learn. Mem., April 1, 2008; 15(4): 190 - 197.
[Abstract] [Full Text] [PDF]


Home page
BrainHome page
C. Bellebaum, B. Koch, M. Schwarz, and I. Daum
Focal basal ganglia lesions are associated with impairments in reward-based reversal learning
Brain, March 1, 2008; 131(3): 829 - 841.
[Abstract] [Full Text] [PDF]


Home page
ScienceHome page
K. D'Ardenne, S. M. McClure, L. E. Nystrom, and J. D. Cohen
BOLD Responses Reflecting Dopaminergic Signals in the Human Ventral Tegmental Area
Science, February 29, 2008; 319(5867): 1264 - 1267.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrowOA All Versions of this Article:
130/9/2412    most recent
awm147v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (14)
Right arrow Disclaimer
Google Scholar
Right arrow Articles by Schott, B. H.
Right arrow Articles by Düzel, E.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Schott, B. H.
Right arrow Articles by Düzel, E.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?