Abstract
Free full text
Phasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral Conditioning
Associated Data
Abstract
Natural rewards and drugs of abuse can alter dopamine signaling, and ventral tegmental area (VTA) dopaminergic neurons are known to fire action potentials tonically or phasically under different behavioral conditions. However, without technology to control specific neurons with appropriate temporal precision in freely behaving mammals, the causal role of these action potential patterns in driving behavioral changes has been unclear. We used optogenetic tools to selectively stimulate VTA dopaminergic neuron action potential firing in freely behaving mammals. We found that phasic activation of these neurons was sufficient to drive behavioral conditioning and elicited dopamine transients with magnitudes not achieved by longer, lower-frequency spiking. These results demonstrate that phasic dopaminergic activity is sufficient to mediate mammalian behavioral conditioning.
Dopaminergic (DA) neurons have been suggested to be involved in the cognitive and hedonic underpinnings of motivated behaviors (1–4). Changes in the firing pattern of DA neurons between low-frequency tonic activity and phasic bursts of action potentials could encode reward prediction errors and incentive salience (5). Consistent with the reward prediction-error hypothesis, DA neuron firing activity is depressed by aversive stimuli (6). However, it remains unclear whether DA neuron activation alone is sufficient to elicit reward-related behaviors. Lesion, electrical stimulation, and psychopharmacology studies have been important but have not allowed causal and temporally precise control of DA neurons in freely moving mammals; for example, electrical stimulation inevitably activates multiple classes of neurons within heterogeneous brain tissue, and pharmacological stimulation does not allow delivery of defined patterns of DA neuron spikes in vivo.
To control DA neurons selectively, we used a Cre-inducible adeno-associated virus (AAV) vector (7, 8) carrying the gene encoding the light-activated cation channel channelrhodopsin-2 (ChR2) in-frame fused to enhanced yellow fluorescent protein (ChR2-EYFP) (9–11). To ensure that there would be no substantial expression leak in nontargeted cell types, we designed the Cre-inducible AAV vector with a double-floxed inverted open reading frame (ORF), wherein the ChR2-EYFP sequence is present in the anti-sense orientation (Fig. 1A). Stereotactic delivery of this vector into the VTA of tyrosine hydroxylase (TH) internal ribosomal entry site (IRES)– Cre transgenic mice enables DA neuron-specific expression of ChR2-EYFP. Upon transduction, Cre-expressing TH cells invert the ChR2-EYFP ORF in irreversible fashion and thereby activate sustained ChR2-EYFP expression under the strong, constitutively active elongation factor 1a (EF-1α) promoter.
We validated the specificity and efficacy of this targeting strategy in vivo. In coronal VTA sections of transduced THIRES-Cre brains, ChR2-EYFP specifically co-localized with endogenous TH (Fig. 1B). Greater than 90% of TH-immunopositive cells were positive for ChR2-EYFP near virus injection sites, and more than 50% were positive overall, demonstrating highly efficacious transduction of the TH cells. Of ChR2-EYFP–expressing cells, 98.3 ± 0.5% were co-labeled by TH staining (Fig. 1C), demonstrating high specificity. Expression was stable and persistent for at least 2 months, and ChR2-EYFP–expressing neurons displayed robust projections; EYFP-positive fibers richly innervated local neurons in downstream nucleus accumbens (NAc) (Fig. 1D) (12).
To assess the potential for optogenetic control of transduced cells, we used whole-cell patch clamps to measure light-induced membrane currents in ChR2-expressing DA neurons (Fig. 2A). ChR2-EYFP–expressing cells in the VTA displayed typical electrophysiological properties of DA neurons with a mean resting membrane potential of −56.0 ± 1.8 mV and a mean membrane resistance of 372.3 ± 19.3 megohm (n = 10 cells), consistent with previously reported values for VTA DA neurons (13) and indicating that expression of ChR2 alone does not affect their basic physiology. Under blue light (473 nm) illumination, all patched cells exhibited prominent inward photocurrents (Fig. 2, B and C; n = 10 cells). Trains of light flashes drove action potential firing in ChR2-EYFP neurons; with use of low- and high-frequency light trains, we evoked tonic and phasic DA neuron firing, respectively (Fig. 2D). DA neurons typically do not maintain high-frequency spiking (14); 1- to 5-Hz light pulses drove long DA neuron spike trains reliably, whereas bursting at 20 Hz or greater for prolonged trains evoked action potentials in <50% of light pulses (Fig. 2E and fig. S1; bursts maintaining the >15-Hz spiking characteristic of phasic firing could be elicited simply by using higher-frequency light pulse trains). Optrode recording confirmed that optical stimulation of VTA DA neurons in vivo evoked broad spike waveforms consistent with extracellular waveforms for VTA DA neurons (6) (Fig. 2F and fig. S2).
We next tested the behavioral conditioning effects of phasic DA neuron activity via the conditioned place preference (CPP) paradigm (Fig. 3A and fig. S3), with use of phasic opto-genetic stimulation (15) of DA neurons as our conditioning stimuli (Fig. 3, B and C). As a control, we paired the opposite chamber with the same number of light pulses delivered instead at 1 Hz. Mice were subjected to 2 days of conditioning, and conditioned preference was determined by comparing time spent in each chamber of the apparatus. In the first round of experiments, mice received phasic (50-Hz optical stimulation) conditioning in one chamber on the first day of conditioning (day 2), and 1-Hz optical stimulation in the other chamber on the second day of conditioning (day 3); two cohorts of mice were used with the chamber-stimulation pairing reversed to control for spontaneous preference shifts (fig. S3). Mice developed a clear place preference for the chamber associated with phasic optical stimulation by several measures (Fig. 3, D to F; P < 0.001 by Student's t test; n = 13 mice), and both cohorts of mice exhibited this conditioned preference independent of chamber pairing (fig. S5).
We performed two classes of control experiments to validate the results. First, nontransgenic littermates (n = 9) were injected with Cre-dependent ChR2-EYFP AAV and subjected to the same stimulation paradigm as the experimental animals. Separately, THIRES-Cre transgenic mice (n = 9) were injected with Cre-dependent ChR2-EYFP AAV but received no optical stimulation during conditioning to further control for spontaneous preference shifts. Neither control group showed a significant CPP (Fig. 3E right, P > 0.5 by Student's t test). Furthermore, we did not find any significant changes in anxiety-related behaviors (Fig. 3G) or in locomotor activity (Fig. 3H) during preference tests and in open field tests (fig. S6).
Next, we tested whether the CPP effect observed was due to an appetitive effect from 50-Hz stimulation or to an aversive effect from 1-Hz stimulation. We compared the effect of each firing modality with no stimulation in two independent cohorts. Consistent with the previous CPP experiments (Fig. 3, E and F), the phasic cohort displayed significant place preference for the stimulation chamber after conditioning (Fig. 4, A and C), from 251 ± 28 s during pretest to 522 ± 63s during posttest (n = 7 mice; P < 0.05, Student's t test). However, the 1-Hz cohort (n = 6) showed no place aversion for the 1-Hz stimulation chamber (showing a trend toward place preference for 1 Hz instead; Fig. 4, B and C). We hypothesized that the CPP effect observed for the phasic cohort could be due to larger transient DA release triggered by the 50-Hz optical stimulation. We therefore used in vivo fast-scan cyclic voltammetry (FSCV) (16, 17) to detect DA transients. Maintaining the optical fiber in the VTA, we implanted a carbon fiber electrode for measuring DA signals in the NAc, one of the major targets of VTA DA projections (Fig. 1D). Despite sharing the same total illumination duration and number of light flashes (25 15-ms light flashes at 1 Hz or 50 Hz), the 50-Hz light train elicited larger DA transients (Fig. 4, D and E). Indeed, the mean peak DA transient concentrations in the NAc were measured at 75.9 ± 24.5 nM and 1.3 ± 0.8 nM, respectively, for the 50-Hz and 1-Hz stimuli (Fig. 4E); the former is similar to the magnitude of natural reward-triggered dopamine transients (16), whereas DA accumulation during chronic 1-Hz stimulation remained much lower (fig. S7; this level of DA could still theoretically contribute to behavioral changes).
Rodents learn to associate the effects of stimuli with their environment and subsequently display a conditioned place preference for that environment (18). Previous studies have demonstrated the important role of DA in the processing of salient signals (19) and goal-directed behaviors (20). However, it has been unclear whether other circuits and neurotransmitter systems are required at the same time (21) and whether specific patterns of activity in distinct neuron types are sufficient to effect place preference. To enable direct testing of the role of phasic DA neuron firing on behavioral conditioning, we developed a versatile Cre-inducible gene expression system to decouple the strength of transgene expression from cell type–specific promoters (which are often too weak to drive functional expression of opsins). By using this system, we selectively modulated DA neuron activity with defined stimulation patterns in the CPP paradigm and found that phasic stimulation sufficed to establish place preference in the absence of other reward. These results establish a causal role in behavioral conditioning for defined spiking modes in a specific cell type; of course, even a single cell type can release multiple neurotransmitters and neuromodulators (for example, VTA DA neurons primarily release DA but can also release other neurotransmitters such as glutamate) and will exert effects through multiple distinct downstream cell types. Indeed, the optogenetic approach, integrated with electro-physiological, behavioral, and electrochemical readout methods, opens the door to exploring the causal, temporally precise, and behaviorally relevant interactions of DA neurons with other neuromodulatory circuits (22–25), including monoaminergic and opioid circuits important in neuropsychiatric illnesses (26–28). In the process of identifying candidate interacting neuro-transmitter systems, downstream neural circuit effectors (29), and subcellular biochemical mechanisms on time scales appropriate to behavior and relevant circuit dynamics, it will be important to continue to leverage the specificity and temporal precision of optogenetic control (30).
Acknowledgments
We thank M. Wightman, P. Phillips, and the entire Deisseroth laboratory for their support. All reagents and protocols are freely distributed and supported by the authors (www.optogenetics.org); because these tools are not protected by patents, Stanford University has applied for a patent to ensure perpetual free distribution to the international academic nonprofit community. H.C.T. is supported by a Stanford Graduate Fellowship. F.Z. and G.D.S. are supported by NIH National Research Service award. A.R.A. is supported by the Fonds National de la Recherche Scientifique, NARSAD, and the Fondation Leon Fredericq. L.d.L. is supported by National Institute on Drug Abuse (NIDA), Defense Advanced Research Projects Agency, and NARSAD. K.D. is supported by NSF; National Institute of Mental Health; NIDA; and the McKnight, Coulter, Snyder, Albert Yu and Mary Bechmann, and Keck foundations.
References and Notes
Full text links
Read article at publisher's site: https://doi.org/10.1126/science.1168878
Read article for free, from open access legal sources, via Unpaywall: https://europepmc.org/articles/pmc5262197?pdf=render
Free to read at www.sciencemag.org
http://www.sciencemag.org/cgi/content/abstract/324/5930/1080
Subscription required at www.sciencemag.org
http://www.sciencemag.org/cgi/content/full/324/5930/1080
Subscription required at www.sciencemag.org
http://www.sciencemag.org/cgi/reprint/324/5930/1080.pdf
Citations & impact
Impact metrics
Citations of article over time
Alternative metrics
Article citations
Dopamine builds and reveals reward-associated latent behavioral attractors.
Nat Commun, 15(1):9825, 13 Nov 2024
Cited by: 0 articles | PMID: 39537606 | PMCID: PMC11561151
ONIX: a unified open-source platform for multimodal neural recording and perturbation during naturalistic behavior.
Nat Methods, 11 Nov 2024
Cited by: 0 articles | PMID: 39528678
Magnetoelectric nanodiscs enable wireless transgene-free neuromodulation.
Nat Nanotechnol, 11 Oct 2024
Cited by: 2 articles | PMID: 39394431
Overcoming off-target optical stimulation-evoked cortical activity in the mouse brain <i>in vivo</i>.
iScience, 27(11):111152, 15 Oct 2024
Cited by: 0 articles | PMID: 39524362
Dopamine neurons encode trial-by-trial subjective reward value in an auction-like task.
Nat Commun, 15(1):8138, 17 Sep 2024
Cited by: 0 articles | PMID: 39289338 | PMCID: PMC11408490
Go to all (746) article citations
Other citations
Data
Data behind the article
This data has been text mined from the article, or deposited into data resources.
BioStudies: supplemental material and supporting data
Similar Articles
To arrive at the top five similar articles we use a word-weighted algorithm to compare words from the Title and Abstract of each citation.
Optogenetic interrogation of dopaminergic modulation of the multiple phases of reward-seeking behavior.
J Neurosci, 31(30):10829-10835, 01 Jul 2011
Cited by: 229 articles | PMID: 21795535 | PMCID: PMC3171183
Glutamatergic Ventral Pallidal Neurons Modulate Activity of the Habenula-Tegmental Circuitry and Constrain Reward Seeking.
Biol Psychiatry, 83(12):1012-1023, 12 Jan 2018
Cited by: 78 articles | PMID: 29452828 | PMCID: PMC5972062
Tonic or Phasic Stimulation of Dopaminergic Projections to Prefrontal Cortex Causes Mice to Maintain or Deviate from Previously Learned Behavioral Strategies.
J Neurosci, 37(35):8315-8329, 24 Jul 2017
Cited by: 52 articles | PMID: 28739583 | PMCID: PMC5577850
Contributions of dopaminergic and non-dopaminergic neurons to VTA-stimulation induced neurovascular responses in brain reward circuits.
Neuroimage, 177:88-97, 30 Apr 2018
Cited by: 19 articles | PMID: 29723641
Funding
Funders who supported this work.
NIDA NIH HHS (1)
Grant ID: R01 DA021880
NIMH NIH HHS (1)
Grant ID: R01 MH087592
NINDS NIH HHS (2)
Grant ID: K99 NS065009
Grant ID: K99 NS065009-02