Abstract
Background: Regional changes in corticostriatal transmission induced by phasic dopaminergic signals are an essential feature of the neural network responsible for instrumental reinforcement during discovery of an action. However, the timing of signals that are thought to contribute to the induction of corticostriatal plasticity is difficult to reconcile within the framework of behavioural reinforcement learning, because the reinforcer is normally delayed relative to the selection and execution of causally-related actions.
Objective: While recent studies have started to address the relevance of delayed reinforcement signals and their impact on corticostriatal processing, our objective was to establish a model in which a sensory reinforcer triggers appropriately delayed reinforcement signals relayed to the striatum via intact neuronal pathways and to investigate the effects on corticostriatal plasticity.
Methods: We measured corticostriatal plasticity with electrophysiological recordings using a light flash as a natural sensory reinforcer, and pharmacological manipulations were applied in an in vivo anesthetized rat model preparation.
Results: We demonstrate that the spiking of striatal neurons evoked by single-pulse stimulation of the motor cortex can be potentiated by a natural sensory reinforcer, operating through intact afferent pathways, with signal timing approximating that required for behavioural reinforcement. The pharmacological blockade of dopamine receptors attenuated the observed potentiation of corticostriatal neurotransmission.
Conclusion: This novel in vivo model of corticostriatal plasticity offers a behaviourally relevant framework to address the physiological, anatomical, cellular, and molecular bases of instrumental reinforcement learning.
Graphical Abstract
[http://dx.doi.org/10.1515/JBCPP.2000.11.4.305] [PMID: 11248944]
[PMID: 33977645]
[http://dx.doi.org/10.1016/j.nlm.2013.11.003] [PMID: 24231424]
[http://dx.doi.org/10.1038/nrn2022] [PMID: 17115078]
[http://dx.doi.org/10.1016/j.neuroscience.2011.07.060] [PMID: 21821101]
[http://dx.doi.org/10.1523/JNEUROSCI.1554-07.2007] [PMID: 17670959]
[http://dx.doi.org/10.1016/j.conb.2005.10.006] [PMID: 16271465]
[http://dx.doi.org/10.1371/journal.pbio.1002034] [PMID: 25562526]
[http://dx.doi.org/10.1016/j.brainresrev.2007.10.007] [PMID: 18055018]
[http://dx.doi.org/10.3389/fpsyg.2013.00907] [PMID: 24376428]
[http://dx.doi.org/10.1016/j.neuron.2010.11.022] [PMID: 21144997]
[http://dx.doi.org/10.1016/j.beproc.2012.07.007] [PMID: 22868172]
[http://dx.doi.org/10.7554/eLife.21886] [PMID: 28054919]
[http://dx.doi.org/10.1038/35092560] [PMID: 11544526]
[http://dx.doi.org/10.1146/annurev.psych.56.091103.070229] [PMID: 16318590]
[http://dx.doi.org/10.1016/j.bbr.2008.10.030] [PMID: 19026691]
[http://dx.doi.org/10.1016/j.tins.2007.03.001] [PMID: 17367873]
[http://dx.doi.org/10.1523/JNEUROSCI.4476-05.2005] [PMID: 16339023]
[PMID: 21423492]
[http://dx.doi.org/10.1523/JNEUROSCI.4402-07.2008] [PMID: 18322089]
[http://dx.doi.org/10.1126/science.1160575] [PMID: 18687967]
[http://dx.doi.org/10.1080/02724990042000010] [PMID: 11216300]
[http://dx.doi.org/10.3389/fncom.2018.00049] [PMID: 30018546]
[http://dx.doi.org/10.3389/fncir.2015.00085] [PMID: 26834568]
[http://dx.doi.org/10.1093/cercor/bhl152] [PMID: 17220510]
[http://dx.doi.org/10.1016/j.neuropharm.2011.12.027] [PMID: 22261383]
[http://dx.doi.org/10.1016/j.neuron.2017.02.029] [PMID: 28285820]
[http://dx.doi.org/10.1038/nature01476] [PMID: 12687000]
[http://dx.doi.org/10.1523/JNEUROSCI.3823-03.2004] [PMID: 14960596]
[http://dx.doi.org/10.1016/j.neuron.2014.08.033] [PMID: 25220811]
[http://dx.doi.org/10.1038/sj.npp.1300619] [PMID: 15549053]
[http://dx.doi.org/10.1126/science.1255514] [PMID: 25258080]
[http://dx.doi.org/10.1038/s41467-017-00394-x] [PMID: 28839128]
[http://dx.doi.org/10.3389/fnsyn.2010.00023] [PMID: 21423509]
[http://dx.doi.org/10.1111/ejn.13921] [PMID: 29603470]
[http://dx.doi.org/10.1038/s41467-022-28950-0] [PMID: 35277506]
[http://dx.doi.org/10.3389/fncir.2018.00053] [PMID: 30108488]
[http://dx.doi.org/10.1002/cne.10541] [PMID: 12561080]
[http://dx.doi.org/10.7554/eLife.19103] [PMID: 27892854]
[http://dx.doi.org/10.1016/j.neuron.2010.06.017] [PMID: 20670836]
[http://dx.doi.org/10.1152/jn.2001.85.2.960] [PMID: 11160526]
[http://dx.doi.org/10.1523/JNEUROSCI.4815-08.2009] [PMID: 19439610]
[http://dx.doi.org/10.1126/science.1107026] [PMID: 15746431]
[http://dx.doi.org/10.1038/s41467-021-24241-2] [PMID: 34183678]
[http://dx.doi.org/10.1002/cne.21202] [PMID: 17183537]
[http://dx.doi.org/10.1038/nn1113] [PMID: 12925855]
[http://dx.doi.org/10.1073/pnas.0408305102] [PMID: 15608059]
[http://dx.doi.org/10.1016/S0168-0102(03)00029-4] [PMID: 12725914]
[http://dx.doi.org/10.1016/S0306-4522(97)00179-6] [PMID: 9300404]
[http://dx.doi.org/10.1007/978-1-4899-2995-2]
[http://dx.doi.org/10.1523/JNEUROSCI.0247-09.2009] [PMID: 19403836]
[http://dx.doi.org/10.1146/annurev.ne.09.030186.002041] [PMID: 3085570]
[http://dx.doi.org/10.1016/j.tins.2005.06.006] [PMID: 15982753]
[http://dx.doi.org/10.1016/0006-8993(86)91593-3] [PMID: 3008920]
[http://dx.doi.org/10.1016/0306-4522(83)90138-0] [PMID: 6138732]
[http://dx.doi.org/10.1016/j.bbr.2008.10.034] [PMID: 19027797]
[http://dx.doi.org/10.1111/ejn.13964] [PMID: 29791051]
[http://dx.doi.org/10.1016/j.celrep.2018.02.016] [PMID: 29490273]
[http://dx.doi.org/10.1146/annurev-neuro-072116-031033] [PMID: 31018098]
[http://dx.doi.org/10.1016/S0301-0082(96)00042-1] [PMID: 9004351]
[http://dx.doi.org/10.1016/S0306-4522(98)00319-4] [PMID: 10362291]
[http://dx.doi.org/10.1016/0166-2236(90)90109-N] [PMID: 1695403]
[http://dx.doi.org/10.1523/JNEUROSCI.3486-06.2006] [PMID: 17167083]
[http://dx.doi.org/10.1016/j.neunet.2005.06.049] [PMID: 16153803]
[http://dx.doi.org/10.1016/j.tins.2006.12.003] [PMID: 17173981]
[http://dx.doi.org/10.7554/eLife.10032] [PMID: 26322384]
[http://dx.doi.org/10.1152/jn.1998.80.1.1] [PMID: 9658025]
[http://dx.doi.org/10.1016/S0165-0173(02)00181-9] [PMID: 12423763]
[http://dx.doi.org/10.1371/journal.pone.0006557] [PMID: 19675683]
[http://dx.doi.org/10.1113/JP270324] [PMID: 25873197]
[http://dx.doi.org/10.7554/eLife.13185] [PMID: 26920222]
[http://dx.doi.org/10.1113/jphysiol.2007.144501] [PMID: 17974593]
[http://dx.doi.org/10.1016/j.neuroscience.2009.03.015] [PMID: 19303912]
[http://dx.doi.org/10.1038/s41586-020-03166-8] [PMID: 33473213]
[http://dx.doi.org/10.1523/JNEUROSCI.2440-12.2012] [PMID: 22993438]
[http://dx.doi.org/10.1523/JNEUROSCI.5097-08.2009] [PMID: 19357282]
[http://dx.doi.org/10.1016/j.cub.2018.01.031] [PMID: 29429614]
[http://dx.doi.org/10.1523/JNEUROSCI.23-24-08506.2003] [PMID: 13679419]
[http://dx.doi.org/10.1152/jn.2001.85.1.117] [PMID: 11152712]
[http://dx.doi.org/10.1523/JNEUROSCI.21-17-06492.2001] [PMID: 11517238]
[http://dx.doi.org/10.1038/nn.2216] [PMID: 18953346]
[http://dx.doi.org/10.1038/srep16742] [PMID: 26572101]
[http://dx.doi.org/10.1038/s41593-018-0191-4] [PMID: 30038277]
[http://dx.doi.org/10.1098/rstb.2014.0210]
[http://dx.doi.org/10.1038/s41467-021-24696-3] [PMID: 34285209]
[http://dx.doi.org/10.1016/S1474-4422(09)70287-X] [PMID: 19909912]
[http://dx.doi.org/10.1097/YCO.0b013e328336661b] [PMID: 20051858]
[http://dx.doi.org/10.1523/JNEUROSCI.0041-12.2012] [PMID: 22933784]
[http://dx.doi.org/10.1016/j.tins.2010.02.002] [PMID: 20207024]