Kesner, R. P. & Churchwell, J. C. An analysis of rat prefrontal cortex in mediating executive function. Neurobiol. Learn. Mem. 96, 417–431 (2011).
Dalley, J. W., Cardinal, R. N. & Robbins, T. W. Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates. Neurosci. Biobehav. Rev. 28, 771–784 (2004).
Güntürkün, O. The avian ‘prefrontal cortex’ and cognition. Curr. Opin. Neurobiol. 15, 686–693 (2005).
Milner, B. Effects of different brain lesions on card sorting: the role of the frontal lobes. Arch. Neurol. 9, 90–100 (1963).
Izquierdo, A., Brigman, J. L., Radke, A. K., Rudebeck, P. H. & Holmes, A. The neural basis of reversal learning: an updated perspective. Neuroscience 345, 12–26 (2017).
Rescorla, R. & Wagner, A. in Classical Conditioning II: Current Research and Theory (eds Black, A. & Prokosy, W.) 64–99 (Appleton-Century-Crofts, 1972).
Sutton, R. S. & Barto, A. G. Reinforcement Learning: An Introduction (MIT Press, 2018).
Stuber, G. D. Neurocircuits for motivation. Science 382, 394–398 (2023).
Faustino, B., Oliveira, J. & Lopes, P. Diagnostic precision of the Wisconsin Card Sorting Test in assessing cognitive deficits in substance use disorders. Appl. Neuropsychol. Adult 28, 165–172 (2021).
Sinha, R. & Li, C. S. R. Imaging stress- and cue-induced drug and alcohol craving: association with relapse and clinical implications. Drug Alcohol Rev. 26, 25–31 (2007).
Kim, C., Johnson, N. F., Cilles, S. E. & Gold, B. T. Common and distinct mechanisms of cognitive flexibility in prefrontal cortex. J. Neurosci. 31, 4771–4779 (2011).
Ogg, M. C. et al. Locus coeruleus norepinephrine neurons facilitate orbitofrontal cortex remapping and behavioral flexibility. Cell Rep.44, 116687 (2025).
Namboodiri, V. M. K. et al. Relative salience signaling within a thalamo-orbitofrontal circuit governs learning rate. Curr. Biol. 31, 5176–5191 (2021).
Banerjee, A. et al. Value-guided remapping of sensory cortex by lateral orbitofrontal cortex. Nature 585, 245–250 (2020).
Laubach, M., Amarante, L. M., Swanson, K. & White, S. R. What, if anything, is rodent prefrontal cortex? eNeuro 5, ENEURO.0315-18.2018 (2018).
Bussey, T. J., Muir, J. L., Everitt, B. J. & Robbins, T. W. Triple dissociation of anterior cingulate, posterior cingulate, and medial frontal cortices on visual discrimination tasks using a touchscreen testing procedure for the rat. Behav. Neurosci. 111, 920–936 (1997).
Biró, S., Lasztóczi, B. & Klausberger, T. A visual two-choice rule-switch task for head-fixed mice. Front. Behav. Neurosci. 13, 119 (2019).
Rich, E. L. & Shapiro, M. L. Prelimbic/infralimbic inactivation impairs memory for multiple task switches, but not flexible selection of familiar tasks. J. Neurosci. 27, 4747–4755 (2007).
Oualian, C. & Gisquet-Verrier, P. The differential involvement of the prelimbic and infralimbic cortices in response conflict affects behavioral flexibility in rats trained in a new automated strategy-switching task. Learn. Mem. 17, 654–668 (2010).
Dutech, A., Coutureau, E. & Marchand, A. Reinforcement learning approaches to instrumental contingency degradation in rats. In Conférence Française de Neurosciences Computationnelles – NeuroComp 2010 (eds Fourcaud-Trocmé, N. et al.) Vol. 105, 36–44 (Journal of Physiology-Paris, 2010).
Ottenheimer, D. J., Hjort, M. M., Bowen, A. J., Steinmetz, N. A. & Stuber, G. D. A stable, distributed code for cue value in mouse cortex during reward learning. eLife 12, RP84604 (2023).
Otis, J. M. et al. Prefrontal cortex output circuits guide reward seeking through divergent cue encoding. Nature 543, 103–107 (2017).
Schultz, W. Dopamine reward prediction error coding. Dialogues Clin. Neurosci. 18, 23–32 (2016).
Hjort, M. Source data for ‘Hjort et al. Prefrontal to Ventral Tegmental Area Dynamics Drive Contingency Degradation’. figshare https://doi.org/10.6084/m9.figshare.31431814 (2026).
Chen, T.-W. et al. Ultra-sensitive fluorescent proteins for imaging neuronal activity. Nature 499, 295–300 (2013).
Hjort, M. et al. Microprisms enable enhanced throughput and resolution for longitudinal tracking of neuronal ensembles in deep brain structures. Neurophotonics 11, 033407 (2024).
Spellman, T., Svei, M., Kaminsky, J., Manzano-Nieves, G. & Liston, C. Prefrontal deep projection neurons enable cognitive flexibility via persistent feedback monitoring. Cell 184, 2750–2766 (2021).
Steinmetz, N. A., Zatka-Haas, P., Carandini, M. & Harris, K. D. Distributed coding of choice, action and engagement across the mouse brain. Nature 576, 266–273 (2019).
Packer, A. M., Russell, L. E., Dalgleish, H. W. P. & Häusser, M. Simultaneous all-optical manipulation and recording of neural circuit activity with cellular resolution in vivo. Nat. Methods 12, 140–146 (2015).
Marshel, J. H. et al. Cortical layer–specific critical dynamics triggering perception. Science 365, eaaw5202 (2019).
Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B. & Uchida, N. Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482, 85–88 (2012).
Gongwer, M. W. et al. Brain-wide projections and differential encoding of prefrontal neuronal classes underlying learned and innate threat avoidance. J. Neurosci. 43, 5810–5830 (2023).
Hui, M. & Beier, K. T. Defining the interconnectivity of the medial prefrontal cortex and ventral midbrain. Front. Mol. Neurosci. 15, 971349 (2022).
Zhuo, Y. et al. Improved green and red GRAB sensors for monitoring dopaminergic activity in vivo. Nat. Methods21, 680–691 (2024).
van der Meulen, J. A. J., Joosten, R. N. J. M. A., de Bruin, J. P. C. & Feenstra, M. G. P. Dopamine and noradrenaline efflux in the medial prefrontal cortex during serial reversals and extinction of instrumental goal-directed behavior. Cereb. Cortex 17, 1444–1453 (2007).
Gallello, I. et al. Dopamine responses in medial frontal cortex are more consistent with a generalized arousal signal than signed reward prediction errors. J. Neurosci. 46, e1454252026 (2026).
Babiczky, Á & Matyas, F. Molecular characteristics and laminar distribution of prefrontal neurons projecting to the mesolimbic system. eLife 11, e78813 (2022).
Watabe-Uchida, M., Eshel, N. & Uchida, N. Neural circuitry of reward prediction error. Annu. Rev. Neurosci. 40, 373–394 (2017).
Tan, K. R. et al. GABA neurons of the VTA drive conditioned place aversion. Neuron 73, 1173–1183 (2012).
van Zessen, R., Phillips, J. L., Budygin, E. A. & Stuber, G. D. Activation of VTA GABA neurons disrupts reward consumption. Neuron 73, 1184–1194 (2012).
Preview : Journal Type Jeong, M. et al. Distinct interneuronal dynamics selectively gate target-specific cortical projections in drug seeking. Neuronhttps://doi.org/10.1016/j.neuron.2026.01.002 (2026).
Gallistel, C. R., Fairhurst, S. & Balsam, P. The learning curve: Implications of a quantitative analysis. Proc. Natl Acad. Sci. USA 101, 13124 (2004).
Grossman, C. D., Bari, B. A. & Cohen, J. Y. Serotonin neurons modulate learning rate through uncertainty. Curr. Biol. 32, 586–599 (2022).
Soltani, A. & Izquierdo, A. Adaptive learning under expected and unexpected uncertainty. Nat. Rev. Neurosci. 20, 635–644 (2019).
Pearce, J. M. & Hall, G. A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol. Rev. 87, 532–552 (1980).
Mackintosh, N. J. A theory of attention: variations in the associability of stimuli with reinforcement. Psychol. Rev. 82, 276–298 (1975).
Le Pelley, M. E. The role of associative history in models of associative learning: a selective review and a hybrid model. Q. J. Exp. Psychol. B 57B, 193–243 (2004).
Coddington, L. T., Lindo, S. E. & Dudman, J. T. Mesolimbic dopamine adapts the rate of learning from action. Nature 614, 294–302 (2023).
Behrens, T. E. J., Woolrich, M. W., Walton, M. E. & Rushworth, M. F. S. Learning the value of information in an uncertain world. Nat. Neurosci. 10, 1214–1221 (2007).
Bissonette, G. B. & Roesch, M. R. Neural correlates of rules and conflict in medial prefrontal cortex during decision and feedback epochs. Front. Behav. Neurosci. 9, 266 (2015).
Malagon-Vina, H., Ciocchi, S., Passecker, J., Dorffner, G. & Klausberger, T. Fluid network dynamics in the prefrontal cortex during multiple strategy switching. Nat. Commun. 9, 309 (2018).
Karlsson, M. P., Tervo, D. G. R. & Karpova, A. Y. Network resets in medial prefrontal cortex mark the onset of behavioral uncertainty. Science 338, 135–139 (2012).
Powell, N. J. & Redish, A. D. Representational changes of latent strategies in rat medial prefrontal cortex precede changes in behaviour. Nat. Commun. 7, 12830 (2016).
Rich, E. L. & Shapiro, M. Rat prefrontal cortical neurons selectively code strategy switches. J. Neurosci. 29, 7208–7219 (2009).
Beier, K. T. et al. Circuit architecture of VTA dopamine neurons revealed by systematic input-output mapping. Cell 162, 622–634 (2015).
Watabe-Uchida, M., Zhu, L., Ogawa, S. K., Vamanrao, A. & Uchida, N. Whole-brain mapping of direct inputs to midbrain dopamine neurons. Neuron 74, 858–873 (2012).
Goldstein, R. Z. & Volkow, N. D. Dysfunction of the prefrontal cortex in addiction: neuroimaging findings and clinical implications. Nat. Rev. Neurosci. 12, 652–669 (2011).
Le, T. M., Potvin, S., Zhornitsky, S. & Li, C.-S. R. Distinct patterns of prefrontal cortical disengagement during inhibitory control in addiction: A meta-analysis based on population characteristics. Neurosci. Biobehav. Rev. 127, 255–269 (2021).
Izquierdo, A. & Jentsch, J. D. Reversal learning as a measure of impulsive and compulsive behavior in addictions. Psychopharmacology (Berl.) 219, 607–620 (2012).
Lüscher, C., Robbins, T. W. & Everitt, B. J. The transition to compulsion in addiction. Nat. Rev. Neurosci. 21, 247–263 (2020).
Devoto, F., Zapparoli, L., Spinelli, G., Scotti, G. & Paulesu, E. How the harm of drugs and their availability affect brain reactions to drug cues: a meta-analysis of 64 neuroimaging activation studies. Transl. Psychiatry 10, 429 (2020).
Guo, Z. V. et al. Procedures for behavioral experiments in head-fixed mice. PLoS ONE 9, e88678 (2014).
Gordon-Fennell, A. et al. An open-source platform for head-fixed operant and consummatory behavior. eLife 12, e86183 (2023).
Lee, J., Linster, C. & Devore, S. Odor preferences shape discrimination learning in rats. Behav. Neurosci. 127, 498–504 (2013).
Saraiva, L. R. et al. Combinatorial effects of odorants on mouse behavior. Proc. Natl Acad. Sci. USA 113, E3300–E3306 (2016).
De Bruin, J. P. C. et al. Role of the prefrontal cortex of the rat in learning and decision making: effects of transient inactivation. Prog. Brain Res. 126, 103–113 (2000).
Seamans, J. K., Floresco, S. B. & Phillips, A. G. Functional differences between the prelimbic and anterior cingulate regions of the rat prefrontal cortex. Behav. Neurosci. 109, 1063–1073 (1995).
Hervig, M. E. et al. Dissociable and paradoxical roles of rat medial and lateral orbitofrontal cortex in visual serial reversal learning. Cereb. Cortex 30, 1016–1029 (2020).
Dalton, G. L., Wang, N. Y., Phillips, A. G. & Floresco, S. B. Multifaceted contributions by different regions of the orbitofrontal and medial prefrontal cortex to probabilistic reversal learning. J. Neurosci. 36, 1996–2006 (2016).
Boulougouris, V., Dalley, J. W. & Robbins, T. W. Effects of orbitofrontal, infralimbic and prelimbic cortical lesions on serial spatial reversal learning in the rat. Behav. Brain Res. 179, 219–228 (2007).
Mills, B. GitHub – BlakeRMills/MetBrewer: color palette package in R inspired by works at the Metropolitan Museum of Art in New York. GitHub https://github.com/BlakeRMills/MetBrewer?tab=readme-ov-file (2023).
Rhoads, S. A. & Gan, L. Computational models of human social behavior and neuroscience: An open educational course and Jupyter Book to advance computational training. J. Open Source Educ. 5, 146 (2022).
Yu, C.-H. The Cousa objective: a long-working distance air objective for multiphoton imaging in vivo. Nat. Methods 21, 132–141 (2024).
Barnett, L. M., Hughes, T. E. & Drobizhev, M. Deciphering the molecular mechanism responsible for GCaMP6m’s Ca2+-dependent change in fluorescence. PLoS ONE 12, e0170934 (2017).
Pachitariu, M. et al. Suite2p: beyond 10,000 neurons with standard two-photon microscopy. Preprint at bioRxiv https://doi.org/10.1101/061507 (2017).
Thevenaz, P., Ruttimann, U. E. & Unser, M. A pyramid approach to subpixel registration based on intensity. IEEE Trans. Image Process. 7, 27–41 (1998).
Engel, T. A. & Steinmetz, N. A. New perspectives on dimensionality and variability from large-scale cortical dynamics. Curr. Opin. Neurobiol. 58, 181–190 (2019).
Harris, K. D. Nonsense correlations in neuroscience. Preprint at bioRxiv https://doi.org/10.1101/2020.11.29.402719 (2021).
Friedrich, J., Zhou, P. & Paninski, L. Fast online deconvolution of calcium imaging data. PLoS Comput. Biol. 13, e1005423 (2017).
de Jong, J. W. et al. A neural circuit mechanism for encoding aversive stimuli in the mesolimbic dopamine system. Neuron 101, 133–151 (2019).
Roth, B. L. DREADDs for neuroscientists. Neuron 89, 683–694 (2016).
Armbruster, B. N., Li, X., Pausch, M. H., Herlitze, S. & Roth, B. L. Evolving the lock to fit the key to create a family of G protein-coupled receptors potently activated by an inert ligand. Proc. Natl Acad. Sci. USA 104, 5163–5168 (2007).
Nagai, Y. et al. Deschloroclozapine, a potent and selective chemogenetic actuator enables rapid neuronal and behavioral modulations in mice and monkeys. Nat. Neurosci. 23, 1157–1167 (2020).
Kosaki, Y. & Watanabe, S. Dissociable roles of the medial prefrontal cortex, the anterior cingulate cortex, and the hippocampus in behavioural flexibility revealed by serial reversal of three-choice discrimination in rats. Behav. Brain Res. 227, 81–90 (2012).
Brigman, J. L. & Rothblat, L. A. Stimulus specific deficit on visual reversal learning after lesions of medial prefrontal cortex in the mouse. Behav. Brain Res. 187, 405–410 (2008).
Chudasama, Y. & Robbins, T. W. Dissociable contributions of the orbitofrontal and infralimbic cortex to Pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex. J. Neurosci. 23, 8771–8780 (2003).
Paxinos, G. & Franklin, K. B. J. Paxinos and Franklin’s the Mouse Brain in Stereotaxic Coordinates (Academic Press, 2019).
