Yang, Minsu Abel

Abstract The external globus pallidus (GPe) has traditionally been viewed as a relay nucleus within the basal ganglia (BG), but accumulating evidence indicates a more dynamic role in reinforcement learning (RL). One key characteristic of GPe activity—transient pauses in high-frequency discharge (HFD) neurons—is preserved across species, yet its potential implications in RL remains unclear. Here, we developed a neurophysiologically grounded computational model to investigate the origin and role of GPe pauses in RL. Our model successfully replicated a range of empirical observations, including pause dynamics during learning and cue-related activity modulation. We demonstrated that the GPe-subthalamic nucleus (STN) circuit functions analogously to a denoising autoencoder, modulating baseline excitability in downstream BG circuits and that GPe pauses emerge as circuit-level consequences of strong, convergent inhibition from the GPe to STN. Simulations and in vivo recordings revealed that the activity of GPe-STN projecting neurons increases following sudden environmental changes, promoting adaptive exploration by disrupting action value contrast. Intriguingly, this same configuration impairs performance with extended training, suggesting that habitual behavior may benefit from weakened GPe-to-STN projections. These findings provide a unifying framework for understanding GPe pause dynamics and highlight circuit-level distinctions supporting the balance between flexibility and proficiency in RL.

Abstract Behavioral flexibility allows animals to adjust actions to changing environments. While the basal ganglia are critical for adaptation, the specific role of the external globus pallidus (GPe) is unclear. This study examined the contributions of two major GPe cell types—prototypic neurons projecting to the subthalamic nucleus (Proto GPe→STN neurons) and astrocytes—to behavioral flexibility. Using longitudinal operant conditioning with context reversals, we found that Proto GPe→STN neurons dynamically represent contextual information correlating with behavioral optimality. In contrast, GPe astrocytes exhibited gradual contextual encoding independent of performance. Deleting Proto GPe→STN neurons impaired adaptive responses to changing action-outcome contingencies without altering initial reward-seeking acquisition, highlighting their specific role in enabling behavioral flexibility. Furthermore, we discovered that Proto GPe→STN neurons integrate inhibitory striatal and excitatory subthalamic inputs, modulating downstream basal ganglia circuits to support flexible behavior. This research elucidates the complementary roles of Proto GPe→STN neurons and astrocytes in cellular mechanisms of flexible reward-seeking behavior.

An imbalance in goal-directed and habitual behavioral control is a hallmark of decision-making–related disorders, including addiction. Although external globus pallidus (GPe) is critical for action selection, which harbors enriched astrocytes, the role of GPe astrocytes involved in action-selection strategies remained unknown. Using in vivo calcium signaling with fiber photometry, we found substantially attenuated GPe astrocytic activity during habitual learning compared to goal-directed learning. The support vector machine analysis predicted the behavioral outcomes. Chemogenetic activation of the astrocytes or inhibition of GPe pan-neuronal activities facilitates the transition from habit to goal-directed reward-seeking behavior. Next, we found increased astrocyte-specific GABA (γ-aminobutyric acid) transporter type 3 (GAT3) messenger RNA expression during habit learning. Notably, the pharmacological inhibition of GAT3 occluded astrocyte activation–induced transition from habitual to goal-directed behavior. On the other hand, attentional stimuli shifted the habit to goal-directed behaviors. Our findings suggest that the GPe astrocytes regulate the action selection strategy and behavioral flexibility.