Hong, Sa‐Ik

An imbalance in goal-directed and habitual behavioral control is a hallmark of decision-making–related disorders, including addiction. Although external globus pallidus (GPe) is critical for action selection, which harbors enriched astrocytes, the role of GPe astrocytes involved in action-selection strategies remained unknown. Using in vivo calcium signaling with fiber photometry, we found substantially attenuated GPe astrocytic activity during habitual learning compared to goal-directed learning. The support vector machine analysis predicted the behavioral outcomes. Chemogenetic activation of the astrocytes or inhibition of GPe pan-neuronal activities facilitates the transition from habit to goal-directed reward-seeking behavior. Next, we found increased astrocyte-specific GABA (γ-aminobutyric acid) transporter type 3 (GAT3) messenger RNA expression during habit learning. Notably, the pharmacological inhibition of GAT3 occluded astrocyte activation–induced transition from habitual to goal-directed behavior. On the other hand, attentional stimuli shifted the habit to goal-directed behaviors. Our findings suggest that the GPe astrocytes regulate the action selection strategy and behavioral flexibility.

Abstract The external globus pallidus (GPe) guides action selection. However, it remains elusive how diverse GPe cells engage in routine formation while learning action sequences in repetitive reward-seeking conditioning. Here, we investigated the Ca2+ signals of GPe cells during routine formation. We found that the dynamics of astrocytes and prototypic neurons’ activities are associated with the refinement of the action sequence, which enables cost-effective reward-seeking.

Abstract The external globus pallidus (GPe) coordinates action-selection through GABAergic projections throughout the basal ganglia. GPe arkypallidal (arky) neurons project exclusively to the dorsal striatum, which regulates goal-directed and habitual reward-seeking. However, the role of GPe arky neurons in reward-seeking remains unknown. Here, we identified that a majority of arky neurons target the dorsolateral striatum (DLS). Using fiber photometry, we found that arky activities were higher during random interval (RI; habit) compared to random ratio (RR; goal) operant reward-seeking. Support vector machine analysis demonstrated that arky neuron activities have sufficient information to distinguish between RR and RI behavior. Genetic ablation of this arkyGPe◊DLS circuit facilitated a shift from goal-directed to habitual behavior. Conversely, chemogenetic activation reduced habitual seeking-behaviors, which was blocked by systemic D1R agonism. Our findings reveal a novel role of this arkyGPe◊DLS circuit in constraining habitual reward-seeking, which is relevant to addictive behaviors and other compulsive disorders.

Abstract The external globus pallidus (GPe) is an integrative hub and gateway for behavioral flexibility in reward-related behaviors. However, it remains unknown whether enriched astrocytes in the GPe guide behavioral flexibility. Here, we trained mice to exhibit goal-directed and habitual reward-seeking behaviors using the behavior tasks with effort- and time-based reward delivery, respectively. Then, we examined the temporal dynamics of GPe astrocytes during goal-directed and habitual learning. Overall, GPe astrocytes were substantially silenced during habitual learning compared to goal-directed learning. In the timescale of action events, GPe astrocyte activities were increased immediately after termination of reward-taking behavior before the following action. However, during habitual learning, the increase of astrocyte activity was not evident. Moreover, support vector machine (SVM) analysis demonstrated that GPe astrocytes dynamics predicted whether mice perform goal-directed or habitual behaviors. Interestingly, chemogenetic activation of GPe astrocytes, which dampened GPe neuronal firings and habitual behaviors, exhibting goal-directed behaviors. Strikingly, brief and repeated attentional stimulations recapitulated the effect of chemogenetic activation of GPe in intervening the habitual reward-seeking behaviors with increased GPe astrocyte activities. Our findings reveal a novel insight that increasing GPe astrocytic activities attenuates habitual behavior and improves behavioral flexibility, which may provide a potential therapeutic target for decision-making-related disorders, such as obsessive-compulsive disorder and addiction.

Habitual reward‐seeking behavior is a hallmark of addictive behaviors. Although habitual behavior could be reversed to goal‐directed behavior, this shifting is not well studied. Here, we identify a role of astrocyte activation in the dorsomedial striatum (DMS) on transition from habitual to goal‐directed reward‐seeking behavior. Utilizing the Inscopix endomicroscopy/fiber photometry in vivo calcium imaging and the cell‐type specific activation of designer receptors exclusively activated by designer drugs (DREADDs), we confirmed that GFAP‐driven activation of hM3Dq DREADDs increases intensity and frequency of calcium signaling in the DMS astrocytes of ALDH1L1‐GCaMP6s expressing mice. We found that this chemogenetic activation of the DMS astrocytes increase and decrease neuronal excitability of direct pathway Medium Spiny Neurons (dMSNs) and indirect pathway Medium Spiny Neurons (iMSNs), respectively. Specifically, it reduced the frequency of spontaneous excitatory postsynaptic currents (sEPSCs) in the dMSNs, whereas it increased the amplitude of the sEPSCs and decreased the frequency of spontaneous inhibitory postsynaptic currents (sIPSCs) in the iMSNs. The changes in synaptic events induced by astrocytic activation were significantly inhibited by either of the pretreatments of DPCPX (Adenosine A1R antagonist, 1 μM), PSB12379 (Inhibitor of ectonucleotidase, CD73, 10 μM), NBTI [Inhibitor of the astrocytic adenosine transporter, equilibrative nucleoside transporter 1 (ENT1, slc29a1), 10 μM], and genetic deletion of ENT1. These data suggest that astrocytic activation‐induced synaptic activities are, in part, adenosine‐dependent. In the evaluation tests of goal‐directed and habitual reward‐seeking, the chemogenetic activation of the DMS astrocytes shifted the habitual behavior to goal‐directed action in sucrose reward‐seeking for WT, but not ENT1 KO mice. The astrocytic activation‐induced shifting was rescued when ENT1 expression was normalized in the DMS astrocytes of the ENT1 KO mice. On the other hand, when mice were trained to have goal‐directed behavior, the astrocytic activation in the DMS did not change the reward‐seeking behavioral pattern. Together, our results indicate that astrocyte‐regulated adenosine signaling in the DMS determines goal‐directed and habitual behaviors by selectively regulating synapses in the MSNs. The interaction between astrocytes and neurons via adenosine signaling could be a potential therapeutic target for maladaptive reward‐seeking behaviors. Support or Funding Information This work was supported by the Samuel C. Johnson for Genomics of Addiction Program at Mayo Clinic, the Ulm Foundation, and National Institute on Alcohol Abuse and Alcoholism (K01 AA027773 to SK, R01 AA018779 to DSC).

Abstract Two distinct dorsal striatum regions, dorsomedial striatum (DMS) and dorsolateral striatum (DLS), are attributed to conditioned goal‐directed and habitual reward‐seeking behaviours, respectively. Previously, our study shows that the ethanol‐sensitive adenosine transporter, equilibrative nucleoside transporter 1 (ENT1), regulates ethanol‐drinking behaviours. Although ENT1 is expressed in both neurons and astrocytes, astrocytic ENT1 is thought to regulate adenosine levels in response to ethanol. However, the role of DMS and DLS astrocytic ENT1 in goal‐directed and habitual ethanol‐seeking is not well known. Here, we identified whether the upregulation of astrocytic ENT1 in the DMS and DLS differentially regulates operant seeking behaviours towards the 10% sucrose (10S); 10% ethanol and 10% sucrose (10E10S); and 10% ethanol (10E) in mice. Using 4 days of random interval (RI), mice exhibited habitual seeking for 10S, but goal‐directed seeking towards 10E10S. Using the same mice conditioned with 10E10S, we examined 10E‐seeking behaviour on a fixed ratio (FR) for 6 days and RI for 8 days. On the other hand, during FR and the first 4 days of RI schedules, mice showed goal‐directed seeking for 10E, whereas mice exhibited habitual seeking for 10E during the last 4 days of RI schedule. Interestingly, DMS astrocytic ENT1 upregulation promotes shift from habitual to goal‐directed reward‐seeking behaviours. By contrast, DLS astrocytic ENT1 upregulation showed no effects on behavioural shift. Taken together, our findings demonstrate that DMS astrocytic ENT1 contributes to reward‐seeking behaviours.

Abstract Waiting impulsivity is a risk factor for many psychiatric disorders including alcohol use disorder (AUD). Highly impulsive individuals are vulnerable to alcohol abuse. However, it is not well understood whether chronic alcohol use increases the propensity for impulsive behavior. Here, we establish a novel experimental paradigm demonstrating that continuous binge‐like ethanol exposure progressively leads to maladaptive impulsive behavior. To test waiting impulsivity, we employed the 5‐choice serial reaction time task (5‐CSRTT) in C57BL/6J male mice. We assessed premature responses in the fixed and variable intertrial interval (ITI) 5‐CSRTT sessions. We further characterized our ethanol‐induced impulsive mice using Open Field, y‐maze, two‐bottle choice, and an action‐outcome task. Our results indicate that continuous binge‐like ethanol exposure significantly increased premature responses when mice were tested in variable ITI sessions even during a prolonged abstinent period. Ethanol‐induced impulsive mice exhibited anxiety‐like behavior during chronic exposures. This behavior was also observed in a separate cohort that was subjected to 20 days of abstinence. Ethanol‐treated mice were less motivated for a sucrose reward compared with air‐exposed control mice, while also demonstrating reduced responding during action‐outcome testing. Overall, ethanol‐treated mice demonstrated increased impulsive behavior, but a reduced motivation for a sucrose reward. Although waiting impulsivity has been hypothesized to be a trait or risk factor for AUD, our findings indicate that maladaptive impulse control can also be potentiated or induced by continuous chronic ethanol exposure in mice.