Showing posts with label aversive. Show all posts
Showing posts with label aversive. Show all posts

2018/01/24

2016/1/24 榎本

Paraventricular Thalamus Balances Danger and Reward

Eun A. Choi and Gavan P. McNally
J Neurosci. 2017 Mar 15;37(11):3018-3029.

視床室傍核(PVT / Pa: Paraventricular nucleus of thalamus)と視床下部室傍核(PVN / PVH: Paraventricular hypothalamic nucleus)は別の神経核であることにご注意ください。略称統一してほしい……今回はPVTの話です。

PVTは脳幹や視床下部から入力をうけ、辺縁皮質(PL, IL)や島皮質と相互連絡、側坐核や扁桃体中心核(CeA)、分界条床核(BST)や前交連後肢間質核(IPAC)なんかに出力します。睡眠/覚醒や摂食制御、不安やムード、ストレスなどに関わる機能について調べられてきましたが、近年の計測制御技術興隆の恩恵をうけ、より精密な神経回路メカニズムが明らかになりつつあります。今回は報酬とフットショックがくる相克的な条件の課題を学習させたラットを用い、DREADDでPVTを可逆的に不活性化させてフリージング/報酬接近行動を観察することにより、一見矛盾するような結果を示しています。



参考文献

High field FMRI reveals thalamocortical integration of segregated cognitive and emotional processing in mediodorsal and intralaminar thalamic nuclei.
Metzger CD1, Eckert U, Steiner J, Sartorius A, Buchmann JE, Stadler J, Tempelmann C, Speck O, Bogerts B, Abler B, Walter M.
Front Neuroanat. 2010 Nov 1;4:138.

ヒトfMRIでPVTの活動を報告しているのは今のところこれだけ。セクシー画像で興奮するみたい。


Placing the paraventricular nucleus of the thalamus within the brain circuits that control behavior.
Kirouac GJ.
Neurosci Biobehav Rev. 2015 Sep;56:315-29.


A thalamic input to the nucleus accumbens mediates opiate dependence
Yingjie Zhu, Carl F. R. Wienecke, Gregory Nachtrab& Xiaoke Chen
Nature. 2016 Feb 11;530(7589):219-22.


A food-predictive cue attributed with incentive salience engages subcortical afferents and efferents of the paraventricular nucleus of the thalamus.
Haight JL, Fuller ZL, Fraser KM, Flagel SB.
Neuroscience. 2017 Jan 6;340:135-152.


Contributions of the paraventricular thalamic nucleus in the regulation of stress, motivation, and mood.
Hsu DT, Kirouac GJ, Zubieta JK, Bhatnagar S.
Front Behav Neurosci. 2014 Mar 11;8:73.

サルです。PaというのがPVT。

2018/01/17

2018/01/17 春野

Aversive Prediction Errorはどこにありどう学習に使われるのか?

SLIDE


Dysregulation of aversive signaling pathways: a novel circuit endophenotype for pain and anxiety disorders.

Li-Feng Yeh, Mayumi Watanabe, Jessica Sulkes-Cuevas, Joshua P Johansen
Curr Opin Neurobiol. 2017 Sep 28;48:37-44.

abstract
Aversive experiences activate dedicated neural instructive pathways which trigger memory formation and change behavior. The strength of these aversive memories and the degree to which they alter behavior is proportional to the intensity of the aversive experience. Dysregulation of aversive learning circuits can lead to psychiatric pathology. Here we review recent findings elucidating aversive instructive signaling circuits for fear conditioning. We then examine how chronic pain as well as stress and anxiety disrupt these circuits and the implications this has for understanding and treating psychiatric disease. Together this review synthesizes current work on aversive instructive signaling circuits in health and disease and suggests a novel circuit based framework for understanding pain and anxiety syndromes.
PDF



A temporal shift in the circuits mediating retrieval of fear memory.


Fabricio H. Do-Monte, Kelvin Quiñones-Laracuente & Gregory J. Quirk
Nature. 2015 Mar 26;519(7544):460-3.

abstract
Fear memories allow animals to avoid danger, thereby increasing their chances of survival. Fear memories can be retrieved long after learning, but little is known about how retrieval circuits change with time. Here we show that the dorsal midline thalamus of rats is required for the retrieval of auditory conditioned fear at late (24 hours, 7 days, 28 days), but not early (0.5 hours, 6 hours) time points after learning. Consistent with this, the paraventricular nucleus of the thalamus (PVT), a subregion of the dorsal midline thalamus, showed increased c-Fos expression only at late time points, indicating that the PVT is gradually recruited for fear retrieval. Accordingly, the conditioned tone responses of PVT neurons increased with time after training. The prelimbic (PL) prefrontal cortex, which is necessary for fear retrieval, sends dense projections to the PVT. Retrieval at late time points activated PL neurons projecting to the PVT, and optogenetic silencing of these projections impaired retrieval at late, but not early, time points. In contrast, silencing of PL inputs to the basolateral amygdala impaired retrieval at early, but not late, time points, indicating a time-dependent shift in retrieval circuits. Retrieval at late time points also activated PVT neurons projecting to the central nucleus of the amygdala, and silencing these projections at late, but not early, time points induced a persistent attenuation of fear. Thus, the PVT may act as a crucial thalamic node recruited into cortico-amygdalar networks for retrieval and maintenance of long-term fear memories.
PDF


Placing prediction into the fear circuit.

Gavan P. McNally, Gavan P. McNally, Joshua P. Johansen, Hugh T. Blair
Trends Neurosci. 2011 Jun;34(6):283-92.

Abstract
Pavlovian fear conditioning depends on synaptic plasticity at amygdala neurons. Here, we review recent electrophysiological, molecular and behavioral evidence suggesting the existence of a distributed neural circuitry regulating amygdala synaptic plasticity during fear learning. This circuitry, which involves projections from the midbrain periaqueductal gray region, can be linked to prediction error and expectation modulation of fear learning, as described by associative and computational learning models. It controls whether, and how much, fear learning occurs by signaling aversive events when they are unexpected. Functional neuroimaging and clinical studies indicate that this prediction circuit is recruited in humans during fear learning and contributes to exposure-based treatments for clinical anxiety. This aversive prediction error circuit might represent a conserved mechanism for regulating fear learning in mammals.
PDF


Neural substrates for expectation-modulated fear learning in the amygdala and periaqueductal gray.

Joshua P Johansen, Jason W Tarpley, Joseph E LeDoux & Hugh T Blair
Nat Neurosci. 2010 Aug;13(8):979-86. doi: 10.1038/nn.2594.

Abstract
A form of aversively motivated learning called fear conditioning occurs when a neutral conditioned stimulus is paired with an aversive unconditioned stimulus (UCS). UCS-evoked depolarization of amygdala neurons may instruct Hebbian plasticity that stores memories of the conditioned stimulus-unconditioned stimulus association, but the origin of UCS inputs to the amygdala is unknown. Theory and evidence suggest that instructive UCS inputs to the amygdala will be inhibited when the UCS is expected, but this has not been found during fear conditioning. We investigated neural pathways that relay information about the UCS to the amygdala by recording neurons in the amygdala and periaqueductal gray (PAG) of rats during fear conditioning. UCS-evoked responses in both amygdala and PAG were inhibited by expectation. Pharmacological inactivation of the PAG attenuated UCS-evoked responses in the amygdala and impaired acquisition of fear conditioning, indicating that PAG may be an important part of the pathway that relays instructive signals to the amygdala.
PDF


A feedback neural circuit for calibrating aversive memory strength.

Takaaki Ozawa, Edgar A Ycu, Ashwani Kumar, Li-Feng Yeh, Touqeer Ahmed, Jenny Koivumaa & Joshua P Johansen
Nat Neurosci. 2017 Jan;20(1):90-97. doi: 10.1038/nn.4439.

Abstract
Aversive experiences powerfully regulate memory formation, and memory strength is proportional to the intensity of these experiences. Inhibition of the neural circuits that convey aversive signals when they are predicted by other sensory stimuli is hypothesized to set associative memory strength. However, the neural circuit mechanisms that produce this predictive inhibition to regulate memory formation are unknown. Here we show that predictive sensory cues recruit a descending feedback circuit from the central amygdala that activates a specific population of midbrain periaqueductal gray pain-modulatory neurons to control aversive memory strength. Optogenetic inhibition of this pathway disinhibited predicted aversive responses in lateral amygdala neurons, which store fear memories, resulting in the resetting of fear learning levels. These results reveal a control mechanism for calibrating learning signals to adaptively regulate the strength of behavioral learning. Dysregulation of this circuit could contribute to psychiatric disorders associated with heightened fear responsiveness.
恐怖記憶の強さを制御するフィードバック機構 : ライフサイエンス 新着論文レビュー
PDF


Hypothalamic corticotropin-releasing factor is centrally involved in learning under moderate stress.

Morgan Lucas, Alon Chen & Gal Richter-Levin
Neuropsychopharmacology. 2013 Aug;38(9):1825-32. doi: 10.1038/npp.2013.82.

Abstract
The corticotropin-releasing factor (CRF) neuropeptide is found to have a pivotal role in the regulation of the behavioral and neuroendocrine responses to stressful challenges. Here, we studied the involvement of the hypothalamic CRF in learning under stressful conditions. We have used a site-specific viral approach to knockdown (KD) CRF expression in the paraventricular nucleus of the hypothalamus (PVN). The two-way shuttle avoidance (TWSA) task was chosen to assess learning and memory under stressful conditions. Control animals learned to shuttle from one side to the other to avoid electrical foot shock by responding to a tone. Novel object and social recognition tasks were used to assess memory under less stressful conditions. KD of PVN-CRF expression decreased the number of avoidance responses in a TWSA session under moderate (0.8 mA), but not strong (1.5 mA), stimulus intensity compared to control rats. On the other hand, KD of PVN-CRF had no effect on memory performance in the less stressful novel object or social recognition tasks. Interestingly, basal or stress-induced corticosterone levels in CRF KD rats were not significantly different from controls. Taken together, the data suggest that the observed impairment was not a result of alteration in HPA axis activity, but rather due to reduced PVN-CRF activity on other brain areas. We propose that hypothalamic CRF is centrally involved in learning under moderate stressful challenge. Under 'basal' (less stressful) conditions or when the intensity of the stress is more demanding, central CRF ceases to be the determinant factor, as was indicated by performances in the TWSA with higher stimulus intensity or in the less stressful tasks of object and social recognition.
PDF

2017/12/27

2017/12/27 榎本

Bo Liらの仕事を中心に、いま現在の扁桃体……特に中心核(CeA)をとりまく嫌悪学習/可塑性に関わる神経回路の理解と、そこに至るまでの歴史をご紹介いたします。役者もいろいろ、論文も沢山ありますが、大事なところを見極めていきましょう。

SLIDE


2017/12/13

2017/12/13 榎本

Optogenetic Inhibition Reveals Distinct Roles for Basolateral Amygdala Activity at Discrete Time Points during Risky Decision Making
Orsini CA, Hernandez CM, Singhal S, Kelly KB, Frazier CJ, Bizon JL, Setlow B
J Neurosci. 2017 Nov 29;37(48):11537-11548. doi: 10.1523/JNEUROSCI.2344-17.2017. Epub 2017 Oct 27

ラットにSmall & Safe rawardかLarge & Risky rewardかを選ばせる課題を用い、扁桃体BLAを光刺激で抑制したときに、光刺激のタイミングによって真逆の効果が見られることを報告しています。

Abstract

Decision making is a multifaceted process, consisting of several distinct phases that likely require different cognitive operations. Previous work showed that the basolateral amygdala (BLA) is a critical substrate for decision making involving risk of punishment; however, it is unclear how the BLA is recruited at different stages of the decision process. To this end, the current study used optogenetics to inhibit the BLA during specific task phases in a model of risky decision making (risky decision-making task) in which rats choose between a small, “safe” reward and a large reward accompanied by varying probabilities of footshock punishment. Male Long–Evans rats received intra-BLA microinjections of viral vectors carrying either halorhodopsin (eNpHR3.0-mCherry) or mCherry alone (control) followed by optic fiber implants and were trained in the risky decision-making task. Laser delivery during the task occurred during intertrial interval, deliberation, or reward outcome phases, the latter of which was further divided into the three possible outcomes (small, safe; large, unpunished; large, punished). Inhibition of the BLA selectively during the deliberation phase decreased choice of the large, risky outcome (decreased risky choice). In contrast, BLA inhibition selectively during delivery of the large, punished outcome increased risky choice. Inhibition had no effect during the other phases, nor did laser delivery affect performance in control rats. Collectively, these data indicate that the BLA can either inhibit or promote choice of risky options, depending on the phase of the decision process in which it is active.

PDF | SLIDE


参考に、ここ数年の扁桃体関連論文リストです。

2015/07/15

2015/07/15 野々村

A Corticostriatal Path Targeting Striosomes Controls Decision-Making under Conflict
Friedman A, Homma D, Gibb LG, Amemori K, Rubin SJ, Hood AS, Riad MH, Graybiel AM.
Cell. 2015 Jun 4;161(6):1320-33. doi: 10.1016/j.cell.2015.04.049. Epub 2015 May 28.

Rat のPLから背内側線条体のマトリックスに投射しているニューロンが,Rewardと Aversive baseの意思決定におけるconflictに特異的に関わっていることを,光遺伝学と電気生理の技術を使用して証明した論文です.

PDF | SLIDE

2014/11/11

2014/11/11 榎本

Observation of Reward Delivery to a Conspecific Modulates Dopamine Release in Ventral Striatum
Vadim Kashtelyan, Nina T. Lichtenberg, Mindy L. Chen, Joseph F. Cheer, Matthew R. Roesch
Current Biology. Volume 24, Issue 21, p2564-2568, 3 November 2014

Highlights
  • Dopamine is released when rats first observe a conspecific receive reward
  • The dopaminergic response reverses in later trials
  • Appetitive vocalizations are recorded when dopamine is released
  • Rats emit aversive calls during later trials of observation

ラットに仲間が報酬をもらうのを見せたとき、はじめは嬉しげな行動をするし、じっさい線条体でドパミンが放出されるのだけれども、そのうち放出量が下がってきて、(文字通り)抗議の声を上げて(Ultrasonic vocalization)そちらを見もしなくなる、という話です。齧歯類でもここまでできる。

 *

Mosher CP, Zimmerman PE, Gothard KM.
Curr Biol. 2014 Oct 1. pii: S0960-9822(14)01127-0. 

おまけです。サルが目と目で通じ合う……


そういうときは扁桃体の特別なニューロンが発火しているのです。

PDF | SLIDE

2014/10/21

2014/10/21 春野

Aversive prediction error signals in the amygdala
McHugh SB, Barkus C, Huber A, Capitão L, Lima J, Lowry JP, Bannerman DM.
J Neurosci. 2014 Jul 2;34(27):9024-33. doi: 10.1523/JNEUROSCI.4465-13.2014.

マウスのBLAから取ったhemodynamic responseがかなり高い精度で
aversive prediction errorを表しそうだというJNSの論文を紹介します。

PDF | SLIDE

2013/09/27

2013/09/27 渡邊

Two Dimensions of Value:  Dopamine Neurons Represent Reward But NotAversiveness
Christopher D. Fiorillo
Science 2 August 2013:  Vol. 341 no. 6145 pp. 546-549

SNcやVTAのドパミンニューロンが報酬予測誤差の情報をコードしていることは、良く知られていることですが、多くの研究は「正の報酬」についての研究であり、「負の報酬」つまり罰については詳細な検証がされていませんでした。そして、多くの研究は明示的にまた暗黙的に報酬と罰は正反対の存在として扱ってきました。
確かに、強化学習モデルの報酬予測誤差理論では報酬も罰も、区別することなく一軸の中の一点として表現できます。また実際の動物の行動としては接近vs回避行動のどちらかしか起こりません。
しかしながら、今回Fiorilloが示した結果はドパミンは正の報酬しかコードしておらず、罰の情報はコードしていないというものです。そして、報酬の軸と罰の軸の二軸があると主張しています。

PDF  SLIDE


2013/07/12

2013/07/12 渡邊

こんばんは。夜分遅く失礼します。渡邊です。

明日の発表では「学習性無力感」とその脳内メカニズムについていくつかの研究を紹介しながら、これまで明らかになっている点、未だ明らかになっていない点についてお話したいと思います。
というのも、自分が現在計画している実験系において罰(電気ショック)を使った課題を考えているのですが、そのような学習過程では、学習性無力感に陥ってしまう可能性もあり、それは自分が見たい現象と切り分けられるかディスカッションさせていただきたいと思っています。

添付は今回の話の元にしたReview

Helplessness: a systematic translational review of theory and evidence for its relevance to understanding and treating depression.
Pryce CR, Azzinnari D, Spinelli S, Seifritz E, Tegethoff M, Meinlschmidt G.
Pharmacol Ther. 2011 Dec;132(3):242-67.

それと学習性無力感について特に重要な論文

Medial prefrontal cortex determines how stressor controllability affects behavior and dorsal raphe nucleus.
Amat J, Baratta MV, Paul E, Bland ST, Watkins LR, Maier SF.
Nat Neurosci. 2005 Mar;8(3):365-71.

です。
よろしくお願いします。

PDF1  PDF2  SLIDE

2013/05/10

2013/05/10 木村

Distinct extended amygdala circuits for divergent motivational states.
Jennings JH, Sparta DR, Stamatakis AM, Ung RL, Pleil KE, Kash TL, Stuber GD.
Nature. 2013 Apr 11;496(7444):224-8.

Diverging neural pathways assemble a behavioural state from separable features in anxiety.
Kim SY, Adhikari A, Lee SY, Marshel JH, Kim CK, Mallory CS, Lo M, Pak S, Mattis J, Lim BK, Malenka RC, Warden MR, Neve R, Tye KM, Deisseroth K.
Nature. 2013 Apr 11;496(7444):219-23.

Bed nucleus of stria terminalis (BNST) 分界条床核は「偏桃体の伸びた部分」"Extended amygdala"とも呼ばれ、情動の統合と表出に関わる神経核です。最近注目されているところで、mouse optogeneticsを使って調べた研究がnatureに掲載されました。

pdf1  pdf2  slide  pptx

2012/12/04

2012/12/04 榎本


The mysterious motivational functions of mesolimbic dopamine.
Salamone JD, Correa M.
Neuron. 2012 Nov 8;76(3):470-85.

側坐核ドパミン系機能についての、心理学者ぽいまとめです。ゴールまでの心理的距離(物理的距離、待ち時間、確率、労働)をのりこえるための、辺縁系から運動系への橋渡し、というかんじ…?



Pain relief produces negative reinforcement through activation of mesolimbic reward-valuation circuitry.
Navratilova E, Xie JY, Okun A, Qu C, Eyde N, Ci S, Ossipov MH, King T, Fields HL, Porreca F.
Proc Natl Acad Sci U S A. 2012 Nov 26. [Epub ahead of print]

痛みの緩和が報酬になる……ラットの脚を傷つけて、リドカイン注射で沈痛してやると、VTA→NAc medial shellへ投射しているドパミン依存的に条件付け場所嗜好性がみられ、VTAでのcFOS発現、マイクロダイアリシスで側坐核におけるドパミン放出まで確認してます。嫌悪刺激にたいして興奮応答するようなやつとはちがって、古典的な報酬系の回路っぽい。入力は傍小脳脚核や帯状皮質(直接または扁桃体を介して)、外側手綱核から間接的に?



おまけ

脳の中のグリア細胞の働きで、運動学習が加速することを発見 ―神経細胞とは異なるグリア細胞の活動を光で自在に操る技術を確立―

意識のことまで話しを拡げているのがおもしろいです。


2012/11/05

2012/11/05 山中

Input-specific control of reward and aversion in the ventral tegmental area.
Lammel S, Lim BK, Ran C, Huang KW, Betley MJ, Tye KM, Deisseroth K, Malenka RC.
Nature. 2012 Oct 14. doi: 10.1038/nature11527.

LDT(laterodorsal tegmentum) -> lateral VTA DA -> NAc lateral shell のpathwayと、
LHb -> medial VTA DA -> mPFC のpathwayが
それぞれRewardとAversiveの情報処理に重要であることをTracer study, optogenetics, electrophysiology, pharmachologyを駆使して示しています。

*LDTについて追加のreference
http://www.nature.com/npp/journal/v35/n1/full/npp200993a.html