15.12.2012 Views

When citing an abstract from the 2009 Annual - Society for ...

When citing an abstract from the 2009 Annual - Society for ...

When citing an abstract from the 2009 Annual - Society for ...

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

Disclosures: Y. Yim, None; G. Kim, None; C. Kim, None; D. Kim, None.<br />

Poster<br />

582. Stress <strong>an</strong>d Behavior<br />

Location: South Hall A<br />

Time: Tuesday, October 20, <strong>2009</strong>, 8:00 am - 12:00 noon<br />

Program#/Poster#: 582.6/GG68<br />

Topic: F.02.d. Cognitive learning <strong>an</strong>d memory systems<br />

Support: Swiss National Science Foundation Gr<strong>an</strong>t 3100A0-108102<br />

Title: Stress, individual differences, <strong>an</strong>d norepinephrine in prediction <strong>an</strong>d optimization of mouse<br />

behavior using rein<strong>for</strong>cement learning<br />

Authors: *G. LUKSYS, C. SANDI, W. GERSTNER;<br />

EPFL, Laus<strong>an</strong>ne, Switzerl<strong>an</strong>d<br />

Abstract: Behavioral per<strong>for</strong>m<strong>an</strong>ce during learning is known to be affected by modulatory<br />

factors such as stress <strong>an</strong>d motivation, as well as by individual differences that influence<br />

sensitivity to <strong>the</strong>se factors. Despite numerous studies, no integrative framework is available that<br />

could predict how a particular <strong>an</strong>imal would per<strong>for</strong>m a certain learning task in a realistic<br />

situation. Here, we show that a simple rein<strong>for</strong>cement learning model c<strong>an</strong> predict mouse behavior<br />

in a hole-box conditioning task, if model meta-parameters (<strong>the</strong> learning rate, explorationexploitation<br />

bal<strong>an</strong>ce, <strong>an</strong>d future reward discounting) are dynamically controlled based on <strong>the</strong><br />

in<strong>for</strong>mation about <strong>the</strong> <strong>an</strong>imal’s genotype <strong>an</strong>d phenotype, stress conditions, recent per<strong>for</strong>m<strong>an</strong>ce<br />

feedback, <strong>an</strong>d pharmacological m<strong>an</strong>ipulations of adrenergic alpha-2 receptors. We find that<br />

stress <strong>an</strong>d motivation affect behavioral per<strong>for</strong>m<strong>an</strong>ce by altering <strong>the</strong> exploration-exploitation<br />

bal<strong>an</strong>ce in a genotype dependent m<strong>an</strong>ner. Our results also provide computational insights into<br />

how <strong>an</strong> inverted-U-shape relation between stress/arousal/norepinephrine levels <strong>an</strong>d focused<br />

per<strong>for</strong>m<strong>an</strong>ce could be explained through ch<strong>an</strong>ges in per<strong>for</strong>m<strong>an</strong>ce accuracy <strong>an</strong>d future reward<br />

discounting. Finally, we <strong>an</strong>alyze under which meta-parameter settings <strong>the</strong> modeled <strong>an</strong>imal c<strong>an</strong><br />

acquire <strong>the</strong> maximal reward during <strong>the</strong> experimental sessions, <strong>an</strong>d which experimental<br />

m<strong>an</strong>ipulations should be applied <strong>for</strong> different mice to help <strong>the</strong>m improve <strong>the</strong>ir per<strong>for</strong>m<strong>an</strong>ce.<br />

Disclosures: G. Luksys, None; C. S<strong>an</strong>di, None; W. Gerstner, None.<br />

Poster

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!