12.12.2012 Views

Who Needs Emotions? The Brain Meets the Robot

Who Needs Emotions? The Brain Meets the Robot

Who Needs Emotions? The Brain Meets the Robot

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

eware <strong>the</strong> passionate robot 359<br />

by x. <strong>The</strong> changes in <strong>the</strong> WG are of two kinds: changes in <strong>the</strong> R values labeling<br />

<strong>the</strong> nodes (this finds echoes in <strong>the</strong> <strong>the</strong>ory of reinforcement learning:<br />

Sutton & Barto, 1998) and actual structural changes in <strong>the</strong> graph.<br />

More recently, we have integrated <strong>the</strong> WG model with a model of how<br />

a rat can still exhibit spatially guided behavior when its hippocampus is<br />

lesioned (Guazzelli, Corbacho, Bota, & Arbib, 1998; Guazzelli, Bota, &<br />

Arbib, 2001). Figure 12.2 can be seen as <strong>the</strong> interaction of <strong>the</strong> following<br />

subsystems:<br />

1. <strong>The</strong> path Sensory Inputs → Parietal Affordances → Premotor<br />

Action Selection → Motor Outputs is modulated by drive state<br />

(hypothalamus, nucleus accumbens). <strong>The</strong>se interactions are an<br />

example of <strong>the</strong> taxon affordance model (TAM) (Guazzelli, Corbacho,<br />

Bota, & Arbib, 1998).<br />

2. Motor outputs affect goal objects in ways that have consequences<br />

(gaining food, getting injured, etc.) for <strong>the</strong> organism.<br />

<strong>The</strong>se can affect <strong>the</strong> internal state of brain and body, updating<br />

<strong>the</strong> drive state. This affects <strong>the</strong> modulation of (1) in 2 ways:<br />

Sensory<br />

inputs<br />

Dynamic<br />

remapping<br />

Parietal<br />

Hippocampal<br />

formation<br />

place<br />

Affordances<br />

Caudoputamen<br />

Actor-critic<br />

Nucleus<br />

accumbens<br />

Dopamine<br />

neurons<br />

Prefrontal<br />

world graph<br />

Premotor<br />

action selection<br />

Hypothalamus<br />

drive states<br />

Motor<br />

outputs<br />

GOAL OBJECT<br />

CONSEQUENCES<br />

Internal state<br />

Incentives<br />

Sensory<br />

inputs<br />

Figure 12.2. <strong>The</strong> taxon affordance model-world graph (TAM-WG) has as its<br />

basis a system, TAM, for exploiting affordances. <strong>The</strong> path Sensory Inputs →<br />

Parietal Affordances → Premotor Action Selection → Motor Outputs is<br />

modulated by drive state. This is elaborated by <strong>the</strong> WG model, which can use<br />

a cognitive map, mediated by interactions between hippocampus and prefrontal<br />

cortex, to plan paths to targets which are not currently perceptible.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!