12.07.2015 Views

Spatial Cognition - Frontiers in Artificial Intelligence and Applications ...

Spatial Cognition - Frontiers in Artificial Intelligence and Applications ...

Spatial Cognition - Frontiers in Artificial Intelligence and Applications ...

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

<strong>Spatial</strong> <strong>Cognition</strong>An AI PerspectiveChristian Freksa *Abstract. After a decade of temporal reason<strong>in</strong>g <strong>in</strong> <strong>Artificial</strong><strong>Intelligence</strong> (AI) <strong>in</strong> the 1980s <strong>and</strong> 1990s, spatial reason<strong>in</strong>g <strong>and</strong>spatial cognition have moved <strong>in</strong>to the focus of <strong>in</strong>terest <strong>in</strong>concentrated research enterprises s<strong>in</strong>ce the mid 1990s. This paperdescribes the <strong>in</strong>terdiscipl<strong>in</strong>ary research area of spatial cognitionfrom an artificial <strong>in</strong>telligence perspective <strong>and</strong> motivates the<strong>in</strong>terest <strong>in</strong> the field <strong>and</strong> the challenges from a cognitive perspective.It argues that all themes of cognitive science surface <strong>in</strong>spatial cognition <strong>and</strong> that spatial cognition is particularly suitableto <strong>in</strong>vestigate these themes. The particular significance of spatialstructures for knowledge acquisition <strong>and</strong> knowledge process<strong>in</strong>g bycognitive agents is described; it is shown why spatial structuresare <strong>in</strong>strumental <strong>in</strong> mak<strong>in</strong>g sense of physical environments <strong>and</strong>abstract worlds. Basic approaches to computationally processspatial knowledge are sketched out; the role of qualitativereason<strong>in</strong>g <strong>in</strong> AI is compared to the role of qualitative approaches<strong>in</strong> other discipl<strong>in</strong>es. The relative merits of <strong>in</strong>tr<strong>in</strong>sically spatial <strong>and</strong>of more abstract, non-spatial ways of deal<strong>in</strong>g with spatialknowledge are discussed. The role of schematic representation ofspatial knowledge is addressed.1 WHAT IS SPATIAL COGNITION?<strong>Spatial</strong> <strong>Cognition</strong> is concerned with the acquisition, organization,utilization, <strong>and</strong> revision of knowledge about spatial environments.It allows cognitive agents to act <strong>and</strong> <strong>in</strong>teract <strong>in</strong> space <strong>in</strong>telligently<strong>and</strong> to communicate about spatial environments <strong>in</strong> mean<strong>in</strong>gfulways. <strong>Spatial</strong> <strong>and</strong> temporal cognitive capabilities enable humansto manage basic <strong>and</strong> high-level cognitive tasks <strong>in</strong> everyday life.1.1 Natural <strong>and</strong> artificial, real <strong>and</strong> abstractsystemsThe cognitive agents that are <strong>in</strong>vestigated <strong>in</strong> spatial cognition arenatural agents (humans <strong>and</strong> other animals); artificial agents(robots); they may exist <strong>in</strong> the real physical world; or they may beconceived as abstract notions or described by abstract formalisms(simulation programs).The fact that we study such different systems <strong>in</strong> the commonframework of spatial cognition underscores that we are look<strong>in</strong>g forthe underly<strong>in</strong>g <strong>in</strong>formation process<strong>in</strong>g pr<strong>in</strong>ciples shared by thesedifferent systems. In fact, each of the doma<strong>in</strong>s cannot be successfully<strong>in</strong>vestigated on its own, as we lack methods <strong>in</strong> each doma<strong>in</strong>to discover all relevant features. For example, <strong>in</strong> natural systems,we can study behavior, anatomy, physiology, <strong>and</strong> we can performbra<strong>in</strong> imag<strong>in</strong>g studies. However, sometimes we do not know localfunctions of the agent’s neural system <strong>and</strong> we do not know*Cognitive Systems Research Group <strong>and</strong> SFB/TR 8 <strong>Spatial</strong> <strong>Cognition</strong>,Universität Bremen, Germany. Email: freksa@sfbtr8.uni-bremen.dewhether the agent of our <strong>in</strong>vestigation performs a spatial task (<strong>and</strong>if so, which one) <strong>in</strong> a given situation; we cannot validate certa<strong>in</strong>experimental results, as the agents may behave differently due tolearn<strong>in</strong>g or other <strong>in</strong>ternal or external factors beyond our control.Furthermore, different cognitive agents may apply differentstrategies to solve a given task; <strong>in</strong> such cases, we cannot use othercognitive agents to confirm our f<strong>in</strong>d<strong>in</strong>gs. Moreover, for functional<strong>and</strong> / or ethical reasons we are restricted <strong>in</strong> our <strong>in</strong>vestigationmethods.The situation is quite different <strong>in</strong> artificial systems: while wehave precise knowledge of the local structures <strong>and</strong> functionalities,it is frequently difficult to design systems to produce a certa<strong>in</strong>behavior; we may not know which representational <strong>and</strong> computationalparadigm will be most appropriate <strong>and</strong> we may not evenknow the computational task to be performed to achieve a desiredresult. Similarly, <strong>in</strong>vestigations of real <strong>and</strong> abstract systems havedifferent strengths <strong>and</strong> weaknesses which complement each otherrather well. It is always helpful <strong>and</strong> usually most efficient if wecan answer certa<strong>in</strong> questions abstractly; on the other h<strong>and</strong>, <strong>in</strong>vestigationson real systems are required to ask the right questions.While natural systems provide us with <strong>in</strong>spirations aboutpurpose <strong>and</strong> function of cognitive systems, artificial structuresallow us to <strong>in</strong>vestigate processes we cannot or do not want tostudy <strong>in</strong> liv<strong>in</strong>g organisms <strong>and</strong> other <strong>in</strong>tegrated structures. Thus, westudy natural <strong>and</strong> artificial systems both as real physical systems<strong>and</strong> as abstract entities to unveil the secrets of cognitive pr<strong>in</strong>ciples.1.2 An <strong>in</strong>terdiscipl<strong>in</strong>ary enterprise<strong>Spatial</strong> cognition is a subfield of cognitive science. Almost alldiscipl<strong>in</strong>es <strong>in</strong>volved <strong>in</strong> the cognitive science enterprise contributeto spatial cognition: artificial <strong>in</strong>telligence, cognitive psychology,l<strong>in</strong>guistics, philosophy of m<strong>in</strong>d, psychophysics <strong>and</strong> cognitiveneuroscience, cognitive anthropology, mathematics, cognitivegeography <strong>and</strong> cartography, architecture <strong>and</strong> design. Each of thesefields employs specific approaches to uncover certa<strong>in</strong> aspects ofcognitive structures <strong>and</strong> processes. For example, cognitivepsychology studies natural cognitive systems <strong>and</strong> their behaviorby conduct<strong>in</strong>g empirical <strong>in</strong>vestigations <strong>and</strong> analyz<strong>in</strong>g their results;AI studies cognitive functions by construct<strong>in</strong>g formal <strong>and</strong>synthetic structures <strong>and</strong> algorithms <strong>and</strong> empirically test<strong>in</strong>g theirbehavior; <strong>and</strong> l<strong>in</strong>guistics comb<strong>in</strong>es the analysis of naturallanguage with the construction of formal structures to support orrefute theories of spatial language. Geographical <strong>in</strong>formationscience makes use of results from these discipl<strong>in</strong>es [17].The different approaches employed <strong>in</strong> cognitive science can becomb<strong>in</strong>ed rather effectively to ga<strong>in</strong> <strong>in</strong>sight <strong>in</strong>to complete cognitivemechanisms. Philosophers of m<strong>in</strong>d <strong>and</strong> AI researchers <strong>in</strong>vestigate


3 SPACE-BASED CONCEPTREPRESENTATIONCognitive representations can make use of perceptual structuresthat have been developed dur<strong>in</strong>g the process of adaptation to theenvironment. In the space-based approach that will be outl<strong>in</strong>ed <strong>in</strong>this chapter, knowledge is represented <strong>in</strong> terms of environmentrelatedconcepts like <strong>in</strong> front of or beh<strong>in</strong>d that are anchored <strong>in</strong>spatial relations between physical objects <strong>in</strong> the real world, ratherthan <strong>in</strong> terms of general abstract notions like zero or one, on or off,true or false. It has been shown <strong>in</strong> the cognitive science literaturethat explicit semantic connections to the problem doma<strong>in</strong> can beprocessed more appropriately than their logic abstractions [20].3.1 Doma<strong>in</strong>-specific vs. general representationformatWhat difference does the relation to the spatial environmentmake? First of all, we recognize the disadvantage of representationsthat are connected to specific entities: these representationsare not as general as abstract representations that could be <strong>in</strong>stantiatedby arbitrary entities. This is a reason why we <strong>in</strong>troduce theadvantages of algebra over calculus <strong>in</strong> mathematics <strong>and</strong> theexploitation of tautologies over truth table manipulation logics.As long as we deal with complete <strong>and</strong> certa<strong>in</strong> knowledge,abstract representations <strong>in</strong> fact are superior as certa<strong>in</strong> reason<strong>in</strong>gsteps may be taken without reference to the object doma<strong>in</strong>; if weare deal<strong>in</strong>g with <strong>in</strong>complete <strong>and</strong> uncerta<strong>in</strong> knowledge, thesituation may be different. In the follow<strong>in</strong>g, I will consider the useof space-based representations to reason about spatial relations.3.2 Exploit<strong>in</strong>g spatial structures for reason<strong>in</strong>gThe power of abstract reason<strong>in</strong>g does not come for free. Whencognitive agents must reason on the basis of <strong>in</strong>complete oruncerta<strong>in</strong> knowledge – the st<strong>and</strong>ard situation for cognitive agents –they may only be able to draw logic <strong>in</strong>ferences if they cansubstitute for the miss<strong>in</strong>g knowledge by good guesses. Goodguesses may come from a good theory or from well-<strong>in</strong>formedknowledge sources. A good theory may provide default values thatcan support reason<strong>in</strong>g processes <strong>in</strong> st<strong>and</strong>ard situations. A well<strong>in</strong>formedknowledge source may complete miss<strong>in</strong>g knowledge justas needed. The former approach employs underst<strong>and</strong><strong>in</strong>g of thegeneral situation while the latter approach employs <strong>in</strong>formants thatneed not underst<strong>and</strong> what is go<strong>in</strong>g on.3.2.1 World knowledge <strong>and</strong> doma<strong>in</strong> knowledgeThe <strong>in</strong>terest<strong>in</strong>g case is the case of the ‘good theory’. ‘Generalknowledge’ comes <strong>in</strong> two varieties: (1) relat<strong>in</strong>g to the whole, orevery member of a class or category (the mathematical sense of‘general’); <strong>and</strong> (2) be<strong>in</strong>g usually the case; true or applicable <strong>in</strong>most <strong>in</strong>stances, but not all (the colloquial sense of ‘general’). Hereaga<strong>in</strong>, the former is the more <strong>in</strong>terest<strong>in</strong>g: knowledge that alwaysholds will be even more valuable for logic <strong>in</strong>ferences thanknowledge that usually holds. Can we separate the two types ofknowledge?Knowledge that always holds is world knowledge; it expressespr<strong>in</strong>ciples or laws of the world. Knowledge that usually orfrequently holds is doma<strong>in</strong> knowledge. Both types of knowledgeare useful, but if we can separate the two, we may be able todist<strong>in</strong>guish necessary <strong>and</strong> plausible consequences.<strong>Spatial</strong> structures can provide us with knowledge aboutnecessary implications of spatial relations <strong>and</strong> actions. They canbe used to replicate spatial relations <strong>in</strong> the real world <strong>and</strong> thusimplicitly fill <strong>in</strong> miss<strong>in</strong>g relations that we don’t explicitly know.<strong>Spatial</strong> <strong>and</strong> spatio-temporal structures have the advantage of be<strong>in</strong>ggeneral enough to support a large scope of cognitively relevantfeatures <strong>and</strong> phenomena <strong>and</strong> restrictive enough to provide usefulconstra<strong>in</strong>ts for reason<strong>in</strong>g. Our hypothesis is that spatio-temporalphenomena form the basis for our thoughts <strong>and</strong> reason<strong>in</strong>g <strong>and</strong> canbe best supported by a spatio-temporal substrate.3.2.2 Sources of uncerta<strong>in</strong>tyWhen we deal with uncerta<strong>in</strong> knowledge, it is crucial that weunderst<strong>and</strong> the nature of the uncerta<strong>in</strong>ty. Cognitive agents mustlive with only partial knowledge about their environment <strong>and</strong> stilltake the right actions. Lack of knowledge about precise locations,durations, or actions affects local uncerta<strong>in</strong>ty much more than globaluncerta<strong>in</strong>ty. It is known that children learn laws of persistence<strong>and</strong> dynamics at an early age. Knowledge about spatio-temporalcoherence allows cognitive agents to make reliable predictionsdespite miss<strong>in</strong>g knowledge [7]. In our everyday actions <strong>in</strong> trafficetc. we rely on spatio-temporal coherence to control our actions.This <strong>in</strong>sight will enable us to resolve the uncerta<strong>in</strong>ty appropriately.Too abstract representations of the environment may onlytell us about alternative options <strong>in</strong> terms of logical disjunctions;this may be not enough to resolve uncerta<strong>in</strong>ty <strong>in</strong>telligently. Inspatio-temporal worlds, uncerta<strong>in</strong>ty almost always is a function ofspatio-temporal vic<strong>in</strong>ity due to the relevant laws of physics; thus,when we employ spatio-temporal representations that ma<strong>in</strong>ta<strong>in</strong>spatio-temporal coherence, we get <strong>in</strong>formation about vic<strong>in</strong>ity forfree. This <strong>in</strong>formation can be used to resolve perceptual <strong>and</strong><strong>in</strong>ferential uncerta<strong>in</strong>ty.3.3 Reason<strong>in</strong>g about non-spatial relationsIn the previous chapter I have given arguments, why space-basedrepresentations may be useful for reason<strong>in</strong>g about spatialsituations. In the present chapter I will argue that space-basedrepresentations may support cognition beyond the spatial doma<strong>in</strong>.3.3.1 Concept acquisition through perceptual experienceLet us go back to the concept acquisition process I discussed <strong>in</strong>section 2.2. Suppose we have a cognitive agent equipped withspatial concepts but no other concepts about its environment. Howcan children (or adults or artificial cognitive agents) acquire <strong>and</strong>communicate concepts that can not be directly related to thephysical environment through perception? Cognitive agents willbe able to form new concepts related to the environment if (1) aperceptual, (2) a conceptual, or (3) a comb<strong>in</strong>ation of a perceptual<strong>and</strong> a conceptual pattern gives rise to a new concept.In other words, new concepts can be formed if they havesometh<strong>in</strong>g <strong>in</strong> common with exist<strong>in</strong>g concepts or perceptions. Ifthey have everyth<strong>in</strong>g <strong>in</strong> common with exist<strong>in</strong>g concepts, they areno new concepts. If they have noth<strong>in</strong>g <strong>in</strong> common with exist<strong>in</strong>gconcepts, they cannot be related to experiences <strong>and</strong> therefore theycannot be generated. Mathematically speak<strong>in</strong>g, new concepts mustnot be orthogonal to exist<strong>in</strong>g concepts but they must have a certa<strong>in</strong>correspondence / association to exist<strong>in</strong>g ones. This enables us tounderst<strong>and</strong> new concepts <strong>in</strong> terms of established concepts.


3.3.2 Conceptual anchor<strong>in</strong>g non-spatial conceptsIf we assume that the early concepts we form about the world arespatial concepts rooted <strong>in</strong> the physical environment throughperception, it makes sense that we form subsequent concepts onthe basis of spatial concepts, <strong>in</strong> particular concepts that areexperientially related to spatial concepts – for example, temporalconcepts. In our perceptual experience, there is a strongcorrelation between duration <strong>and</strong> spatial distance: longer distancesusually take more time to travel than shorter distances, <strong>and</strong> we useexpressions like ‘it takes long to get there’ which make sense both<strong>in</strong> a spatial <strong>and</strong> <strong>in</strong> a temporal <strong>in</strong>terpretation.But time also passes without any distance be<strong>in</strong>g traveled. Thedifferences between physical distances we can measure with ayard stick <strong>and</strong> the experience that time can pass <strong>in</strong> which we canplay, th<strong>in</strong>k, dream, or wait without physically mov<strong>in</strong>g make itworthwhile to form a new concept ‘duration’. Nevertheless, it isvery hard, if not impossible, to describe temporal duration if wecannot resort to well-understood concepts like spatial distance thatcan be objectively characterized with reference to the physicalenvironment. For example, we can suggest that a given duration isthe time it would take to travel a certa<strong>in</strong> distance by certa<strong>in</strong> means;then we can abstract from the travel<strong>in</strong>g event; everyth<strong>in</strong>g elsebe<strong>in</strong>g equal, the duration persists. In fact, we may imag<strong>in</strong>etemporal durations <strong>in</strong> terms of distances traveled to get a bettergrasp at the concept of duration.3.3.3 The constructive approach <strong>in</strong> cognitionOther concepts like ‘speed’ may be developed accord<strong>in</strong>gly (whichconcept is more basic, ‘duration’ or ‘speed’?) <strong>and</strong> when we have agood h<strong>and</strong>le at everyday physical concepts, even more abstractconcepts may be formed with reference to the exist<strong>in</strong>g ones. Intheir theory of metaphors, Lakoff <strong>and</strong> Johnson [15] give plenty ofexamples that illustrate relationships between different concepts;such examples may serve to build up abstract concept structuresfrom concrete perceptual entities <strong>and</strong> relations. A great feature ofsuch conceptual structures is that we may be able to borrowcalculation or reason<strong>in</strong>g procedures from well-establishedconcepts for use <strong>in</strong> new conceptual structures when we lackappropriate specific <strong>in</strong>ference rules for the new concepts. Forexample, we might add durations as we add spatial distanceswithout formally establish<strong>in</strong>g the adequacy of this operation <strong>in</strong> thetemporal doma<strong>in</strong>, because this may be experientially plausible onthe basis of our experience or knowledge about the spatial doma<strong>in</strong>.In this way, conceptual systems <strong>in</strong>clud<strong>in</strong>g their <strong>in</strong>ferentialmechanisms can be bootstrapped from basic pr<strong>in</strong>ciples.4 SPATIAL COGNITION IN AIAfter provid<strong>in</strong>g arguments why spatial concepts are uniquelyfundamental for cognition, I will outl<strong>in</strong>e how spatial conceptshave been formalized for model<strong>in</strong>g <strong>and</strong> underst<strong>and</strong><strong>in</strong>g spatialcognition <strong>in</strong> AI research.4.1 Basic conceptsA fundamental <strong>in</strong>sight <strong>in</strong>to concept formation <strong>in</strong> cognitive systemsis that new concepts are formed if dist<strong>in</strong>ctions are helpful ornecessary. Conversely, the dist<strong>in</strong>ction of concepts or notionswhich do not make a significant difference <strong>in</strong> the given context isavoided. This appears to be an element of cognitive economy. Forknowledge representation <strong>in</strong> AI this means that concepts should berepresented at the coarsest feasible rather than on the f<strong>in</strong>estpossible level.The pr<strong>in</strong>ciple of us<strong>in</strong>g coarse representations appears to be <strong>in</strong>conflict with an eng<strong>in</strong>eer<strong>in</strong>g pr<strong>in</strong>ciple dem<strong>and</strong><strong>in</strong>g the use of themost precise <strong>in</strong>formation available. In cognitive systems thisconflict surfaces when we face the question how to representperceptual <strong>in</strong>formation for spatial reason<strong>in</strong>g. After all, our eyes<strong>and</strong> other visual sensors provide rather precise <strong>in</strong>formation aboutthe spatial environment over the entire perceptual range. Incomputer vision, the eng<strong>in</strong>eer<strong>in</strong>g approach has been followed for along time: ‘why should we throw away <strong>in</strong>formation our sensorsprovide’ was a common statement <strong>in</strong> computer vision. Currentdevelopments with almost arbitrary availability of storage capacitytend to support this view.Nevertheless, I propose a different approach. Our researchquestion is: ‘which <strong>in</strong>formation is necessary to answer a givenquestion?’ This question is geared towards unveil<strong>in</strong>g cognitivepr<strong>in</strong>ciples – <strong>in</strong>clud<strong>in</strong>g the limits of their operation. In addition, we<strong>in</strong>vestigate how to exploit redundant knowledge to make cognitivesystems robust.4.2 Qualitative reason<strong>in</strong>gQualitative reason<strong>in</strong>g has been a topic <strong>in</strong> AI for a quarter century.‘Qualitative’ is contrasted here to ‘quantitative’ or ‘metric’. Qualitativerepresentations dist<strong>in</strong>guish conceptual categories rather thanmeasures. The simplest qualitative classification is obta<strong>in</strong>ed bycompar<strong>in</strong>g measurements <strong>in</strong> terms of less than (). The basic idea of qualitative reason<strong>in</strong>g is that weuse low-resolution representations to describe the essence of thestate of affairs. From a cognitive perspective, this difference hasimportant implications: while quantitative approaches need notcare about the relation of the values to the represented environment,qualitative values depend on their mean<strong>in</strong>g <strong>and</strong> their role <strong>in</strong>the represented world.It may be <strong>in</strong>terest<strong>in</strong>g to note that <strong>in</strong> the empirical sciences,qualitative descriptions are considered <strong>in</strong>ferior to quantitativedescriptions; this is, of course, due to the fact that it is muchharder to develop models that make quantitative predictions thanmodels that provide qualitative descriptions; if I have quantitative<strong>in</strong>formation I can derive the qualitative <strong>in</strong>formation.In qualitative reason<strong>in</strong>g, the situation is different: as we needrepresentations not only to describe values but also to <strong>in</strong>fer newconfigurations, we cannot rely on the translation of arbitrarynumerical values <strong>in</strong>to qualitative categories; <strong>in</strong>stead, the ma<strong>in</strong>focus is on develop<strong>in</strong>g suitable conceptual frameworks that allowfor <strong>in</strong>ferr<strong>in</strong>g mean<strong>in</strong>gful <strong>in</strong>formation from mean<strong>in</strong>gful premises.This suggests that we might need a new representation for eachnew problem area, as for each k<strong>in</strong>d of task the relevant qualitiesmay differ. To overcome this problem, we must identify generalpr<strong>in</strong>ciples for qualitative reason<strong>in</strong>g that can be useful for a widescope of problems. Where can we f<strong>in</strong>d such general pr<strong>in</strong>ciples?Right! – If we believe that space <strong>and</strong> time provide generalstructures for cognition as these are needed for <strong>in</strong>terfac<strong>in</strong>gpercepts <strong>and</strong> concepts, we should expect to f<strong>in</strong>d these structures <strong>in</strong>space <strong>and</strong> time – if anywhere. It therefore may not be surpris<strong>in</strong>gthat space <strong>and</strong> time were among the first doma<strong>in</strong>s successfullyexplored for qualitative reason<strong>in</strong>g.


4.3 Qualitative temporal reason<strong>in</strong>gIn our commonsense conceptualizations, the temporal doma<strong>in</strong>appears simpler than the spatial doma<strong>in</strong>: the simplest conception isthat of a directed time-l<strong>in</strong>e with totally ordered time po<strong>in</strong>ts. Timepo<strong>in</strong>ts correspond to temporal <strong>in</strong>stants. Usually, we are more <strong>in</strong>terested<strong>in</strong> events than <strong>in</strong> <strong>in</strong>stants <strong>and</strong> events stretch over a time span.The philosopher Hambl<strong>in</strong> became <strong>in</strong>terested <strong>in</strong> temporal relationsbetween <strong>in</strong>tervals. He described thirteen mutually exclusive relationsbetween <strong>in</strong>tervals that exhaustively characterize the relationsthat can hold between two temporal <strong>in</strong>tervals [14]. Ten years later,Allen <strong>in</strong>dependently discovered these relations <strong>and</strong> developed acalculus of qualitative temporal relations [1]; the thirteen relationsbecame widely known as ‘Allen relations’ <strong>in</strong> the AI community.Allen’s calculus has become a wonderful tool to reason abouttemporal relations of events on arbitrary levels of eventhierarchies <strong>and</strong> across levels – <strong>and</strong> for this, only comparisons ofmean<strong>in</strong>gful entities (events) <strong>and</strong> no quantitative (external)measurements are required [9].4.4 Qualitative spatial reason<strong>in</strong>gIf space is cognitively more fundamental than time, we needcalculi for spatial reason<strong>in</strong>g. The idea is to process spatial<strong>in</strong>formation directly without deriv<strong>in</strong>g spatial notions from moregeneral, abstract notions. Geometry allows us to compute spatialrelations from quantitative measurements. In qualitative spatialreason<strong>in</strong>g we want to <strong>in</strong>fer spatial relations on the basis ofqualitative concepts <strong>in</strong>stead.Like temporal events, spatial entities form hierarchies:neighbor<strong>in</strong>g spatial objects can be aggregated to form largerspatial objects or spaces. Therefore, the spatial doma<strong>in</strong> appears tobe suitable for the exploitation of general spatial conceptualization<strong>and</strong> comput<strong>in</strong>g pr<strong>in</strong>ciples. As it turns out, there are many moremean<strong>in</strong>gful ways to conceptualize <strong>and</strong> qualitatively representcommonsense space than time: space can be conceptualized <strong>in</strong>terms of three spatial dimensions, <strong>in</strong> terms of topological <strong>and</strong>order<strong>in</strong>g relationships, <strong>in</strong> terms of distance <strong>and</strong> orientationrelations. In addition, we employ a variety of reference systems:absolute, <strong>in</strong>tr<strong>in</strong>sic, relative, to use Lev<strong>in</strong>son’s classification. [16].Thus, we face the challenge of deal<strong>in</strong>g not with THErepresentation of space but with many representations of space<strong>and</strong> their <strong>in</strong>terrelationships. We must <strong>in</strong>vestigate the <strong>in</strong>tegration ofspatial representations <strong>and</strong> process<strong>in</strong>g mechanisms <strong>and</strong> the use ofspatial knowledge as a resource for solv<strong>in</strong>g complex spatialproblems [3].5 SPATIAL AND CONCEPTUALNEIGHBORHOODNeighborhood is a very important notion that helps us to structure<strong>and</strong> to comprehend the world around us <strong>and</strong> to help us to underst<strong>and</strong>what is go<strong>in</strong>g on <strong>in</strong> it. Neighborhoods come <strong>in</strong>to existenceby group<strong>in</strong>g nearby objects <strong>and</strong> possibly separat<strong>in</strong>g them fromother objects. On the discrete level of concepts, neighborhoodcorresponds to cont<strong>in</strong>uity on the geometric or physical level ofdescription: cont<strong>in</strong>uous processes or events map onto identical orneighbor<strong>in</strong>g classes of descriptions.Neighborhoods are <strong>in</strong>terest<strong>in</strong>g <strong>in</strong>formation structures, asneighborhoods can be formed recursively <strong>and</strong> represented byhierarchical tree or lattice structures.In its most basic form, a hierarchy is a spatial structure, <strong>and</strong> theconstitut<strong>in</strong>g nearness is a spatial distance. <strong>Spatial</strong> neighborhoodsare very natural perceptual <strong>and</strong> cognitive entities as they areformed ‘automatically’ <strong>in</strong> front of our eyes when we move awayfrom spatial configurations of objects. This is, because perceptualsystems have limited spatial resolution <strong>and</strong> merge spatially neighbor<strong>in</strong>gobjects. This is supported by the fact that perception organsthemselves are organized spatially – neighbor<strong>in</strong>g ret<strong>in</strong>al cells aresensitive to spatially neighbor<strong>in</strong>g stimuli. This spatial organizationis ma<strong>in</strong>ta<strong>in</strong>ed <strong>and</strong> supported by many neural structures <strong>in</strong> bra<strong>in</strong>s.Neighborhoods also play an important role beyond the purelyspatial doma<strong>in</strong>. Other neighborhood structures can be derivedfrom spatial neighborhoods, for example temporal neighborhood.In the context of reason<strong>in</strong>g, ‘conceptual neighborhood’ isparticularly <strong>in</strong>terest<strong>in</strong>g. Conceptual neighborhood is def<strong>in</strong>ed as astructure on relations (rather than on objects or their locations):two (spatial, temporal, or other) relations are conceptual neighborsif they can be directly transformed <strong>in</strong>to one another by a m<strong>in</strong>imalchange <strong>in</strong> the underly<strong>in</strong>g world (i.e., if no other <strong>in</strong>termediaterelation will hold <strong>in</strong> between).Conceptual neighborhoods reflect operations <strong>and</strong> transitions <strong>in</strong>the represented reference world: only transitions that are possible<strong>in</strong> the reference world become conceptual neighbors. Thus, aworld of rigid objects has a different conceptual neighborhoodstructure than a world with elastic objects or a world <strong>in</strong> whichobjects can be beamed to remote locations without reach<strong>in</strong>g<strong>in</strong>termediate locations. In other words, the conceptualneighborhood structure of an environment ma<strong>in</strong>ta<strong>in</strong>s the (physicalor geometric) laws that govern this environment. In this way, itma<strong>in</strong>ta<strong>in</strong>s the <strong>in</strong>tegrity of the represented world <strong>and</strong> therefore it isa good basis for reason<strong>in</strong>g about operations <strong>and</strong> events <strong>in</strong> thisworld.A ma<strong>in</strong> feature of conceptual neighborhood structures is thatthey can be used to control the complexity of reason<strong>in</strong>g processes:if the reason<strong>in</strong>g follows the structures established by theoperations <strong>in</strong> the world, expensive computational operations canbe avoided that would be carried out <strong>in</strong> a more abstract reason<strong>in</strong>gsystem. In some cases, a lower complexity class may be achievedthrough neighborhood reason<strong>in</strong>g [8, 9, 18].6 SPATIAL AND NON-SPATIALREPRESENTATIONS OF SPACEIn this paper I have argued <strong>in</strong> favor of representations <strong>and</strong> reason<strong>in</strong>gprocesses for cognitive systems that ma<strong>in</strong>ta<strong>in</strong> <strong>and</strong> make useof spatial structures. So far, I discussed <strong>in</strong>ternal representations ofspatial environments; I will now turn to external representationsthat are equally important for cognitive systems.6.1 External representations of spatialknowledgeIntelligent processes are not only due to <strong>in</strong>telligent reason<strong>in</strong>gprocesses but also the result of successful <strong>in</strong>teraction of cognitivesystems with their environment. In particular, cognitive agents canresort to ‘knowledge <strong>in</strong> the world’ when they have smart sensorysystems that can access relevant <strong>in</strong>formation on dem<strong>and</strong>. Thus, theenvironment itself may partly replace representations that wouldbe otherwise required [6]. The spatial environment itself featuresall the nice spatial properties we discuss <strong>in</strong> this paper.


Us<strong>in</strong>g the environment <strong>in</strong>stead of a representation hasadvantages <strong>and</strong> disadvantages. The greatest advantage of the‘representation <strong>in</strong> the world’ is that it is the most truthful <strong>and</strong>complete knowledge source we can possibly have; it is ‘merely’ amatter of perception to access this knowledge. Another advantageis that the knowledge is <strong>in</strong>tr<strong>in</strong>sically related to the objectsconcerned.On the other h<strong>and</strong>, ‘knowledge <strong>in</strong> the world’ is unprocessed<strong>in</strong>formation that does not conta<strong>in</strong> any <strong>in</strong>sights regard<strong>in</strong>g theenvironment; it therefore is not knowledge <strong>in</strong> a strict sense. The<strong>in</strong>tr<strong>in</strong>sic connection between objects <strong>in</strong> the world <strong>and</strong> <strong>in</strong>formationabout these objects also can be a serious disadvantage: theknowledge may not be where the agent is <strong>and</strong> it may be hard forthe agent to access the knowledge, as the environment may belarge or <strong>in</strong>accessible. Specifically, this concerns situations wherethe effort of plann<strong>in</strong>g is worthwhile, as abstract plann<strong>in</strong>g would beless expensive than trial <strong>and</strong> error <strong>in</strong> the real environment.But there are <strong>in</strong>termediate avenues between ‘knowledge <strong>in</strong> thehead’ <strong>and</strong> ‘knowledge <strong>in</strong> the world’ that can be taken. One optionis to place preprocessed <strong>in</strong>formation <strong>in</strong> the world, for examplesymbolic classifications like street classifications or street names.Another option is the creation of a separate externalization ofknowledge about the world that utilizes some of the advantageswhile avoid<strong>in</strong>g some of the disadvantages of the ‘knowledge <strong>in</strong> theworld’.A well-known example of an external representation of aspatial environment is a geographic map: it ma<strong>in</strong>ta<strong>in</strong>s certa<strong>in</strong>aspects of the spatial structure of the real environment while at thesame time it avoids some of the disadvantages: map <strong>in</strong>formationshould be more easily accessible than the real environment; due toscal<strong>in</strong>g it may provide a better overview of the environment thanthe environment itself; it may conta<strong>in</strong> preprocessed knowledge –<strong>in</strong> particular: aspectualized knowledge that emphasizes certa<strong>in</strong>aspects <strong>and</strong> ignores others [4].6.2 L<strong>in</strong>guistic representations of spatialknowledgeWhile spatially structured knowledge has numerous advantages,we must not forget the advantages of more abstract propositional(e.g. l<strong>in</strong>guistic) representations. While spatially structuredrepresentations can express some uncerta<strong>in</strong>ty, they admit littleambiguity. Language, on the other h<strong>and</strong>, is capable of express<strong>in</strong>gambiguity, conflict<strong>in</strong>g <strong>in</strong>formation, <strong>and</strong> meta-knowledge rathereasily. The capability of overcom<strong>in</strong>g spatial constra<strong>in</strong>ts is a featurethat may be particularly desirable, <strong>in</strong> certa<strong>in</strong> situations.Intr<strong>in</strong>sically spatial representations <strong>and</strong> non-spatial representationscomplement each other very well. Good examples for thisare geographic maps: imag<strong>in</strong>e a map without labels or a legend(they are suitable only to test spatial knowledge, but not to providespatial knowledge) or legends / city street <strong>in</strong>dices without maps(these are useful only to f<strong>in</strong>d out about the existence of streets <strong>in</strong> acity, but not about their spatial location).A question sometimes asked about wayf<strong>in</strong>d<strong>in</strong>g is “what isbetter, a map or a l<strong>in</strong>guistic route description?” This question canbe answered rather well <strong>in</strong> the context of particular circumstances.For example, maps have much more general use as they representa large number of routes while l<strong>in</strong>guistic descriptions usuallyrepresent one particular route; on the other h<strong>and</strong>: maps need to be<strong>in</strong>terpreted while l<strong>in</strong>guistic descriptions are suitable to represent<strong>in</strong>terpretations such that <strong>in</strong>structions can be directly executed [10].Nevertheless, the question for the better of two alternativeserroneously suggests that I can either have one or the other, butnot both. However, the best representations frequently are<strong>in</strong>tegrated hybrid representations that comb<strong>in</strong>e the advantages ofvarious approaches. For example, a map provides the spatialbackground with a strong structural correspondence to the targetdoma<strong>in</strong> while the l<strong>in</strong>guistic <strong>in</strong>formation may provide useful meta<strong>in</strong>formationthat connects to the spatial background but uses itsown <strong>in</strong>struments to be most effective.7 SPATIAL SCHEMATIZATIONIn this last chapter, I will discuss a form of spatial representationthat comb<strong>in</strong>es features of <strong>in</strong>tr<strong>in</strong>sically spatial forms of representationwith features of l<strong>in</strong>guistic representations.Schematic maps like subway maps ma<strong>in</strong>ta<strong>in</strong> certa<strong>in</strong> aspects ofspatial structures while relax<strong>in</strong>g others. While all geographic mapsdistort spatial relations of the environment to some extent due torepresentational constra<strong>in</strong>ts <strong>in</strong> the spatial medium map, schematicmaps <strong>in</strong>tentionally distort spatial relations to emphasize ordeemphasize certa<strong>in</strong> features of the represented environment.Specifically, topological relations are fully ma<strong>in</strong>ta<strong>in</strong>ed whiledistance <strong>and</strong> orientation <strong>in</strong>formation is relaxed. The ma<strong>in</strong>objective <strong>in</strong> the schematization process is the elim<strong>in</strong>ation ofdecision-irrelevant features, especially curves, to reduce the mapsto the essential structures that will be helpful for solv<strong>in</strong>g specifictasks – <strong>in</strong> particular wayf<strong>in</strong>d<strong>in</strong>g tasks. The goal is to reduce thecognitive load on the map user by elim<strong>in</strong>at<strong>in</strong>g distract<strong>in</strong>g features.Schematic maps are well suited to represent qualitative spatialconcepts. The orientation of a l<strong>in</strong>e on the map may correspond to ageneral orientation (or category of orientations) <strong>in</strong> the environment;a distance on the map may correspond to the number oftra<strong>in</strong> stops, rather than to the metric distance <strong>in</strong> the environment,etc. [4, 13].If we consider a physical spatial environment as constitut<strong>in</strong>gone extreme of a hypothetical cont<strong>in</strong>uum <strong>and</strong> abstract mentalconcepts of the spatial world as the other extreme, we cansequence different types of representations of spatial doma<strong>in</strong>s.Mov<strong>in</strong>g from the physical spatial environment towards abstractconcepts, we obta<strong>in</strong> a mild abstraction by tak<strong>in</strong>g a visual image(e.g. a photograph) that preserves important spatial relations.Mov<strong>in</strong>g a few steps further, we may get a topographic map <strong>in</strong>which objects have been identified <strong>and</strong> spatial relations from thereal environment are ma<strong>in</strong>ta<strong>in</strong>ed. Further abstraction may lead to aschematic map.Mov<strong>in</strong>g from the other extreme, abstract mental concepts canbe manifested most easily by verbal descriptions. When we move<strong>in</strong> the hypothetical cont<strong>in</strong>uum closer to the physical manifestationof the world, we can put concepts of spatial objects <strong>and</strong> relations<strong>in</strong>to a sketch map to convey selected spatial relations. Sketchmaps tend to have close correspondences to verbal descriptions<strong>and</strong> they are used to augment verbal descriptions by spatialconfigurations from the physical world.In this framework, schematic maps differ from sketch maps <strong>in</strong>that they are derived from topographic maps that are meant torepresent a certa<strong>in</strong> part of the environment completely, at a givengranularity level. Sketch maps, on the other h<strong>and</strong>, usuallycorrespond to the l<strong>in</strong>ear flow of speak<strong>in</strong>g <strong>and</strong> draw<strong>in</strong>g <strong>and</strong>frequently to the temporal sequence of route traversal. Thus,schematic maps provide <strong>in</strong>formation about a region while sketchmaps more typically provide <strong>in</strong>formation about a s<strong>in</strong>gle route or


about a small set of routes. However, there is no sharp boundarybetween schematic maps <strong>and</strong> sketch maps as schematic maps maybe <strong>in</strong>complete <strong>and</strong> sketch maps may be unusually elaborate.8 CONCLUSION<strong>Spatial</strong> cognition is a fundamental cognitive capability whichserves as conceptual foundation for other cognitive capabilities.Through the connection between a variety of specific spatialsensors on one h<strong>and</strong> <strong>and</strong> general process<strong>in</strong>g structures on the otherh<strong>and</strong>, spatial cognition establishes an <strong>in</strong>terface between physicalspatial environments <strong>and</strong> abstract <strong>in</strong>formation structures.<strong>Spatial</strong> cognition concerns the entire sensory – cognition –motor – environment loop <strong>in</strong>clud<strong>in</strong>g the registration of spatialrelationships, the <strong>in</strong>ternal <strong>and</strong> external representation of spatialknowledge, the abstraction of spatial knowledge, the classification<strong>and</strong> match<strong>in</strong>g of spatial <strong>and</strong> abstract structures, the transformationbetween spatial reference systems, the adaptation to effectors thatact <strong>in</strong> <strong>and</strong> manipulate the spatial environment, <strong>and</strong> the <strong>in</strong>teractionbetween cognitive agents. Thus, it can be viewed as exemplary forgeneral cognition processes. The fact that spatial knowledgestructures have strong l<strong>in</strong>ks to physical structures that can beaccessed <strong>and</strong> evaluated by objective means supports the use ofscientific research methods.The spatial doma<strong>in</strong> also is particularly <strong>in</strong>terest<strong>in</strong>g as a doma<strong>in</strong>for explor<strong>in</strong>g imprecise, <strong>in</strong>complete, uncerta<strong>in</strong>, coarse, <strong>and</strong>conflict<strong>in</strong>g knowledge. These attributes can be related to physicalperception processes; this allows us to provide physicalexplanation models for the formalization of this k<strong>in</strong>d ofknowledge. The physical doma<strong>in</strong> can play a similar role <strong>in</strong>cognitive systems as logics plays <strong>in</strong> formal systems, as ourunderst<strong>and</strong><strong>in</strong>g of simple physical systems is comparable to ourunderst<strong>and</strong><strong>in</strong>g of simple logic systems.As natural cognitive systems are understood to a degree whereat least partial functionality can be replicated, powerful computersystems are available that can keep up with natural computation,on certa<strong>in</strong> levels, <strong>and</strong> robot <strong>and</strong> multimodal <strong>in</strong>teraction devicesbecome more <strong>and</strong> more sophisticated, high-level spatial cognitivefunctions can be explored by a constructive approach <strong>and</strong> newcapabilities can be <strong>in</strong>tegrated <strong>in</strong>to artificial cognitive agents.If we ma<strong>in</strong>ta<strong>in</strong> a close relation between human spatial concepts<strong>and</strong> spatial concepts we use for our artificial agents, we supportthe communication between human <strong>and</strong> artificial cognitive agents.In this way, we support the development of spatial assistancesystems that complement rather than replace human cognitiveabilities.ACKNOWLEDGMENTSI acknowledge critical <strong>and</strong> constructive comments by ThomasBarkowsky. I am grateful for support for the TransregionalCollaborative Research Center <strong>Spatial</strong> <strong>Cognition</strong>: Reason<strong>in</strong>g,Action, Interaction (SFB/TR 8) provided by the DeutscheForschungsgeme<strong>in</strong>schaft. I am also grateful for support for theInternational Quality Network on <strong>Spatial</strong> <strong>Cognition</strong> provided bythe German Academic Exchange Service (DAAD).REFERENCES[1] J.F. Allen, Ma<strong>in</strong>ta<strong>in</strong><strong>in</strong>g knowledge about temporal <strong>in</strong>tervals, CACM26 (11) (1983) 832-843.[2] J. Ayers, J.L. Davis, <strong>and</strong> A. Rudolph, eds., Neurotechnology forbiomimetic robots, MIT Press, Cambridge, MA, 2002.[3] T. Barkowsky, The Transregional Collaborative Research Center, KI1/2004, 34-36.[4] B. Berendt, T. Barkowsky, C. Freksa, <strong>and</strong> S. Kelter, <strong>Spatial</strong>representation with aspect maps, <strong>in</strong> C. Freksa, C. Habel, <strong>and</strong> K.F.Wender, eds., <strong>Spatial</strong> cognition – an <strong>in</strong>terdiscipl<strong>in</strong>ary approach torepresent<strong>in</strong>g <strong>and</strong> process<strong>in</strong>g spatial knowledge, 313-336, LNAI 1404,Spr<strong>in</strong>ger, Berl<strong>in</strong> 1998.[5] V. Braitenberg, Vehicles: Experiments <strong>in</strong> synthetic psychology, MITPress, Cambridge, MA, 1984.[6] R.A. Brooks, <strong>Intelligence</strong> without representation, <strong>Artificial</strong> <strong>Intelligence</strong>47, 1991, 139-159.[7] C. Freksa, Qualitative spatial reason<strong>in</strong>g, <strong>in</strong> D.M. Mark <strong>and</strong> A.U.Frank, eds., Cognitive <strong>and</strong> l<strong>in</strong>guistic aspects of geographic space,361-372, Kluwer, Dordrecht 1991.[8] C. Freksa, Conceptual neighborhood <strong>and</strong> its role <strong>in</strong> temporal <strong>and</strong>spatial reason<strong>in</strong>g, <strong>in</strong> M. S<strong>in</strong>gh, L. Travé-Massuyès, eds, Decisionsupport systems <strong>and</strong> qualitative reason<strong>in</strong>g, 181-187, North-Holl<strong>and</strong>,Amsterdam 1991.[9] C. Freksa, Temporal reason<strong>in</strong>g based on semi-<strong>in</strong>tervals, <strong>Artificial</strong><strong>Intelligence</strong> 54 (1992) 199-227.[10] C. Freksa, <strong>Spatial</strong> aspects of task-specific wayf<strong>in</strong>d<strong>in</strong>g maps: Arepresentation-theoretic perspective, <strong>in</strong> J.S. Gero <strong>and</strong> B. Tversky, eds.,Visual <strong>and</strong> <strong>Spatial</strong> Reason<strong>in</strong>g <strong>in</strong> Design, 15-32, Key Centre of DesignComput<strong>in</strong>g <strong>and</strong> <strong>Cognition</strong>, University of Sydney, 1999.[11] C. Freksa <strong>and</strong> T. Barkowsky, On the relation between spatial concepts<strong>and</strong> geographic objects, <strong>in</strong> P. Burrough <strong>and</strong> A. Frank, eds.,Geographic objects with <strong>in</strong>determ<strong>in</strong>ate boundaries, 109-121, Taylor<strong>and</strong> Francis, London 1996.[12] C. Freksa <strong>and</strong> C. Habel, Warum <strong>in</strong>teressiert sich die Kognitionsforschungfür die Darstellung räumlichen Wissens? <strong>in</strong> C. Freksa <strong>and</strong>C. Habel, Hg, Repräsentation und Verarbeitung räumlichen Wissens,1-15, Spr<strong>in</strong>ger, Berl<strong>in</strong> 1990.[13] C. Freksa, R. Moratz, <strong>and</strong> T. Barkowsky, Robot navigation withschematic maps, Intelligent Autonomous Systems 6, 809-816, IOSPress, 2000.[14] C.L. Hambl<strong>in</strong>, Instants <strong>and</strong> <strong>in</strong>tervals, <strong>in</strong>: J.T. Fraser, F.C. Haber, <strong>and</strong>G.H. Müller, eds., The study of time, Spr<strong>in</strong>ger, Berl<strong>in</strong>, 1972, 324-331.[15] G. Lakoff <strong>and</strong> M. Johnson, Metaphors we live by. University ofChicago Press, Chicago, 1980.[16] S.C. Lev<strong>in</strong>son, Frames of reference <strong>and</strong> Molyneux’s question:crossl<strong>in</strong>guistic evidence, <strong>in</strong> P. Bloom, M. Peterson, L. Nadel, <strong>and</strong> M.Garrett, eds, Language <strong>and</strong> Space, 109–169. MIT Press, Cambridge,MA 1996.[17] D.M. Mark, C. Freksa, S.C. Hirtle, R. Lloyd, <strong>and</strong> B. Tversky,Cognitive Models of Geographic Space, Int. J. of GeographicalInformation Science 13 (1999), 8, 747-774.[18] B. Nebel <strong>and</strong> H.-J. Bürckert: Reason<strong>in</strong>g about temporal relations: amaximal tractable subclass of Allen's <strong>in</strong>terval algebra. Proc. AAAI1994: 356-361.[19] R. Pfeifer <strong>and</strong> C. Scheier, Underst<strong>and</strong><strong>in</strong>g <strong>in</strong>telligence, MIT Press,Cambridge, MA, 1999.[20] D.E. Rumelhart <strong>and</strong> D.A Norman, Representation <strong>in</strong> memory. In R.C.Attk<strong>in</strong>son, R.J. Hemste<strong>in</strong>, G. L<strong>in</strong>dsey, <strong>and</strong> R.D. Luce, eds., Steven'sh<strong>and</strong>book of experimental psychology, 511-587, 2 nd ed., John Wileys& Sons Ltd, New York, 1988.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!