10.05.2014 Views

annual report 2004 - Örebro universitet

annual report 2004 - Örebro universitet

annual report 2004 - Örebro universitet

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

Annual Report <strong>2004</strong><br />

Örebro <strong>universitet</strong> Örebro University<br />

Institutionen för teknik Department of technology<br />

701 82 Örebro SE-701 82 Örebro, Sweden


Annual Report <strong>2004</strong> 1<br />

Contents<br />

SUMMARY 2<br />

PREFACE 3<br />

1. CENTER FOR APPLIED AUTONOMOUS SENSOR SYSTEMS (AASS) 5<br />

1.1 ORGANISATION 9<br />

1.2 MANAGEMENT 12<br />

1.3 FUNDING 14<br />

1.4 UNDERGRADUATE EDUCATION 16<br />

1.5 GRADUATE EDUCATION 18<br />

1.6 CO-OPERATION 23<br />

1.7 DISSIMINATION OF INFORMATION 28<br />

2 RESEARCH LABS 34<br />

2.1 BIOLOGICAL INSPIRED SYSTEMS LAB 35<br />

2.2 MOBILE ROBOTICS LAB 42<br />

2.3 INTELLIGENT CONTROL LAB 56<br />

2.4. LEARNING SYSTEMS LAB 68<br />

3. PUBLICATIONS 80<br />

3.1 BOOKS (INCL. PHD/LIC THESIS) AND EDITED VOLUMES 80<br />

3.2 CHAPTERS IN EDITED VOLUMES 80<br />

3.3 JOURNALS 80<br />

3.4 CONFERENCE PAPERS 81<br />

3.5 WORKSHOP AND SYMPOSIUM PAPERS 82


2 AASS – Center for Applied Autonomous Sensor Systems<br />

Summary<br />

The Applied Autonomous Sensor Systems Centre (AASS) organizes all research and graduate<br />

education in the area of Autonomous Systems and also is responsible for the undergraduate<br />

and MSc programs in Computer Engineering (Datateknik) at the Dept. of Technology, at<br />

Örebro University, Örebro, Sweden. The research effort has a pronounced interdisciplinary<br />

character being a fusion of a variety of disciplines from Systems and Control, Measurement<br />

Technology and Sensors, Computer Science and Artificial Intelligence, and Operations<br />

Research but, with emphasis on Intelligent Control and Sensors, Machine Learning, Planning<br />

and Automated Reasoning, and Biologically Inspired Systems. The Applied Autonomous<br />

Sensor Systems Centre is organized in four laboratories, responsible for research and graduate<br />

education in their respective areas:<br />

1. Biologically Inspired Systems Laboratory (BIS)<br />

2. Mobile Robotics Laboratory (MR)<br />

3. Intelligent Control Laboratory (IC)<br />

4. Learning Systems Laboratory (LS)<br />

The common research focus for the four research laboratories is the subject of perception<br />

and autonomy in diverse un- and/or semi-structured environments. This subject is<br />

pursued using a common research methodology, which is strictly applied: all technologies<br />

under investigation should answer actual needs that emerge from an application, and their<br />

effectiveness is always validated on the application. Applications considered by AASS<br />

include mobile platforms, e.g., mobile robots, and immobile platforms, e.g., industrial plants<br />

and processes.<br />

This <strong>report</strong> presents AASS organization and management, developments in education, research<br />

and industrial co-operation, activities within the national/international research community, and<br />

various forms of societal interaction that have taken place in year <strong>2004</strong>. In this context, some<br />

important developments that characterize year <strong>2004</strong> are as follows:<br />

• Control and systems (Reglerteknik) was approved as a separate study program<br />

(forskarutbildningsämne) in graduate education. Prof. I. Kalaykov (IC Lab, AASS) is<br />

responsible for the new program and two Ph.D. students were already admitted in it.<br />

• AASS started an international cooperation under the framework of the "Ubiquitous robot<br />

companion" program, sponsored by the Korean government through its research agency<br />

ETRI. This is one of the most ambitious public programs in cognitive robotics in the world<br />

today.<br />

• S. Coradeschi has obtained a three-year grant from Vetenskapradet for the project<br />

"Anchoring Symbols to Sensor Data". This was the only 3-year grant awarded by<br />

Vetenskapsrådet to Örebro University this year.<br />

• During 2003/<strong>2004</strong> the BIS lab underwent re-organization, including changes in its staff<br />

and research directions. As a result, the BIS lab has now streamlined its activities within<br />

two related research directions: biologically inspired sensing and dexterous manipulation.


Annual Report <strong>2004</strong> 3<br />

Preface<br />

The Centre for Applied Autonomous Sensor Systems (AASS) was formally established in<br />

1996 at the Department of Technology with a grant from the KK-Foundation aimed at<br />

establishing the basis for a concentrated effort on interdisciplinary research in the area of<br />

Autonomous Systems with contributions to education. In the period 1996-<strong>2004</strong>, AASS has<br />

developed from a research group of 2 researchers and 2 PhD students to a full-fledged<br />

research centre with 4 professors, 2 associated professor (docent), 2 visiting professor (from<br />

industry), 4 researchers (PhD), 24 Ph.D. students, and technical and administrative personnel<br />

of 6. Now AASS plays an important educational role within the Department of Technology as<br />

well as has a leading position in the 4th strategic research profile of Örebro University –<br />

“Human senses, autonomous sensor systems, and industrial processes”.<br />

It also has achieved national/international recognition for its research results, established wellfunctioning<br />

industrial co-operation, and strong industrial presence with its participation in the<br />

Robotdalen - the largest Swedish 10-year innovation program in robotics funded by industry<br />

and the state innovation agency VINNOVA with the amount of 200 M SEK. In the context of<br />

these achievements, AASS has, during year <strong>2004</strong>, also had a measurable societal impact in a<br />

number of ways such as<br />

1. Industrial relevance: Partner in large-scale industrial projects with Atlas Copco Rock<br />

Drills AB (Örebro), ESAB AB (Laxå), Volvo Construction equipment AB (Eskilstuna),<br />

and Optab-Optronikinnovation AB (Karlskoga).<br />

2. European dimension: Co-operation within two EC research networks (EURON, and<br />

CLAWAR II) and a coordinator for EU FP5 Marie Curie Training Site.<br />

3. World dimension: AASS started an international cooperation under the framework of the<br />

"Ubiquitous robot companion" program, sponsored by the Korean government through its<br />

research agency ETRI. This is one of the most ambitious public programs in cognitive<br />

robotics in the world today.<br />

4. National dimension: Founding member of the VINNVÄXT/VINNOVA 10-year national<br />

innovation program "Robotdalen" together with MdH Mälardalen, and a large number of<br />

industrial and societal partners and public bodies.<br />

5. Public acceptance: responsible for the implementation of the Robotdalen project<br />

“Technology transfer and competence development (Teknikspridning och kompetenshöjning)''<br />

for the Örebro-node of Robotdalen.<br />

However, our most important contribution with long-term societal impact is our educational<br />

activity. Improving the content, quality, and degree-level of the undergraduate education in<br />

the Department of Technology in general and in Computer Engineering in particular is of<br />

highest priority. Thus undergraduate students with BSc, MSc, and Engineering degrees will<br />

remain our most important "output" - these students are to play important role in the<br />

development of regional and national industrial and business enterprises.


4 AASS – Center for Applied Autonomous Sensor Systems<br />

In this context, the preparatory work aimed at establishing a new engineering education (civing,<br />

180 p) in Mechatronics at the Dept. of Technology is completed and an application will<br />

be submitted to the Dept. of Higher Education (Högskoleverket) in the beginning of 2005. At<br />

the same time research and graduate education will be key factors in keeping with up-to-date<br />

technological developments, maintaining and further developing the scientific relevance and<br />

quality of undergraduate education, and last but not least, increasing the attractivity of Örebro<br />

University as an educational centre in a regional, national, and international perspective. On<br />

the other hand, our research and graduate education is of great value in itself – by doing<br />

research in the area of Autonomous Systems we contribute to the advancement of<br />

technologies at one of the frontiers of modern interdisciplinary science. A particular<br />

"practical" benefit is the reunification of Measurement, Control, and Computer Sciences into<br />

a disciplinary and technological continuum - a reunification that sadly is lacking today, to the<br />

growing discontent of industry. Thus, industrial co-operation will ensure that these<br />

technological advancements are adopted and their business potential is exploited.<br />

Certain "key" figures indicating that the development of the AASS research and educational<br />

profile is on the right track are:<br />

• Number of students in the Computer Engineering undergraduate program <strong>2004</strong>: 85<br />

• Number of MSc students in the Computer Engineering MSc program <strong>2004</strong>: 23.<br />

• Number of MSc theses completed under AASS supervision <strong>2004</strong>: 4.<br />

• Number of PhD students <strong>2004</strong>: 24 (1 PhD and 3 Licentiate degrees awarded in <strong>2004</strong>).<br />

• Number of ex-jobs completed under AASS supervision <strong>2004</strong>: 2.<br />

• Number of publications <strong>2004</strong>: 51<br />

• External funding <strong>2004</strong>: 54.2% of the total AASS budget.<br />

A continued strong support from our founders and academic/industrial partners shows that we<br />

have all reasons to be optimistic about our further development and contributions to<br />

education, industry, and society.


Annual Report <strong>2004</strong> 5<br />

1. Centre for Applied Autonomous Sensor Systems (AASS)<br />

The Applied Autonomous Sensor Systems Centre was formally established in 1996 with a<br />

grant from the KK-Foundation with the purpose of establishing the basis for a concentrated<br />

research effort in the interdisciplinary area of Autonomous Systems with expected<br />

contributions to education and industrial co-operation.<br />

Today AASS is nationally and internationally recognized for its research results and plays an<br />

important educational role within the Department of Technology and in the 4th strategic<br />

research profile of Örebro University – “Human senses, autonomous sensor systems, and<br />

industrial processes”. AASS has established well-functioning industrial co-operation - a<br />

number of industrial partners have developed a strong interest in AASS and support the<br />

research effort in terms of industrial PhD students, joint research projects, research-relevant<br />

equipment (hardware and software), and expertise (industrial employees acting as part-time<br />

AASS researchers).<br />

The industrial co-operation will be made even stronger as a result of our participation in the<br />

VINNOVA Robotdalen innovation program. The AASS research effort is organized on the<br />

basis of the following 4-pronged vision:<br />

1. Recognition by the international and national scientific community not only for AASS's<br />

active contributions to the state-of-the-art in core research areas, but also for its innovative<br />

role in establishing novel research topics that expand the frontiers of the science and<br />

technology for autonomous systems.<br />

2. Significant, long-term industrial interest in utilizing AASS's research results and<br />

educational capacity that will allow improvement of existing industrial technologies and<br />

products as well as, provide possibilities for exploring radically new solutions and future<br />

products.<br />

3. Significant contributions to educational programs at BSc, MSc and PhD-level of<br />

education.<br />

4. Leading role within the Örebro University's strategic research profile "Human Senses,<br />

autonomous sensor systems, and industrial processes''.<br />

In engineering terms, the fulfilment of the above vision will lead to:<br />

• Providing practitioners with methods for the design of engineering systems at all levels of<br />

control and sensing (low, supervisory and task-level) and whose needs are not met by<br />

existing conventional approaches. In educational terms, the fulfilment of the above vision<br />

will lead to:<br />

• The reunification of Measurement, Control, and Computer Sciences into an<br />

interdisciplinary disciplinary continuum - a reunification, which sadly is lacking today<br />

from existing educational programs.


6 AASS – Center for Applied Autonomous Sensor Systems<br />

Autonomous Systems<br />

Autonomous systems are mobile as well as immobile platforms that employ a vast array of<br />

sensors in order to analyze and/or influence highly dynamic environments. Examples of such<br />

systems include robotic systems, complex process control systems, flexible<br />

manufacturing/inspection systems, automotive systems, and unmanned underwater/land and<br />

air/space vehicles.<br />

In order to achieve an autonomous operation the system has to be supplied with the ability to:<br />

plan and schedule control/sensing actions at varying levels of detail and functionality; acquire<br />

and integrate sensory information at different levels of granularity and abstraction; learn how<br />

to adapt to initially unknown or changing environments; identify events that threaten the<br />

system's operation and react to these by reconfiguring its control and sensing routines.<br />

The design and analysis of autonomous systems has a pronounced interdisciplinary character<br />

being a fusion of a variety of disciplines from Systems and Control, Measurement<br />

Technology and Sensors, Computer Science and Artificial Intelligence, and Operations<br />

Research. This fusion is with emphasis on certain modern developments such as Fuzzy<br />

Systems, Intelligent Control and Sensors, Machine Learning, Planning and Automated<br />

Reasoning, and Biologically-inspired Systems.<br />

There are four major research areas that constitute the basis for autonomous systems research<br />

and development: Perception Science and Technology, Reasoning Science and Technology,<br />

Action Science and Technology, and Learning Science and Technology. These four research<br />

areas and the challenges posed by them are well recognized by the international research<br />

community and underpin the mainstream international research effort in the area of<br />

autonomous systems. Perception provides the means to gather information about the working<br />

environment - information that permits operations such as manufacturing, process control,<br />

navigation, monitoring, and manipulation to be accomplished safely and robustly. Reasoning<br />

is the "smarts" of an autonomous sensor system - it is the capacity to reason that provides the<br />

connection between perception and action.<br />

Action is ability to move in space and to manipulate objects in a safe and reliable manner - in<br />

case of robotic systems, or maintain certain desired behaviour in industrial plants/processes<br />

despite disturbances and limited knowledge of process/plant dynamics. Learning is needed to<br />

make technologies from the areas of Perception, Reasoning, and Action play a practical role<br />

in a variety of real-world dynamic, uncertain and unstructured environments.<br />

AASS research reflects these major research areas and - what is more important - aims at their<br />

integration in order to "produce" complete autonomous systems solutions. With the<br />

integration issues in mind <strong>2004</strong> is the starting year for a number of joint inter-lab projects.<br />

The integration projects are seen as central means for cross-fertilisation between the four<br />

laboratories and serve as a convincing demonstration platform towards industry and funding<br />

bodies. The joint projects address issues like: human-like motion control of robot arms;<br />

hybrid maps for mobile robots; Ready-to-eat-food assembly; and human-robot interaction.<br />

Their potential application is in a number of industrially relevant areas: inspection of<br />

industrial sites and installations, inspection of hazardous waste sites and waste manipulation,<br />

product and material monitoring in manufacturing, and rescue operations. Their industrial<br />

relevance is further reinforced by the present inadequacy of the predominant number of<br />

mobile robots/manipulators in industrial use: very limited autonomy, limited task range,


Annual Report <strong>2004</strong> 7<br />

predictability of behaviour only in well-structured and predictable environments, and limited<br />

sensing capabilities. AASS is organized around the following interrelated and mutually<br />

dependent permanent activities:<br />

1. Research projects, including technical support and pertaining to particular lab or "interlab"<br />

projects.<br />

2. Robotdalen projects, industrial projects defined within the Robotdalen framework.<br />

3. The AASS Graduate program, leading to both Licentiate and PhD degrees.<br />

4. The MSc program in Computer Engineering - an educational program at the Department<br />

of Technology reflecting AASS related research.<br />

5. Undergraduate studies in Computer Engineering at the Department of Technology.<br />

6. EU Marie Curie Training Program in advanced autonomous robotic systems - duration<br />

2002-2005.


8 AASS – Center for Applied Autonomous Sensor Systems<br />

Group picture, AASS Staff<br />

From the top left: Per Munkevik (PhD-student), Mikael Broström (Computer Support), Robert Lundh<br />

(PhD-student), Peter Wide (Professor), Anani Ananiev (Senior Researcher),<br />

Upper middle row: Ester Liljedahl (Administrative Manager), Abdelbaki Bouguerra (PhD-student),<br />

Henrik Andreasson (PhD-student), Lars Karlsson (Senior Researcher), Martin Magnusson (PhDstudent),<br />

Mikael Soron (PhD-student), Ivan Kalaykov (Lab leader, Professor), Kevin LeBlanc (PhDstudent),<br />

Lower middle row: Johan Larsson (PhD-student), Boyko Iliev (Lab leader, Senior Researcher),<br />

Mathias Broxvall (Senior Researcher), Grzegorz Cielniak (PhD-student), Malin Lindquist (PhDstudent),<br />

Linn Robertsson (PhD-student), Thorsten Michelfelder (PhD-student), Alexander Skoglund<br />

(PhD-student), Gustav Tolt (PhD-student), Per Sporrong (Research Engineer),<br />

Front row: Cipriano Andrades (Marie Curie-student), Jessica Karlsson (Information assistant), Silvia<br />

Coradeschi (Senior Researcher).<br />

Not present: Dimiter Driankov (Research Manager), Barbro Alvin (Administrative assistant), Pär<br />

Buschka (PhD-student), Tom Duckett (Lab leader), George Fodor (Adj. Professor), Lars Jennergren<br />

(PhD-student), Jun Li (PhD-student), Christer Lindkvist (PhD-student), Amy Loutfi (PhD-student),<br />

Jack Pencz (PhD-student), Martin Persson (PhD-student), Alessandro Saffiotti (Lab leader, Professor),<br />

Bo-Lennart Silverdahl (Research Engineer) Henrik Sturve (Economy assistant), Thomas Uppgård<br />

(PhD-student), Christoffer Wahlgren (PhD-student), Zbigniew Wasik (PhD-student).


Annual Report <strong>2004</strong> 9<br />

1.1 Organisation<br />

AASS is organized in matrix form, as shown in the figure below.<br />

AASS Management<br />

Prof. D. Driankov, Research Director<br />

E. Liljedahl, Administrative Manager<br />

Research Laboratories<br />

BIS Lab<br />

B.Iliev, PhD<br />

MR Lab<br />

Prof. A Saffiotti<br />

IC Lab<br />

Prof. I. Kalaykov<br />

LS Lab<br />

T. Duckett, Docent<br />

Research Projects<br />

Technical and Adm. Support Group: P.Sporrong, B-L.Silfverdal B. Alvin, J.Karlsson and H.Sturve<br />

Robotdalen Projects<br />

Project coordinators: D.Driankov and E.Liljedahl<br />

Graduate Program<br />

Director: L. Karlsson, PhD<br />

MSc Program in Computer Engineering<br />

Program Leader: L. Karlsson, PhD<br />

Undergraduate Studies at Division of Computer Engineering<br />

Director of Studies: S. Coradeschi, PhD<br />

EU Marie Curie Training Program in Autonomous Robotics (2002-2005)<br />

Program Coordinator Prof. D. Driankov<br />

The research labs reflect the four main directions in the research area of Autonomous<br />

Systems, i.e., BIS - Perception Science and Technology; ML - Reasoning Science and<br />

Technology; IC - Action Science and Technology; and LS - Learning Systems and<br />

Technology. Thus they represent competence areas within which basic research is conducted.<br />

According to their disciplinary competence, e.g., Computer Science, Computer Engineering,<br />

AI, Systems and Control, Machine Learning etc., they also provide resources - courses,<br />

teachers, and supervisors - for the graduate and undergraduate studies programs and the rest<br />

of the horizontal entries in the above figure:


10 AASS – Center for Applied Autonomous Sensor Systems<br />

1. Research projects are defined within labs (lab-specific projects), across labs (inter-lab<br />

projects), and/or cooperation with external partners (external projects). The lab leaders are<br />

responsible for the budget and project work on lab-specific projects and external projects.<br />

The AASS Research Director is also responsible for inter-lab projects. The technical<br />

support group provides technical assistance in the design and maintenance of robot<br />

platforms, sensor systems and the associated work with these software environments and<br />

programming tools:<br />

2. Robotdalen projects are industrial projects defined by the industrial partners from<br />

Robotdalen. These are typical “technology transfer” projects and at least one industrial<br />

PhD student is part of such a project while the scientific supervision is provided by AASS.<br />

At the current time there are three such projects. In addition AASS runs a project for<br />

dissemination of technology “Teknikspridning och Kompetenshöjning”, which aims to<br />

increase the interest, as well as the knowledge, for robotics and technology of youth and<br />

children.<br />

3. AASS Graduate program defines the PhD studies curriculum for all graduate students at<br />

AASS independent of their specific research area. The director of the program is<br />

responsible for its structure and contents, as well as the enrolment of graduate students<br />

and supervision of the formal aspects of progress in their PhD studies. The actual PhD<br />

thesis work and its supervision are done within the research labs. AASS graduate students<br />

have the possibility also to be enrolled in the Swedish National Graduate School in<br />

Computer Science (CUGS) where Örebro is one of the participating universities. The<br />

Director of the AASS Graduate program also is a member of the steering committee of<br />

CUGS.<br />

4. MSc program in Computer Engineering is a 4-year studies program, which upon its<br />

completion provides for 160 points of studies and leads to the degree “MSc in<br />

Technology, with profile in Computer Engineering”. The first two years of this program<br />

are common with the 3-year undergraduate program in Computer Engineering at the Dept.<br />

of Technology. The decision whether to join the MSc program is done upon the<br />

completion of the second year of the 3-year undergraduate program. The leader of the<br />

MSc program is responsible for the program's structure and courses’ content it’s<br />

monitoring and “marketing, contact with students, and BSc theses. In its current form the<br />

program contains courses directly related to the disciplinary and research competence at<br />

AASS.<br />

5. Undergraduate education in Computer Engineering is a 3-year studies program given<br />

within the Computer Engineering Division of the Department of Technology. The director<br />

of AASS also is director of the Computer Engineering Division, and Silvia Coradeschi, a<br />

researcher at AASS, is a director of studies for the Computer Engineering program who is<br />

responsible for both the three and four years programs. The responsibilities of the director<br />

include program teaching staff assignment and budget work etc. AASS research staff and<br />

PhD students are a natural part of the teaching staff.<br />

6. EU Marie Curie Training Program in Autonomous Robotics is a 4-year, EU-funded<br />

program, aimed at providing support for the training and mobility of PhD students<br />

throughout Europe. This scheme supports short stays by young researchers pursuing<br />

doctoral studies in the area of Autonomous Systems, providing them with the possibility<br />

of undertaking part of their doctoral studies in a country other than their own, and


Annual Report <strong>2004</strong> 11<br />

allowing them the benefit of working within an internationally recognized group - in this<br />

case AASS - in their specialized area of research - a particular AASS laboratory. The<br />

coordinator of the program is responsible for all organizational, management, and budget<br />

work as well as for contacts with the EU Commission, “marketing”, selection and<br />

enrolment of candidates. Actual research work supervision is done within the respective<br />

labs. In <strong>2004</strong> AASS has received 3 international Ph.D. students as Marie Curie fellows.


12 AASS – Center for Applied Autonomous Sensor Systems<br />

1.2 Management<br />

The management, evaluation, and monitoring of AASS activities are performed by the AASS<br />

Management Body, which consists of the AASS Research Director, Administrative Manager,<br />

and Lab-leaders. The major decisions made by the Management Body concern:<br />

1. Budget;<br />

2. Research strategies;<br />

3. Research/Education integration in the Computer Science (Datateknik) program;<br />

4. Long-term research/education planning and industrial cooperation;<br />

5. Recruitment;<br />

6. Personnel career development;<br />

7. AASS university/department role<br />

The AASS Research Director who chairs the steering committee is responsible for<br />

recruitment, career development, and interface with the department, the university and with<br />

industry and funding bodies. The Research Manager is also responsible for the formulation<br />

and progress of inter-lab projects, industrial projects, long-term research planning and<br />

recruitment needs, and planning and coordination of research grant applications. He also<br />

monitors the AASS Graduate Studies Program and prepares and organizes progress <strong>report</strong>s<br />

and evaluations concerning AASS activities. Two such <strong>report</strong>s, the AASS Activity Plan and<br />

AASS Annual Report, are each year submitted to the KK-Foundation (in January and March<br />

respectively).<br />

The AASS Administrative Manager is responsible for the budget preparation and the<br />

overview of the economy during the year. She also is responsible for agreements and our<br />

duties with <strong>report</strong>s and financial <strong>report</strong>ing towards the external partners. Marketing, external<br />

as well as internal information is some of the other duties. She is responsible for the AASS<br />

Support group, which also means recruitment and personnel planning for the long term as<br />

well as short-term work of the group.<br />

The Lab leaders are responsible for all issues pertaining to lab organization, management, and<br />

development. This includes, planning and coordination of lab-specific research projects as<br />

well as lab administration, e.g. budget handling, lab "marketing'' (internal and external), lab<br />

contributions to teaching, etc.<br />

The AASS Reference Group (RG) meets two times a year (December and June) and reviews<br />

AASS research and progress from both a scientific and industrial perspective. The RG can<br />

propose that certain corrections are made in order to keep AASS on the right track. At the RG<br />

December-meeting, the AASS Activity Plan is presented and approved. At the RG Junemeeting,<br />

the year after, the state of the AASS Activity Plan is reviewed.<br />

Currently the RG consists of:<br />

• Torbjörn Widmark, PhD, AssiDomän Frövi, Product Development & Technical Service,<br />

Frövi, Sweden - RG Chairman.<br />

• Thomas Christaller, Dr. Professor at Fraunhofer Institute for Autonomous Intelligent<br />

Systems, Germany.


Annual Report <strong>2004</strong> 13<br />

• Gu Chun-Yuan, Program manager Mechatronics, ABB Corporate Research, Västerås,<br />

Sweden.<br />

• Toshio Fukuda, Professor at Dept. of Micro System Engineering and Mechano-<br />

Informatics and Systems, Nagoya University, Japan.<br />

• Alexander Lauber, Professor in Measurement Technology, Department of Technology,<br />

Kalmar University, Kalmar, Sweden.<br />

• Emil M. Petriu, Dr. Eng., P. Eng., Professor, School of Information Technology and<br />

Engineering, University of Ottawa, Canada.<br />

• Giulio Sandini, Dr. Professor at LIRA-Lab, Dist-University of Genova, Italy.<br />

• Mel Siegel, Professor at Robotics Institute, Carnegie Mellon University, Pittsburgh, USA.


14 AASS – Center for Applied Autonomous Sensor Systems<br />

1.3 Funding<br />

AASS funding comes from a number of sources. The major ones are as follows:<br />

1. KK-Foundation grants<br />

In the year <strong>2004</strong> these grants amounted to a total of 7,3 MSEK (excl. VAT). 0,9MSEK of<br />

this amount consist of two grants, which two of our PhD students received from the KKfoundation.<br />

During the years 2002- 2008 the KK-Foundation stays for a grant of up to 36<br />

MSEK. This grant, won in a tough competition with other Swedish research centres and<br />

groups, is intended to help achieving internationally competitive research profile,<br />

establishing a long-term development potential and developing sufficient alternative<br />

(other than the KK-Foundation) funding sources. Furthermore the grant is to facilitate<br />

active industrial cooperation where the latter is ensured by requiring 1-to-1 match between<br />

the KK-Foundation grant and funding from industry. This yields a total of up to 72 MSEK<br />

for a period of 6 years. This requirement has had quite a positive effect regarding AASS<br />

industrial cooperation - existing one has been further strengthened and new industrial<br />

partners have been found. The matching funding provided by industry is mainly in the<br />

form of, industrial graduate students, part-time participation of industry personnel in<br />

external research projects, and expensive equipment.<br />

2. Faculty funding<br />

For the year <strong>2004</strong> it amounts to 9,2 MSEK. This funding allows AASS to conduct more<br />

basic research and for maintaining and developing the size and quality of AASS<br />

participation in undergraduate/graduate education.<br />

3. Vetenskapsrådet (VR) – Swedish Council of Research grants<br />

This is a traditional funding source though characterized by its extreme competitiveness.<br />

A VR grant of 1,2 MSEK covering a period of 3 years started in 2001 for research on the<br />

subject of signal-to-symbol conversion in mobile autonomous robots. Another VR grant<br />

of 1,813 MSEK and covering a period of 3 years was obtained in 2002 for research on the<br />

subject of Sensor-based planning for mobile robotics. A third grant of 1 824 000 is<br />

obtained for the period 2005-2008.<br />

4. Regional funding<br />

During <strong>2004</strong> regional industry has supported AASS with about 490 000 SEK for<br />

equipment.<br />

5. Robotdalen “funding”<br />

Currently there are three Robotdalen projects each with one industrial PhD student. The<br />

cost of these PhD students is covered by Robotdalen and the respective industrial partners<br />

involved. For the project “Teknikspridning och Kompetenshöjning” we received 363 600<br />

during <strong>2004</strong>. In January 2005 we received an additional 189 500 for <strong>2004</strong> as well. In total<br />

553 000 SEK.<br />

As a measure of having achieved the objectives set by the KK-Foundation AASS has adopted<br />

the ratio between internal (faculty/university) and external (KK-Foundation, industry,<br />

research funding agencies) funding. For year <strong>2004</strong> this ratio was 54,2% for external funding.<br />

According to the agreement the funding from the KK-Foundation profile should be not more<br />

than 38% of the total AASS budget. For <strong>2004</strong> this was 29%.


Annual Report <strong>2004</strong> 15<br />

The diagram from below summarizes the different funding sources in year <strong>2004</strong>.<br />

Funding <strong>2004</strong><br />

Internal income for teaching<br />

4,0%<br />

EU-networks<br />

0,9%<br />

Other income<br />

0,2%<br />

KK-foundation, Profile<br />

29,2%<br />

KK-foundation, IT<br />

4,1%<br />

Faculty<br />

41,8%<br />

ABB, Instr. & Control, KKrelated<br />

0,5%<br />

Regional companies<br />

2,2%<br />

ETRI<br />

0,5%<br />

NIROS<br />

4,5%<br />

CUGS<br />

3,3%<br />

Robotdalen<br />

3,0%<br />

Vetenskapsrådet<br />

5,4%<br />

Income from other universities<br />

0,4%<br />

The chart below shows the increasing funding levels for the years 1997-<strong>2004</strong>, which<br />

illustrates the rapid AASS development. (All amounts in thousand SEK.)<br />

AASS funding growth 1997-<strong>2004</strong><br />

25 000<br />

20 000<br />

15 000<br />

10 000<br />

5 000<br />

0<br />

1997 1998 1999 2000 2001 2002 2003 <strong>2004</strong>


16 AASS – Center for Applied Autonomous Sensor Systems<br />

1.4 Undergraduate Education<br />

AASS is responsible for the 3-year Computer Engineering Program and the 4-year MSc<br />

Program in Computer Engineering. AASS contributions are in terms of management,<br />

administration, program and course development, and teaching. Silvia Coradeschi, AASS, is<br />

the director of studies for the Computer Engineering Division including both the 3 and 4 years<br />

programs. Her responsibilities include budget and staff management for the undergraduate<br />

education within the division. Lars Karlsson is the leader for the MSc program. His<br />

responsibilities include development, information, course scheduling, and thesis<br />

administration.<br />

1.4.1 Computer engineering program<br />

The Computer Engineering Program is a study program consisting of 120 credit points<br />

(corresponding to three years of studies). The program can be characterized as a fixed study<br />

program with some options during year 3. It leads to a University Diploma in engineering (sv.<br />

"Högskoleingenjörsexamen"), 120 points, and/or a bachelor (BSc) degree. Details about the<br />

program's study plan can be found at:<br />

http://www.oru.se/templates/oruExtNormal.aspx?id=4690<br />

The following courses were taught in <strong>2004</strong> by AASS researchers:<br />

• Artificial Intelligence, Mathias Broxvall<br />

• Artificial Neural Networks, Tom Duckett<br />

• Real Time Programming, Mathias Broxvall<br />

• Artificial Intelligence for Mobile Robots, Alessandro Saffiotti.<br />

• Computer Graphic, Mathias Broxvall<br />

AASS PhD students have been teaching assistants for the following courses in year <strong>2004</strong>:<br />

• Numerical Methods, Li Jun<br />

• Artificial Intelligence for Mobile Robots, Kevin LeBlanc<br />

• Computer use, Linn Robertson<br />

• Computer Architecture, Pär Buschka<br />

• Computer Communication, Henrik Andreasson<br />

• Software System, Robert Lundh<br />

• Artificial Intelligence, Amy Loutfi<br />

• Artificial Neural Networks, Henrik Andreasson, Malin Lindquist<br />

• Java Programming, Zbigniew Wasik<br />

• Real Time programming, Malin Lindquist, Pär Buschka<br />

• Database, Abdelbaki Bouguerra<br />

BSc Theses<br />

• Göksu Gabriel och Demir Viktor “Röststyrning av robot via taligenkänning” Supervisors:<br />

Tom Duckett and Henrik Andreasson.<br />

• Pettersson Morgan, Arm Controller for Robot Waiter. Supervisor: I: Kalaykov (Started in<br />

2003).


Annual Report <strong>2004</strong> 17<br />

1.4.2 MSc in computer engineering<br />

The MSc Computer Engineering Program is a 4-year study program leading to a Master of<br />

Science with a major in Computer Engineering. The first 2 years of the program are in<br />

common with the 3-year Computer Engineering program, and students choose between the<br />

two programs at the end of the second year. The program belongs to the technological study<br />

sector. The program was started in the autumn of 2001 and the first class is graduated in 2002.<br />

Currently there are 40 students enrolled in the program. Details about the program's study<br />

plan can be found at www.oru.se, Department of technology's web pages.<br />

During the year, AASS members and PhD students have been involved in teaching related to<br />

the program as follows.<br />

Teaching<br />

The following courses were taught in <strong>2004</strong> by AASS researchers:<br />

• Computer Graphics, Mathias Broxvall (lectures)<br />

• Artificial Intelligence in Mobile Robotics, Alessandro Saffiotti (lectures), Kevin LeBlanc<br />

(assistant)<br />

• Program Development and Project Management, Robert Lundh (assistant)<br />

• Pattern Recognition, Gustav Tolt (lectures).<br />

MSc Theses<br />

The following MSc theses in Computer Engineering were completed during year <strong>2004</strong> at<br />

AASS.<br />

• Andersson, Karin “Functionality test with the electronic tongue”.<br />

Supervisor: S.Eskiizmirliler (started in 2003)<br />

• Sivebratt, Mikael. "GUI for artificial sensory head".<br />

Supervisor: S. Eskiizmirliler (started in 2003).<br />

• Ellkvist, Tommy och Sheikh Mohammed, Omar “Implementation of an image processing<br />

server for a mobile robot”.<br />

Supervisor: M. Broxvall<br />

• Magnusson, Daniel och Nord, Lasse “Människa och ABB's FlexPicker robot spelar<br />

airhockey”.<br />

Supervisor: I. Kalaykov<br />

Two additional MSc.theses (20 points each) started during spring <strong>2004</strong> but await completion<br />

in 2005.<br />

1.4.3 Other study programs<br />

AASS members and PhD students were also involved in a number of courses for other study<br />

programs:<br />

• Course in Power Point for University Personnel, Martin Persson<br />

• Soft Computing for Control, Ivan Kalaykov.


18 AASS – Center for Applied Autonomous Sensor Systems<br />

1.5 Graduate Education<br />

An integrated vital part of research at AASS is its Graduate Program and perhaps the most<br />

important "output" of AASS is highly qualified PhD's and Licentiates whose contributions<br />

provide further strength to Swedish industry and academic community.<br />

AASS is performing interdisciplinary research in the field of autonomous embedded systems,<br />

integrating theories, technologies and tools from sensors and measurement technology,<br />

control, artificial intelligence and computer science. Therefore, the AASS graduate program<br />

aims at giving graduate students a strong interdisciplinary background in these different areas<br />

with emphasis on topics relevant to autonomous systems. It is assumed that the students<br />

already have adequate knowledge in the basics of engineering and/or computer science.<br />

Finally, the program prepares students for a career in academia or industry by including topics<br />

such as pedagogy, management and presentation techniques.<br />

60 study points are required for a PhD. Of these, 25 points (or more) should be from a core<br />

curriculum courses, an additional 25 points should be from other courses or self studies in<br />

research relevant topics, and 10 points can be chosen freely. The Director of the Graduate<br />

program is Lars Karlsson, PhD.<br />

1.5.1 Core curriculum<br />

There are five courses that are given on a regular basis. These courses constitute the AASS<br />

core curriculum. They cover the different fields that are researched in AASS. In order to<br />

ensure that students acquire the interdisciplinary knowledge that characterizes AASS, the core<br />

courses are compulsory. The core courses are as follows:<br />

• AI for embedded systems. 5 points + 3 optional points for advanced studies.<br />

Teacher: Alessandro Saffiotti, Mobile Robotics Lab.<br />

• Soft computing for control. 5 points + 3 optional points for advanced studies.<br />

Teacher: Ivan Kalaykov, Intelligent Control Lab.<br />

• Embodied learning. 5 points + 3 optional points for advanced studies.<br />

Teacher: Tom Duckett, Learning Systems Lab.<br />

• Research Methodology for Computer Science and Engineering, 5 points,<br />

Teacher: Jan Gustafsson, Mälardalen University.


Annual Report <strong>2004</strong> 19<br />

1.5.2 Occasional courses<br />

The core courses are complemented by courses that are provided on a more occasional basis -<br />

on request - when a visiting researcher provides for such an opportunity, or when a subject of<br />

interest is covered by a graduate course at another university. During <strong>2004</strong>, one occasional<br />

course was given:<br />

• Introduction to Markov Decision Processes. Teacher: Lars Karlsson.<br />

1.5.3 Self-study course work<br />

This type of course work is done within supervised self-study circles (smaller courses), or<br />

individual studies. There was one organized study circle:<br />

• Introduction to reinforcement learning. Teacher: Tom Duckett.<br />

1.5.4 Cooperation with other graduate programs<br />

As recognition of the research effort at AASS, Örebro University has become one of the<br />

participants in CUGS (the Swedish National Graduate School in Computer Science). CUGS is<br />

commissioned by the Swedish government and the Swedish Board of Education and Lars<br />

Karlsson is a member of the CUGS steering Committee.<br />

Because of CUGS, AASS students have now the additional possibility to get enrolled as<br />

CUGS students or to follow some courses of interest provided by the CUGS study program.<br />

Currently, 2 students from the Mobile Robotics Laboratory are enrolled in CUGS, receiving a<br />

total funding of 700,000 SEK:<br />

• Robert Lundh (topic: cooperative robotics, supervisor: Alessandro Saffiotti)<br />

• Kevin Leblanc (topic: cooperative anchoring, supervisor: Alessandro Saffiotti)<br />

The scientific scope of CUGS includes central parts of the core computer science (sv.<br />

datalogi) and computer engineering (sv. datorsystem). In this regard, CUGS puts an emphasis<br />

on programming languages, algorithms, software engineering, also including related areas of<br />

autonomous systems, real-time systems, embedded systems, knowledge-based systems and<br />

artificial intelligence. Other members of CUGS are the universities/university colleges in<br />

Linköping (host), Lund, Mälardalen, and Skövde.<br />

AASS offered one advanced graduate course for CUGS:<br />

• Introduction to Markov Decision Processes. Teacher: Lars Karlsson.<br />

Detailed information about CUGS can be found at:<br />

http://www.ida.liu.se: 9080/groups/cugs/FrontPage.<br />

1.5.5 European graduate programs<br />

As recognition for the quality of its graduate education and research The European<br />

Commission 2002 has granted AASS the status of a Marie Curie Training Site in the area of<br />

Autonomous Robotics. The Commission, during the next four years, will provide the funding<br />

necessary for accommodating PhD students from European countries for periods of stay<br />

between 3 and 12 months. During their stay at AASS the guest-students will participate in


20 AASS – Center for Applied Autonomous Sensor Systems<br />

projects related to AASS research and also take courses offered within the AASS Graduate<br />

Program. Prof. D. Driankov is the responsible coordinator for the program.<br />

During <strong>2004</strong> we have had 3 Marie Curie Fellows:<br />

• André Treptow, Tuebingen University, Department of Computer Science, Jul.-Oct. <strong>2004</strong>,<br />

Active Recognition of People by Mobile Robots.<br />

• Peter Biber, Tuebingen University, Department of Computer Science,<br />

August-November <strong>2004</strong>, Lifelong SLAM by Mobile Robots.<br />

• Cipriano Galindo. University of Malaga, Spain. Period: Sep-Nov <strong>2004</strong><br />

(3 months). Research projects: Hybrid Maps and Perceptual Anchoring.<br />

More information regarding the Marie Curie Training Programs can be found at:<br />

http://improving.cordis.lu/mc<br />

1.5.6 Graduate students<br />

Biologically Inspired Systems Lab<br />

PhD-student First advisor Second Employed at Enrolled at<br />

advisor<br />

Lindquist, Peter Wide Boyko Iliev ÖU ÖU<br />

Malin<br />

Robertsson, Peter Wide Boyko Iliev ÖU ÖU<br />

Linn<br />

Spännar , Jan Peter Wide George Fodor Högskolan<br />

Dalarna<br />

ÖU<br />

Mobile Robotics Lab<br />

PhD-student First advisor Second Employed at Enrolled at<br />

advisor<br />

Bouguerra, Alessandro Lars Karlsson ÖU ÖU<br />

Abdelbaki Saffiotti<br />

Buschka, Pär Alessandro Tom Duckett ÖU ÖU<br />

Saffiotti<br />

Loutfi, Amy Alessandro Silvia ÖU ÖU<br />

Saffiotti Coradeschi<br />

Larsson, Alessandro Mathias Atlas Copco ÖU<br />

Johan Saffiotti Broxvall<br />

Lundh,<br />

Robert<br />

Alessandro<br />

Saffiotti<br />

Lars Karlsson ÖU ÖU and<br />

CUGS<br />

LeBlanc,<br />

Kevin<br />

Alessandro<br />

Saffiotti<br />

Silvia<br />

Coradeschi<br />

ÖU ÖU and<br />

CUGS<br />

Pettersson, Alessandro Lars Karlsson ÖU ÖU<br />

Ola Saffiotti<br />

Wasik, Alessandro Dimiter ÖU ÖU


Annual Report <strong>2004</strong> 21<br />

Zbigniew Saffiotti Driankov<br />

Pencz, Jack Alessandro Silvia<br />

Saffiotti Coradeschi<br />

Intelligent Control Lab<br />

ÖU<br />

ÖU<br />

PhD-student First advisor Second Employed at Enrolled at<br />

advisor<br />

Jennergren, Ivan Anani SIK ÖU<br />

Lars Kalaykov Ananiev<br />

Thomas George Fodor Ivan ÖU ÖU<br />

Uppgård<br />

Kalaykov<br />

Lindkvist, George Fodor Peter Wide ÖU ÖU<br />

Christer<br />

Tolt, Gustav Ivan Dimiter ÖU ÖU<br />

Kalaykov Driankov<br />

Skoglund,<br />

Alexander<br />

(50%)<br />

Ivan<br />

Kalaykov<br />

Tom Duckett ÖU ÖU<br />

Soron, Mikael Ivan<br />

Kalaykov<br />

Learning Systems Lab<br />

Anani<br />

Ananiev<br />

Esab Welding<br />

Equip. AB<br />

PhD-student First advisor Second Employed at Enrolled at<br />

advisor<br />

Andreasson, Alessandro Tom Duckett ÖU ÖU<br />

Henrik Saffiotti<br />

Martin Dimiter Tom Duckett Aerotech ÖU<br />

Persson Driankov<br />

Telub AB<br />

Cielniak, Peter Wide Tom Duckett ÖU ÖU<br />

Grzegorz<br />

Jun, Li Peter Wide Tom Duckett ÖU ÖU<br />

Magnusson, Alessandro Tom Duckett Atlas Copco ÖU<br />

Martin Saffiotti<br />

Skoglund, Ivan Tom Duckett ÖU ÖU<br />

Alexander<br />

(50%)<br />

Kalaykov<br />

Munkevik,<br />

Per<br />

Peter Wide Tom Duckett SIK ÖU<br />

Officially registered as PhD-students by the end of February <strong>2004</strong>.<br />

ÖU


22 AASS – Center for Applied Autonomous Sensor Systems<br />

1.5.7 PhD theses<br />

During <strong>2004</strong> one PhD thesis was defended:<br />

• Ola Pettersson. Model-free Execution Monitoring in Behaviour-based Mobile Robots.<br />

PhD Thesis, Örebro University Studies in Technology Series, <strong>2004</strong>.<br />

1.5.8 Licentiate theses<br />

During <strong>2004</strong> the following licentiate theses were completed:<br />

• Jennergren, Lars. Flexible Assembly of Ready-to-eat Meals. Licentiate thesis, Örebro<br />

University Studies in Technology Series, <strong>2004</strong>.<br />

• Jun, Li. Towards Online Learning of Reactive Behaviours in Mobile Robotics. Licentiate<br />

thesis, Örebro University Studies in Technology Series, <strong>2004</strong>.<br />

• Lindquist, Malin, Electronic Tongue for Water Quality Assessment. Licentiate thesis,<br />

Örebro University Studies in Technology Series, <strong>2004</strong>.


Annual Report <strong>2004</strong> 23<br />

1.6 Co-operation<br />

The AASS research effort builds upon two types of co-operation: industrial and academic.<br />

The former one is of two types: 1) KK-Foundation related according to the 1-to-1 funding<br />

scheme and supports general research themes in autonomous systems and may, or may not<br />

include specific industrial projects; and 2) VINNOVA Robotdalen related, which involves<br />

specific industrial projects. The academic co-operation has both national and international<br />

dimension.<br />

1.6.1 Industrial cooperation: KK-Foundation related<br />

The following industrial companies and the related to those companies’ activities constitute<br />

the basis for the 1-to-1 funding required by the KK-Foundation:<br />

• ABB Automation Technology Products AB/Robotics: the company sponsors AASS with<br />

equipment (flex-picker robot and IRB140), software and software support and the main<br />

receiver is the Intelligent Control Systems lab:<br />

• ABB Automation Technology Products AB/Instrumentation and Control: i) a visiting<br />

professor (adjungerad prof. G. Fodor) from the company supervises 2 AASS PhD<br />

students, ii) one of those (Thomas Uppgård) being an industrial PhD student with AASS;<br />

iii) one of the company's engineers (with a PhD degree from AASS, P. Bergsten) works<br />

part time at AASS on the subject of fuzzy control. In addition they sponsor with<br />

equipment and licenses.<br />

• FFV Aerotech Telub AB, Örebro: an industrial PhD student (Martin Persson) works in the<br />

project Semi-Autonomous Mapping (SAM) by UAV-UGV Cooperation at the Learning<br />

Systems Lab. January 2005 another industrial PhD student (Christer Wahlgren) started his<br />

PhD studies at AASS.<br />

• DELFOI (Göteborg): the company has provided AASS with licences for the use of the<br />

software products related to digital 3D manufacturing solutions as well as the training<br />

courses needed for the use of those products. The software is used in the IC lab projects<br />

on flexible assembly of ready-to-use food, i.e., flexible food-cell and sensory analysis in<br />

the food-factory-of-the-future.<br />

• AssiDomän (Frövi): the company provided equipment (vision platform) for the project<br />

“Behaviour-based mobile manipulation'' at the MR Lab; Torbjörn Widmark, employed<br />

with the company, chairs the AASS Reference Group and is thus very much involved in<br />

the organization and the proceedings of the two <strong>annual</strong> meetings of the Reference group.<br />

• SIK, Göteborg, Sweden (a research organization in the area of automation in food<br />

manufacturing): 2 SIK/AASS PhD students (Lars Jennergren and Per Munkevik) work on<br />

projects in the IC Lab and LS Lab regarding robotics technologies for the food-factory-ofthe-future.<br />

Lars Jennergren finished his Lic. Thesis during <strong>2004</strong>.


24 AASS – Center for Applied Autonomous Sensor Systems<br />

1.6.2 Industrial cooperation: VINNOVA-Robotdalen related<br />

The following Robotdalen projects have been running at AASS during <strong>2004</strong>:<br />

• Robot station friction stir welding: the project involves a cluster of industrial companies in<br />

Laxå (Esab Welding Equipment AB, Specma Automation AB, ABB-Laxå) and the IC Lab<br />

at AASS represented by one industrial PhD student and Prof. I. Kalaykov.<br />

• Navigation system for automated loaders: the project involves Atlas Copco Rock Drills<br />

AB (Örebro), Volvo Construction Equipment (Eskilstuna), and the MR Lab at AASS<br />

represented by one industrial PhD student and Prof. A. Saffiotti.<br />

• Tunnel profile scanner: the project involves Atlas Copco Rock Drills AB (Örebro), Optab<br />

Optronikinnovation AB (Karlskoga), and the LS Lab at AASS represented by one<br />

industrial PhD student and Dr. T. Duckett.<br />

• Teknikspridning och kompetenshöjning: the focus of the project is on: i) the dissemination<br />

of knowledge about robotics and related technical systems aimed at schools in the Örebroregion;<br />

ii) further education of school teachers in the area of robotics; and iii) girls-intechnology<br />

efforts. The project involves KomTek (Örebro, Laxå and Karlskoga),<br />

industrial companies (ESAB, ABB, Lasertech) and AASS as a whole, where E. Liljedahl<br />

is the project co-ordinator.<br />

1.6.3 National Co-operation<br />

1.6.3.1 Scientific cooperation<br />

• WITAS-project (unmanned helicopter), Univ. of Linköping, Dept. of Computer Science:<br />

development of Takagi-Sugeno fuzzy model based visual servoing controllers for<br />

unmanned aerial vehicles.<br />

• Mälardalens högskola, Västerås: development of Vision on Chip system for robotic<br />

applications, funded by Robotdalen.<br />

• SIK, Göteborg: development of robotic technologies for the Food Factory of the Future.<br />

1.6.3.2 National networks, societies, programs<br />

• Founding member of the VINNOVA Robotdalen program<br />

• Coordinator of Team Sweden (team of 3 univ: Lund Univ., Blekinge Institute of<br />

Technology, Orebro Univ.).<br />

• Member of CUGS (participating with two PhD students).<br />

• Member of SLSS (Swedish Learning Systems Society).<br />

• Member of the Swedish IEEE chapter on Signal Processing.<br />

• Affiliated to LiFT (Livsmedelsproduktion med Framtidens Teknologier) - industryoriented<br />

Swedish programme for research and PhD education.<br />

• Member of SWIRA (Swedish Industrial Robotics Association)


Annual Report <strong>2004</strong> 25<br />

1.6.4 International Cooperation<br />

1.6.4.1 EC Networks/Programs<br />

AASS researchers are members and participate in the work of a number of EU networks and<br />

programs:<br />

• The European Community Network of Excellence on Robotics Research (EURON)<br />

Cooperative Robotics coordinator.<br />

• The European Community Thematic Network on Walking and Climbing Robots<br />

(CLAWAR II).<br />

• Marie Curie Training Site (coordinator).<br />

• SCIP Working Group (Soft Computing in Image Processing,<br />

http://fuzzy.rug.ac.be/SCIP/).<br />

1.6.4.2 Participation in scientific events (more info on participation to be found in the<br />

project descriptions from Section 2)<br />

• IASTED Conf. on Visualization, Imaging and Image Processing, Marbella, Spain, <strong>2004</strong>.<br />

• FUZZ-IEEE Conference, Budapest, 27-29 July <strong>2004</strong>.<br />

• IFAC Symposium on Intelligent Autonomous Vehicles, 5-7 July, Lisbon, Portugal, <strong>2004</strong>.<br />

• Second IEEE International Conference on Industrial Informatics, INDIN'04, 24-26 June,<br />

Berlin, Germany, <strong>2004</strong>.<br />

• The 30-th IEEE Annual Conference on Industrial Electronics IECON <strong>2004</strong> Conference,<br />

Nov. 2-6, <strong>2004</strong>, Busan, Korea.<br />

• ICEF9 International Conference on Engineering and Food, Montpellier, France, 7-11<br />

March, <strong>2004</strong>.<br />

• International Conference on Intelligent Manipulation and Grasping, Genoa, Italy, 1-2 July,<br />

<strong>2004</strong>.<br />

• Food Factory <strong>2004</strong> Conference, France, 6-8 October, <strong>2004</strong>.<br />

• International Conference on Mechatronics and Robotics ’04, Aachen, Germany, 13-15<br />

September <strong>2004</strong>. International Conference on Climbing and Walking Robots<br />

CLAWAR’04, Madrid, Spain<br />

1.6.4.3 Scientific cooperation<br />

AASS’s scientific partnerships are reflected in the project descriptions from Section 2. Each<br />

scientific partnership also includes visits from/to AASS.<br />

1.6.5 Services to the research community<br />

1.6.5.1 Membership in professional organizations/societies/management-bodies<br />

- The Board of Trustees of the RoboCup International Federation.<br />

- The Advisory Board of the International Conference on AI.<br />

- The European Coordinating Committee for Artificial Intelligence (ECCAI).


26 AASS – Center for Applied Autonomous Sensor Systems<br />

- The Scandinavian RoboCup Committee.<br />

- Executive committee of the International RoboCup Federation.<br />

- Membership in IEEE Computer Soc.; the IEEE Robotics and Automation Soc.; the IEEE<br />

System, Man and Cybernetics Soc.<br />

- The American Assoc. for Artificial Intelligence.<br />

- The Intelligent Autonomous Systems Soc.<br />

- IEEE CSS/SP societies; SPIE and EUSFLAT.<br />

- AAAI (American National Association for Artificial Intelligence).<br />

- SLSS member (Swedish Learning Systems Society).<br />

- EvoNet - The Network of Excellence in Evolutionary Computing.<br />

- International Association for Pattern Recognition.<br />

- IEEE - Institute of Electrical and Electronics Engineers.<br />

- SSAB - Swedish Society for Automated Image Analysis.<br />

- The Swedish Learning Systems Group.<br />

- The Board of SWIRA, Swedish Industrial Robot Association.<br />

- The Örebro University board.<br />

- The Faculty board (Natural Science, Technology and Medicine).<br />

- The Institutional board (Department of Technology) – two members.<br />

- IEEE Technical Committee on Intelligent Control, Section: Fuzzy Control.<br />

- Editorial Board International Journal of Uncertainty, Fuzziness, and Knowledge-Based<br />

Systems, World Scientific Publ.<br />

- Editorial Board Journal of Systems Architectures, The Euromicro Journal, Elsevier.<br />

- Advisory Board of the Electrical and Computer Science Department, Western Michigan<br />

University, USA.<br />

- IEEE Instrumentation & Measurement society - Chairman Technical Committee TC 27.


Annual Report <strong>2004</strong> 27<br />

1.6.5.2 Organization of scientific events<br />

AASS researchers have participated in at least a dozen Program/Organizing Committees,<br />

evaluation of EU FP6 projects and served as reviewers for numerous international journals<br />

and scientific events.


28 AASS – Center for Applied Autonomous Sensor Systems<br />

1.7 Dissemination of information<br />

The dissemination of information pertaining to AASS activities has the overriding goal to<br />

establish a firm and clear identity and acceptance of the AASS research profile, its industrial<br />

relevance, and societal contributions.<br />

To achieve the above goal our dissemination of information activities are towards the<br />

following three audiences:<br />

A. Industry, public authorities, and research funding bodies;<br />

B. Research community and university students; and<br />

C. General public<br />

Further information about our goals and philosophy regarding dissemination of information<br />

you can find in our Information Policy for 2005.<br />

1.7.1 Activities during March <strong>2004</strong>-February 2005<br />

FAIRS<br />

Activity Time Performance Target group<br />

Technical fair for<br />

women, Örebro<br />

AAAI-<strong>2004</strong><br />

Workshop<br />

Robotdalens dag,<br />

Örebro<br />

Technical fair,<br />

Stockholm<br />

040307-08 Presentation by Amy Loutfi “Putting<br />

A, C<br />

Olfaction into Action: Using electronic<br />

noses with artificial sensor systems.”<br />

040626 Arranged by A.Saffiotti and S.Coradeschi. B<br />

040909 Presentation of projects and co-operation<br />

that AASS is involved within the<br />

Robotdalen project. E. Liljedahl, A.<br />

Skoglund, B-L Silfverdal, P.Sporrong,<br />

B.Alvin<br />

041019-23 Participation in Robotdalens stand,<br />

demonstration of robot dogs and<br />

presentation of AASS and PhD-studies, by<br />

Mikael Soron and Kevin LeBlanc.<br />

A<br />

A, B


Annual Report <strong>2004</strong> 29<br />

VISITS<br />

Activity Time Performance Target group<br />

Study visit 040129 School class from Alléskolan åk 3,<br />

C<br />

Hallsberg. Introduction to AASS’ robots,<br />

research and education. Tom, Ivan, Henrik,<br />

Mathias, Gustav, Kevin<br />

Study visit 040202 Tullängsskolan, Elektro åk 3. Introduction C<br />

to AASS’ robots, research and education.<br />

Tom, Ivan, Henrik, Mathias, Gustav, Kevin<br />

Study visit 040205 Alléskolan åk 3, Hallsberg. Introduction to C<br />

AASS’ robots, research and education.<br />

Tom, Ivan, Henrik, Mathias, Gustav, Kevin<br />

Study visit 040209 Study visit by school class (Year 3,<br />

C<br />

Tullängsskolan, Örebro), Tom, Ivan,<br />

Henrik, Mathias, Gustav, Kevin<br />

Study visit 040212 Study visit by school class (Year 3,<br />

C<br />

Alléskolan, Hallsberg), Tom, Ivan, Henrik,<br />

Mathias, Gustav, Kevin<br />

Visit 040226 Presentation for representatives from the A<br />

KK-foundation<br />

Demonstration 040315 Presentation by Amy Loutfi for Susan<br />

A<br />

Kennarl from the Banft Centre,Canada<br />

Demonstration 040318 Lab demonstration for representatives from B, C<br />

Karlstads university (the Education and<br />

Research department), 35 people<br />

Study visit 040420 Study visit by school class (D8,<br />

C<br />

Vivallaskolan, Örebro), 20 pupils,<br />

Alexander Skoglund<br />

Presentation 040422 Presentation for Kristian Luuk by Amy C<br />

Loutfi<br />

Study visit 040503 Lab presentations for professor Jim Little, B<br />

Computer Science, UBC.<br />

Study visit 040505 Study visit by school class (Vivallaskolan, C<br />

Örebro), 40 pupils, Alexander Skoglund<br />

Study visit 040616 Study visit by Young Entrepreneurs, 25 C<br />

pupils from gymnasiums all over Sweden<br />

participation in an <strong>annual</strong> competition in<br />

Örebro, Henrik Andreasson<br />

Study visit June Study visit by KomTek Laxå summer<br />

C<br />

school for girls (7 pupils), Alexander<br />

Skoglund<br />

Study visit 040929 Study visit by school class from<br />

C<br />

Vivallaskolan, Örebro (20 pupils),<br />

Alexander Skoglund<br />

Visit at Örebro 041004 Presentation of AASS and Robotdalen by A


30 AASS – Center for Applied Autonomous Sensor Systems<br />

university by local<br />

Ester Liljedahl<br />

politicians<br />

Study visit 041018 Study visit by school class from<br />

Vivallaskolan, Örebro (20 pupils),<br />

Alexander Skoglund<br />

Study visit 041019 Study visit by school class from<br />

Vivallaskolan, Örebro (20 pupils),<br />

Alexander Skoglund<br />

Study visit 041021 Study visit by school class from<br />

Vivallaskolan, Örebro (15 pupils),<br />

Alexander Skoglund<br />

Visit 041105 NIROS-demonstration, Dimiter Driankov<br />

and Mathias Broxvall<br />

C<br />

C<br />

C<br />

A,C<br />

OTHER PRESENTATIONS<br />

Activity Time Performance Target group<br />

Annual graduate 040123 Presentation of research topics by graduate B<br />

symposium at AASS<br />

students<br />

Annual academic February Public lecture by Ivan Kalaykov C<br />

festivities, Örebro<br />

Annual Report March Annual Report 2003 was published on A and B<br />

AASS web and sent out to different<br />

contacts.<br />

RoboCup 040627- Competitions with the Robotic dogs and B,C<br />

040705 seminars. Alessandro, Kevin<br />

Doctoral dissertation 041001 Ola Peterssons doctoral dissertation<br />

A, B<br />

”Model-Free Execution Monitoring in<br />

Behaviour-Based Mobile Robotics” was<br />

presented<br />

Licentiate dissertation 041001 Lars Jennergrens licentiate dissertation A, B<br />

“Flexible Assembly of Ready-to-eat Meals”<br />

was presented<br />

Research folder October AASS research folder was updated (in time A, B<br />

for the Technical fair in Stockholm)<br />

Visit by Invest in<br />

Sweden Agency<br />

041012 Presentation of AASS and Robotdalen by<br />

Dimiter Driankov and Ester Liljedahl,<br />

arranged by Business Region Örebro at<br />

A<br />

Seminar “Roads to<br />

technology”, Örebro<br />

university<br />

No Limits<br />

Annual academic<br />

festivities (årshögtid)<br />

Atlas Copco, Örebro<br />

041021 Presentation of summer school for girls by<br />

Ester Liljedahl<br />

November Participation in First Lego Leaguecompetition,<br />

in co-operation with the<br />

Örebro community technical school<br />

February Public lecture by Ola Pettersson and<br />

received his doctor’s degree<br />

C<br />

A, B


Annual Report <strong>2004</strong> 31<br />

PRESS RELEASES<br />

During the year press releases were sent out and also published on Örebro universities web<br />

(http://www.oru.se/templates/oruExtNormal____19607.aspx).<br />

Time Subject Target group<br />

<strong>2004</strong>-09-08 Ola Petterssons doctoral dissertation *) (Robotar kan lära av A, B<br />

sina misstag)<br />

<strong>2004</strong>-09-06 Robotdalens dag (Robotar ökar tillväxten) A<br />

<strong>2004</strong>-08-02 Summer course for girls (Legorobotar lockar tjejer till<br />

teknikstudier)<br />

C<br />

*) The press release about Ola Petterssons dissertation was also translated into English by the<br />

Swedish Research Council (Vetenskapsrådet) and sent out internationally.<br />

MEDIA<br />

Activity Time Performance Target group<br />

Nerikes Allehanda March Article about Amy Loutfis research A, B<br />

Nerikes Allehanda March Article about KK-foundation supporting A, B, C<br />

research at Örebro university<br />

Örebrokuriren August Article about summer course for girls<br />

A, C<br />

(before the course)<br />

Örebrokuriren August Article about summer course for girls (after A, C<br />

the course)<br />

TV4 Bergslagen August News presentation about summer course for A, C<br />

girls<br />

OruMagasinet 12/<strong>2004</strong> Article about Amy Loutfi and her research A, B, C<br />

www.oru.se, Nyheter September Article about Robotdalens dag A, B, C<br />

Nerikes Allehanda September Article about an industrial co-operation A<br />

within Robotdalen (published the day before<br />

Robotdalens dag)<br />

Nerikes Allehanda September Robotdalens dag (from the day) A, C<br />

Örebrokuriren September Robotdalens dag (about the day) A, C<br />

The European<br />

Commissions<br />

Research website<br />

(http://europa.eu.int/c<br />

omm/research/headlin<br />

es/news/article_04_09<br />

_27_en.html<br />

September Article about Ola Petterssons doctoral<br />

dissertation ” Model-Free Execution<br />

Monitoring in Behaviour-Based Mobile<br />

Robotics”<br />

A, B<br />

Mobile Robotics news<br />

website<br />

(www.mobilerobotics.<br />

org/robots/)<br />

September Article about Ola Petterssons doctoral<br />

dissertation ” Model-Free Execution<br />

Monitoring in Behaviour-Based Mobile<br />

Robotics”<br />

www.oru.se/aass October Article and information about AASS<br />

participation at the Technical fair in<br />

Stockholm<br />

A, B<br />

A


32 AASS – Center for Applied Autonomous Sensor Systems<br />

www.robotdalen.org October Article and pictures from Robotdalens stand A<br />

at the Technical fair<br />

Nerikes Allehanda November Article from First Lego League-competition C<br />

Nerikes Allehanda, November Article about research funds from the<br />

A, B<br />

www.oru.se (som<br />

forskningsnyhet) and<br />

www.oru.se/aass<br />

Swedish Research council to a project at<br />

AASS run by Silvia Coradeshi.<br />

www.oru.se November Article about study visits for pupils at<br />

C<br />

AASS during October.<br />

Nerikes Allehanda February Article about public lecture by Ola<br />

C<br />

Pettersson at <strong>annual</strong> academic festivities<br />

Nerikes Allehanda February Article about Robotdalen co-operation A<br />

In September <strong>2004</strong> AASS new web (www.oru.se/aass) was published. From September <strong>2004</strong> –<br />

February 2005 17 articles were published covering seminars, research and activities that<br />

AASS participated in (http://www.oru.se/templates/oruExtNormal____21544.aspx).<br />

1.7.2 Industry, public authorities, and research funding bodies<br />

Well-established means for disseminating information about AASS research results and their<br />

industrial potential amongst these parts of the Swedish industry that can directly/indirectly<br />

benefit from it are:<br />

- Joint projects: See section 1.6.4.3<br />

- Industrial PhD students: See section 1.6.1<br />

- AASS Seminars: See section 1.7.5.1<br />

- Industrial fairs and exhibitions: See 1.7.1<br />

- Industrial associations and interest groups: Robotdalen, SWIRA, SIK,<br />

OIC (Orebro Innovation Centre), NIROS<br />

1.7.3 Research Community and university students<br />

Disseminating information about AASS research profile and its educational role and potential<br />

is done via the traditional dissemination channels, such as:<br />

- Publications<br />

- Conference participation<br />

- Organisation of scientific events<br />

- AASS guest-researchers, guest-students, and visits<br />

- National/international networks<br />

- Joint research projects<br />

1.7.4 General Public<br />

The general public and various civil authorities are informed via the web, public lectures, and<br />

media presence such as newspaper articles. AASS had several articles in the University's<br />

magazine, which is spread to more than 2000 companies and organizations. We also arranged<br />

several "open houses" with demos for the general public as well as public seminars that we<br />

have regularly see 1.7.1 and 1.7.5.1.


Annual Report <strong>2004</strong> 33<br />

Seminars<br />

1.7.5.1 Regular AASS Seminars<br />

Schedule for March <strong>2004</strong>- February 2005<br />

Date Speaker Title of seminar<br />

040301 Prof. Gurvinder S. Smelling mobile robots<br />

Virk, University of<br />

Leeds, UK<br />

040308 Mathias Broxvall,<br />

AASS<br />

Have another look: On Failures and Recovery Planning in<br />

Perceptual Anchoring<br />

041001 Joachim Hertzberg, Towards Cognitive Robotics in 7D<br />

Osnabrück University,<br />

Germany<br />

041011 André Treptow,<br />

Tübingen University,<br />

Germany<br />

Active People Recognition Using Thermal and Grey<br />

Images on Mobile Robots<br />

041011 Cipriano Galindo,<br />

University of Malaga,<br />

Spain<br />

Modelling robot environments through a multihierarchical<br />

fashion: the Multi-AH-graph model<br />

041012 Rainer Palm Multi-step-ahead prediction in control systems using<br />

Gaussian Processes and TS-Fuzzy Models<br />

041122 Peter Biber, Tübingen<br />

university, Germany<br />

Dynamic Maps for Long-Term Operation of Mobile<br />

Service Robots<br />

041213 Tom Ziemke, Skövde Agent-environment state machines<br />

university, Sweden<br />

050110 Abdelbaki Bouguerra Execution failure recovery in mobile robotics: a survey<br />

050214 Henrik Andreasson,<br />

PhD-student AASS<br />

Improving model extraction by fusing Vision and 3D<br />

laser data


34 AASS – Center for Applied Autonomous Sensor Systems<br />

2. Research Labs<br />

At the present time AASS consists of four research laboratories that have joined their<br />

expertise to cover and integrate the broad spectrum of scientific disciplines needed for the<br />

design and implementation of industrially relevant autonomous systems. This would be<br />

practically impossible for any individual laboratory, but is achievable by a joint effort, which<br />

is organized in the form of AASS. This joint effort is aimed not only at expanding the<br />

frontiers of the science of autonomous sensor systems, but also gradually incorporating it in<br />

the graduate and undergraduate curriculum, and producing physical demonstrators of<br />

autonomous sensor systems with industrial and educational relevance.<br />

The common scientific denominator for the four research laboratories is the subject of<br />

"perception and autonomy in diverse un- and/or semi-structured environments''. We<br />

pursue this subject using a common research methodology, which is strictly applied: all<br />

technologies that we investigate should answer actual needs that emerge from an application,<br />

and their effectiveness is always validated on the application.<br />

Note that under each research project funding by KK-Foundation implies corresponding<br />

amount of support from the following companies:<br />

• ABB Automation Technology Products AB/Robotics,<br />

• ABB Automation Technology Products AB/Instrumentation and control<br />

• FFV Aerotech Telub AB<br />

• DELFOI<br />

• AssiDomän<br />

• SIK


Annual Report <strong>2004</strong> 35<br />

2.1 Biologically Inspired Systems Lab<br />

Our objective is to advance the state-of-the-art in the area of biologically inspired sensing,<br />

perception and control systems. That is, the development of sensors, actuators and methods<br />

for sensory information perception and fusion that mimic the structure and capabilities of<br />

biological systems. Achieving this objective would provide, on one hand, more reliable and<br />

accurate measurement and quality assessment devices. On the other hand, it contributes to the<br />

development of artificial intelligent systems, helping humans to avoid repetitive, unskilful,<br />

and hazardous tasks. Our current research activities are focused in two major directions:<br />

biologically inspired sensing and information fusion, and dexterous manipulation.<br />

2.1.1 Research directions<br />

• Sensing and information fusion<br />

We design robust and compact sensors, which are able to<br />

perform human-like smell- and taste sensing in a variety of<br />

real world environments. To complement the sensors<br />

systems, we also investigate methods for pattern recognition,<br />

sensory information fusion and active perception.<br />

The projects in this direction include electronic tongues for<br />

online quality assessment of water and food products. A<br />

further extension of this concept is the artificial sensory head<br />

which is equipped with sensors, related to the five primary<br />

human senses (taste, smell, sound, vision and touch).<br />

• Dexterous manipulation<br />

This research direction addresses different aspects of the control of a five-fingered artificial<br />

hand, ranging from actuator control to grasping and manipulation. The objective of the project<br />

is to develop new methods for dexterous manipulation in complex, unstructured environments<br />

by mimicking the way humans use their hands. To deal with the high complexity of the<br />

problem, we will employ a biologically inspired motor control scheme, tightly integrated with<br />

the sensing and perception part of the system. The artificial hand can be used as a research<br />

platform for advanced robotic applications or as a test bed for development of prosthetic<br />

devices.


36 AASS – Center for Applied Autonomous Sensor Systems<br />

2.1.2 Research Projects in <strong>2004</strong><br />

Project: Electronic tongue for water quality assessment, J413.<br />

Project leader: Peter Wide<br />

Staff: Malin Lindquist, Boyko Iliev<br />

Funding: KK-foundation and Faculty<br />

Partners: HVR Water Purification<br />

Synopsis:<br />

The project belongs to the research area of Sensing and Information Fusion. The objective is<br />

to build up a new integrated, robust, reliable, low mass/power, electronic tongue for water<br />

quality assessment. It can be used in an under water vehicle (or robot) in order to provide real<br />

time water quality monitoring in drinking water reservoir. Previous version of the electronic<br />

tongue included four electrodes: gold, platinum, iridium and rhodium and a reference<br />

electrode. Relays are used to switch between the different electrodes. Since the reference<br />

electrode was made of fragile glass, it was not suitable for use in mobile platforms. The new<br />

tongue will be made of a stainless steel tube including two gold and platinum electrodes<br />

placed on its inner part. To measure a sample, the water must fill up the tube. A second<br />

prototype of the tongue will be adapted for continuous quality monitoring of streaming water.<br />

In this version, the complementing electronic unit will perform all necessary data processing<br />

and inform the user about the quality with the help of light signals. The project will end in<br />

2005.<br />

Results in <strong>2004</strong>:<br />

- Licentiate thesis of Malin Lindquist;<br />

- A more robust version of the electronic tongue for water quality assessment is developed<br />

and tested.<br />

- One article presented on Sensors for Industry Conference, SICON’04, New Orleans,<br />

USA, Feb <strong>2004</strong>.<br />

- One article presented on International Measurement Technology Conference IMTC’04,<br />

Como, Italy, July <strong>2004</strong>.<br />

Future developments:<br />

- Extensive reliability testing and evaluation in different working conditions, including<br />

measurements of streaming water.<br />

- Water quality assessment application in real environment.<br />

- Completion of the doctoral thesis of Malin Lindquist.


Annual Report <strong>2004</strong> 37<br />

Project: Electronic tongue for food quality assessment, J423<br />

Project leader: Boyko Iliev<br />

Staff: Malin Lindquist, Peter Wide<br />

Funding: Faculty and KK-foundation<br />

Partners: None<br />

Synopsis:<br />

The project belongs to the research area of Sensing and Information Fusion. The objective is<br />

to build up an electronic tongue, which could be adaptable to the structural and functional<br />

constraints of the new artificial sensory head. This tongue will also be used to test the mixture<br />

of tastes. Therefore its output will be separately subjected to the wavelet transform based<br />

feature extraction and to the hybrid ANN based classification method. Study and<br />

implementation of the human-like cognitive perspective to the linguistic descriptions of the<br />

taste is envisaged. This project is closely connected to the development of the electronic<br />

tongue for water quality assessment since the projects share certain hardware and software<br />

components. The main difference between the projects come from the fact that the variation<br />

in the content of food samples is much higher than in water samples. This requires dedicated<br />

solutions for both the measurement procedure and data analysis. Currently, the focus of the<br />

project has shifted towards the more general problem of food quality assessment and is no<br />

longer restricted to the artificial head platform. Therefore, the work will continue during<br />

2005.<br />

Results in <strong>2004</strong>:<br />

- A methodology for testing solid food samples is under development. Initial experiments<br />

with baby food were performed.<br />

- An algorithm for online quality assessment based on fuzzy logic.<br />

- One article submitted.<br />

Future developments:<br />

- Refinement of the methodology for measurements of solid food products.<br />

- Feature extraction technique based on wavelet transform, which is able to deal with the<br />

high variations in content of the food samples.


38 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Artificial sensory head, J439<br />

Project leader: Boyko Iliev<br />

Staff: Linn Robertsson, Peter Wide<br />

Funding: Faculty and KK-foundation<br />

Partners: Intelligent Control Lab<br />

Synopsis:<br />

The project belongs to the Sensing and Information Fusion research direction. The objective<br />

is to complete the artificial sensory head by equipping it with sensors, dedicated to the five<br />

primaries human-like senses, so it can be used for food quality assessment. However, the<br />

whole system should also be considered as a common application platform for any sensory<br />

and/or data fusion based research activities. Our main goal is to bring the second version (2G)<br />

of the previous electronic head closer to its biological counterpart in the sense of sensation<br />

and perception processes. Furthermore, the sensing and clustering/classification algorithms<br />

will also be associated with facial expression by means of 3D facial animation software from<br />

Cambridge Research Laboratory. The project will be completed in 2005.<br />

Results in <strong>2004</strong>:<br />

- One conference article presented on Information Processing and Management of<br />

Uncertainty in Knowledge Based Systems, IPMU’04, Perugia, Italy, July <strong>2004</strong>.<br />

- Completed motion control and data acquisition modules.<br />

Future developments:<br />

- Experiments on food quality assessment and development of appropriate sensor fusion<br />

methods.<br />

- Experimental evaluation of perception and sensor fusion models.


Annual Report <strong>2004</strong> 39<br />

Project: Artificial Hand, J444<br />

Project leader: Boyko Iliev<br />

Staff: Rainer Palm<br />

Funding: Faculty<br />

Partners: Elumotion Ltd. UK, INSERM 483-Paris 6<br />

Synopsis:<br />

The project mainly belongs to the Dexterous Manipulation research area. The objective is to<br />

supply dexterous grasp capabilities for a 5-fingered anthropomorphic hand. The prototype<br />

hand has 15 joints (5DIP+5PIP+5MCP) and is equipped with force (tactile) and joint angle<br />

sensors. To achieve higher degree of anthropomorphism, electrically active polymer (EAP)<br />

artificial muscles will actuate the hand. Our goal is to implement intelligent sensory-motor<br />

control schemes for visually guided reach and grasp, which incorporates biological constraints<br />

in terms of architecture and behaviour. The work will be based on the interaction of four<br />

fundamental elements of movement control: 1) Task related anticipatory information<br />

concerning goal selection (Motion planning), 2) Visual information, 3) Tactile information,<br />

and 4) Execution related information. The hand design is such that it can be mounted on both<br />

already existing 6 degrees of freedom lightweight robot arms of the Intelligent Control Lab.<br />

Due to the serious technical problems of the currently available EAP muscles, the hand was<br />

actuated with electrical motors. However, if the capabilities of the future EAP muscles satisfy<br />

the performance requirements, they will be considered in an alternative actuation scheme. The<br />

project will continue in 2005.<br />

Results in <strong>2004</strong>:<br />

- New design specification of the hand, based on DC motors.<br />

- According to the new design, the hand has now 11 individually actuated degrees of<br />

freedom. Elumotion Ltd. Designed and installed the actuation stage.<br />

- Hand simulation environment and low-level control programs are developed.<br />

Future developments:<br />

- Completion of the control system of the hand.<br />

- Applications in sensor-based dexterous manipulation.


40 AASS – Center for Applied Autonomous Sensor Systems<br />

2.1.3 Staff<br />

Prof. Peter Wide received his MSc. Eng. and Licentiate-of-Technology degrees in 1984 and<br />

1987 from the Dept. of Measurement Technology, University of Linköping, Sweden. In<br />

parallel to his academic career he has worked in different electronic industries for more than<br />

15 years as test engineer, development manager, and technical consultant. He received his<br />

PhD in Measurement Science and Technology from Linköping University in 1996. Peter<br />

Wide has been a visiting researcher at the Siemens Corporate R & D Fuzzy Research<br />

Laboratory in Munich, Germany in 1994 and at the School of Information Technology and<br />

Engineering (SITE), University of Ottawa, Canada, in 1997.<br />

Peter Wide is one of the founders of the Centre for Applied Autonomous Sensor System,<br />

where he is now the director. During the last four years he has authored and co-authored<br />

about 60 conference/journal papers. He serves in the program committees of several<br />

international conferences and as a reviewer for IEEE-journals. He is an active member of the<br />

IEEE Instrumentation and Measurement (IM) Society. His professional interests are mainly<br />

related to the fields of sensors, feature extraction, sensor data fusion and quality<br />

measurements.<br />

Rainer Palm is Adjunct Professor at the Department of Technology (AASS), University<br />

Örebro since <strong>2004</strong>. Until <strong>2004</strong> he was a Principal Research Scientist in the Neural<br />

Computation Department of the Siemens Corporate Research Technology in Munich,<br />

Germany, working both in research projects and industrial applications of Automatic Control,<br />

Fuzzy Control, Modelling of Dynamic Systems, and Distributed Systems.<br />

He has been active as a control engineer since 1972 doing research and development in the<br />

field of testing machines for electronic devices. He received his Dipl. Ing. Degree from the<br />

Technical University of Dresden, Germany, in 1975. From 1982 on he worked in the robotic<br />

research area in particular in the field of sensor-guided robots. He received the Dr. Ing.<br />

Degree from the Humboldt-University Berlin, Germany, in 1981, and the Dr. sc. tech. degree<br />

from the Academy of Sciences, Germany, in 1989.<br />

Since 1991 Rainer Palm has held a position at the a fuzzy logic task force group at Siemens<br />

AG in which he developed several fuzzy control methods used in industrial prototypes and<br />

applications. Since 1992 he had a close co-operation with the Department of Computer<br />

Science, Linköping University, and since 1998 with the Department of Technology (AASS),<br />

University Örebro. He is author /co-author, editor/co-editor of 15 books or chapters in books,<br />

author/ co-author of 15 articles in journals, and author /co-author of 30 articles in Conference<br />

proceedings. He is also author / co-author of 14 patents. His research interests include<br />

automatic control, fuzzy control, and robotics.<br />

Boyko Iliev is a research associate at the Department of Technology (AASS), Örebro<br />

University. He received his M.Sc. in Control Systems Engineering from the Technical<br />

University, Sofia, Bulgaria in 1997. During the period 1997-1998 he worked as a research<br />

assistant at the Central Laboratory for Parallel Processing, Bulgarian Academy of Sciences. In<br />

October 1998 he became a graduate student at the Centre for Applied Autonomous Sensor<br />

Systems (AASS), Örebro University and received a Licentiate of Technology degree in 2002.<br />

He received the Ph.D. degree from Örebro University in <strong>2004</strong> in the area of Industrial<br />

Measurement Technology. Since March <strong>2004</strong> he is with the Centre for Applied Autonomous


Annual Report <strong>2004</strong> 41<br />

Sensors Systems and a leader of the Biologically Inspired Systems Lab. He is an author/coauthor<br />

of over 15 conference and journal publications.<br />

His research interests include fuzzy and sliding mode control, and biologically inspired<br />

systems and dexterous manipulation.<br />

Malin Lindquist was born in Örebro, Sweden on November 5, 1975. She received her MSc<br />

degree in automation engineering in 2001 from Örebro University. She has been a graduate<br />

student at the Centre for Applied Autonomous Sensor Systems, Örebro University, Sweden<br />

since 2000. Her current research interests are in biologically inspired sensors and specifically<br />

electronic tongues. She received a Licentiate of Technology degree from Örebro University in<br />

<strong>2004</strong>.<br />

Jan Spännar was born in Smedjebacken, Sweden on March 23, 1964. He received a Master<br />

degree in Applied Physics and Electrical Engineering at Linköping Institute of Technology,<br />

Sweden in 1989. Since fall 1999 he has been a graduate student at the Centre for Applied<br />

Autonomous Sensor Systems, Örebro University. He received his licentiate-of-technology<br />

degree from AASS, Örebro Univ. in 2002. His current research interests include modelling<br />

and identification with applications to process measurement.<br />

Linn Robertsson was born in Örebro in 1979. She was awarded the degree of Master of<br />

Science in Engineering with the specialization on aerospace technology at Luleå University of<br />

Technology in 2001. Since fall 2002 she has been a graduate student at the Centre of Applied<br />

Autonomous Sensor Systems, Örebro University, Örebro, Sweden. Her current research<br />

interests are biologically inspired Sensory Information Fusion Systems and feature extraction<br />

methods.


42 AASS – Center for Applied Autonomous Sensor Systems<br />

2.2. Mobile Robotics Lab<br />

The main project structure in this Lab in <strong>2004</strong> was the same as the one in 2003. All the work<br />

done by this Lab in <strong>2004</strong> concentrated around three vertical research lines, plus one horizontal<br />

line. The project structure is described in the next subsection. The following sub-section<br />

<strong>report</strong>s the activities within each individual project.<br />

2.2.1. Research directions<br />

The general objective of the AASS Mobile Robotics Lab is the development of autonomous<br />

mobile robots that can operate without the need human intervention in unmodified<br />

environments. Our specific research focus is the crucial problem of the integration of higherlevel<br />

cognitive processes into a physically embedded system. The intended scientific<br />

breakthrough of this focus is to provide the "missing link" between the field of Artificial<br />

Intelligence, especially in the area of knowledge representation and reasoning, and the field of<br />

Autonomous Robotics, especially in the area of sensor-based control of autonomous systems.<br />

We address in particular three facets of the integration problem: (i) integration between<br />

reasoning about goals and performance of actions, (ii) integration between models of the<br />

world at different levels of abstraction, and (iii) integration between symbols and sensor data.<br />

In all cases, we study the above problems both in the case of a single robot, and in the case of<br />

multiple cooperating robots.<br />

These facets are reflected in our four research lines:<br />

1. Behavioural plans<br />

We study how a robot can form plans for actions, and then execute them in the face of<br />

uncertainty and changing conditions in the environment.<br />

2. Hybrid maps<br />

The environment of the robot can be represented at different levels of abstraction, like the<br />

geometry of a room, the topology of a building, or the roadmap of a city. We study the<br />

problem of how to integrate these representations, and how to exploit the synergies<br />

between them.<br />

3. Perceptual anchoring<br />

Humans often use symbolic names to refer to objects, like "Room-22", when<br />

programming a robot or interacting with it. The robot, however, can only access sensor<br />

data, like an image from a camera. We have pioneered the field of "perceptual anchoring",<br />

that is, the connection between symbols and sensor data that refer to the same physical<br />

objects.<br />

4. Cooperation<br />

We study how to deal with the previous issues in the case of a team consisting of multiple<br />

robots and possibly humans. This research line is "horizontal" in the sense that it considers<br />

all the above issues, adding the additional dimension of cooperation.


Annual Report <strong>2004</strong> 43<br />

2.2.2. Projects in <strong>2004</strong><br />

Project: Model-free execution monitoring, J412<br />

Project leader: Ola Pettersson<br />

Staff: Alessandro Saffiotti, Lars Karlsson<br />

Funding: Faculty<br />

Synopsis:<br />

Intelligent mobile robots need the ability to integrate robust navigation facilities with higher<br />

level reasoning. This project aims at combining results and techniques from the areas of robot<br />

navigation and of intelligent agency. In particular, we investigate techniques that allow the<br />

robot to decide when to go on with execution, and when to stop and ponder about a new<br />

situation. Our current efforts are directed towards the monitoring of the current execution of a<br />

B-Plan (Behavioural Plan) in order to detect and identify possible failures. We focus on the<br />

use of pattern recognition techniques that avoid the need for a predictive model of the system.<br />

This project belongs to the research line "Behavioural plans". The objective is to investigate<br />

the use of model-free techniques for execution monitoring. The main "pull" is academic.<br />

Results in <strong>2004</strong>:<br />

- PhD thesis by Ola Pettersson, titled “Model-Free Execution Monitoring in Behaviour-<br />

Based Mobile Robots”. The thesis was defended on October 1, <strong>2004</strong>.<br />

- Submission of a journal paper summarizing part of the PhD thesis. A second journal<br />

submission is in preparation.<br />

Partners: None.<br />

Future developments:<br />

- The project was completed in <strong>2004</strong> and it will not be continued in 2005.


44 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Hybrid maps, J415<br />

Project leader: Pär Buschka<br />

Staff: Alessandro Saffiotti<br />

Funding: KK-foundation - IT and Faculty.<br />

Synopsis:<br />

Autonomous mobile robots need to use spatial information about the environment in order to<br />

effectively plan and execute navigation tasks. This information can be represented at different<br />

level of abstractions and of locality. Each level is adequate for some sub-tasks, but not for<br />

others. In this project we study hybrid maps, representations of the space that integrate<br />

different levels of locality and abstraction. Hybrid maps are expected to provide a way for<br />

robots to scale up to much larger environments, which cannot be modelled using metric maps.<br />

This project belongs to research direction "Hybrid Maps". The objective is to define H-Maps,<br />

and the processes needed to build them and to use them in autonomous agents. The main<br />

"pull" is academic.<br />

Results in <strong>2004</strong>:<br />

- Presented a paper on the analysis and definition of the concept of "hybrid maps" at the Int.<br />

Conf. on Intelligent Autonomous Systems (IAS, Amsterdam, NL, April <strong>2004</strong>).<br />

- Presented a paper on fuzzy maps at the Int. Robocup Symposium (Lisbon, PT, July <strong>2004</strong>).<br />

Joint work with project J-448.<br />

- Paper on the survey and classification of hybrid maps submitted to a journal.<br />

- Implemented experimental system to build hybrid maps, and used for extensive<br />

experimentation.<br />

- Started the integration between hybrid maps and multi-hierarchical maps, joint work with<br />

University of Malaga.<br />

Partners:<br />

- University of Malaga, Spain.<br />

- AASS Learning Systems Lab.<br />

Future developments:<br />

- Submission of journal paper on the integration between hybrid maps and multihierarchical<br />

maps.<br />

- PhD Thesis of Pär Buschka expected to be completed during the first half of 2005.


Annual Report <strong>2004</strong> 45<br />

Project: Behaviour-based control of a mobile manipulator, J416<br />

Project leader: Zbigniew Wasik<br />

Staff: Alessandro Saffiotti<br />

Funding: Faculty and KK-foundation<br />

Synopsis:<br />

In this project, we investigate new solutions to the mobile manipulation problem. The<br />

investigation proceeds along two lines: (i) to develop a behaviour-based approach to real-time<br />

visual serving of a manipulator; and (ii) to extend the "Thinking Cap" architecture to cope<br />

with the simultaneous control of the manipulator and of the mobile platform on which the arm<br />

is mounted. The target tasks will include the ability to grasp and move objects in an<br />

unmodified indoor environment. This project belongs to the research line "Behavioural<br />

plans". The objective is to investigate the use of behaviour-based plans to control more<br />

complex plants than a mobile platform, e.g., a mobile manipulator. The main "pull" is<br />

academic, but flexible mobile manipulation is also expected to have industrial relevance in the<br />

future.<br />

Results in <strong>2004</strong>:<br />

- Extension of the behaviour-based manipulation system to perform combined mobility and<br />

manipulation.<br />

- The writing of the PhD thesis of Zbigniew Wasik has been completed.<br />

Partners:<br />

- University of Rome-3, Italy.<br />

Future developments:<br />

- The project will be completed with the defence of the PhD thesis of Zbigniew Wasik, in<br />

Spring 2005.


46 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Symbolic reasoning for perception, J424<br />

Project leader: Amy Loufti<br />

Staff: Silvia Coradeschi, Alessandro Saffiotti<br />

Funding: KK-foundation and Faculty<br />

Synopsis:<br />

In this research line we investigate the use of symbolic reasoning techniques for robot<br />

perception. We focus in particular on one challenging perception problem: the use of an<br />

electronic nose (e-nose). The e-nose is a type of sensor which is rapidly gaining popularity<br />

because of its many potential applications. We consider the problem of integrating the<br />

information provided by the e-nose with both prior information and information from other<br />

sensors (e.g., vision), as well as the problem of deciding when, how and where the e-nose<br />

should be activated. We will consider ideas developed in the field of AI for diagnosis and for<br />

planning of perceptual actions. We will also use, and possibly extend, the framework for<br />

"perceptual anchoring" developed in project J-445 to connect symbolic techniques to the<br />

sensor data provided by the e-nose. Experiments will be performed on a mobile robot<br />

equipped with an e-nose together with a variety of more conventional sensors, including<br />

vision. This project belongs to the research line "Perceptual anchoring". The general<br />

objective is to investigate the use of symbolic reasoning techniques for perception, with<br />

special focus on the use of e-noses. The main "pull" is academic.<br />

Results in <strong>2004</strong>:<br />

- Submission of journal paper summarizing the results of the Licentiate of Amy Loutfi.<br />

- Publication of a paper on forming odour categories (European Conf on AI, Valencia,<br />

Spain).<br />

- Publication of a paper on the use of sensor planning in olfaction (Int. Conf. on Intelligent<br />

Robots and Systems, Sendai, Japan). Joint work with project J-446.<br />

- Contributed a chapter on artificial perceptual systems to the Handbook of Sensor<br />

Networks (CRC Press).<br />

- Thesis plan for Amy Loutfi defined.<br />

- Integration of the software for the e-nose into the Thinking Cap platform.<br />

Partners:<br />

- BIS Lab at AASS.<br />

Future developments:<br />

- Submission of paper on perception management to IJCAI-05.<br />

- Extensive experimental evaluation of the integration between olfaction and other sensing<br />

modalities through anchoring.<br />

- Work toward the completion of the PhD thesis of Amy Loutfi, expected in 2006.


Annual Report <strong>2004</strong> 47<br />

Project: Perceptual anchoring, J445<br />

Project leader: Silvia Coradeschi<br />

Staff: Alessandro Saffiotti, Mathias Broxvall, Kevin LeBlanc<br />

Funding: Swedish Research Council (Vetenskapsrådet) and CUGS<br />

Synopsis:<br />

Intelligent agents embedded in physical environments need the ability to connect the symbols<br />

used to perform abstract reasoning to the physical entities to which these symbols refer.<br />

Anchoring is the process of creating and maintaining the correspondence between symbols<br />

and sensor data that refer to the same physical objects. Anchoring must deal with indexical<br />

and objective references, definite and indefinite identifiers, and temporary impossibility to<br />

perceive physical entities. Furthermore it needs to rely on sensor data which is inherently<br />

affected by uncertainty, and to deal with ambiguities. This project belongs to the research line<br />

"Perceptual anchoring". The objective is the definition and the in-depth study of the problem<br />

of anchoring, and of its use in autonomous agents. The main "pull" is academic: the problem<br />

of anchoring has been defined as such at AASS, and this project aims at maintaining the<br />

position of AASS as the leader of a new research community working around this problem.<br />

Results in <strong>2004</strong>:<br />

- A three year extension grant was awarded to this project by the Swedish Vetenskapsrådet.<br />

- Organized a Workshop on Anchoring at AAAI-04 (San Jose, CA, July <strong>2004</strong>). Chairs: S.<br />

Coradeschi and A. Saffiotti.<br />

- Publication of 2 papers on dealing with ambiguities in anchoring (Int. Conf. on Intelligent<br />

Autonomous Systems, Amsterdam, NL; and ECAI Workshop on Cognitive Robotics,<br />

Valencia, Spain). Joint work with project J-446.<br />

- Publication of 1 workshop papers on anchoring in conceptual spaces (AAAI Workshop on<br />

Anchoring, San Jose, CA).<br />

Partners:<br />

- University of Palermo, Italy<br />

Future developments:<br />

- A new PhD student will be enrolled on this project, supported by the above grant.<br />

- Continue work on the resolution of ambiguities in perceptual anchoring using planning<br />

techniques.<br />

- Continue joint work with Univ. of Palermo on anchoring in conceptual spaces.


48 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Sensor-based planning for mobile robots, J446<br />

Project leader: Lars Karlsson<br />

Staff: Abdelbaki Bouguerra, Mathias Broxvall, Silvia Coradeschi, Alessandro Saffiotti<br />

Funding: Swedish Research Council (Vetenskapsrådet) and KK-foundation.<br />

Synopsis:<br />

The problem we investigate is conditional planning under uncertainty for autonomous robots.<br />

A conditional planner is able to account for different contingencies, and to plan in advance for<br />

detecting when these contingencies occur. For this purpose, we intend to research both the<br />

issues of representation, search etc for a conditional planner, and the integration of the planner<br />

into an actual robotic system. The planning techniques used will be based on an existing<br />

planner, PTLplan, which generates conditional plans taking into account probabilistic or<br />

possibilistic uncertainty, but which so far (like its competitors) has a simplified treatment of<br />

sensing. This project belongs to the research line "Behavioural plans". The objective is to<br />

extend existing planning techniques to better suit the needs of autonomous robotic<br />

applications. The main "pull" is academic.<br />

Results in <strong>2004</strong>:<br />

- Paper on hierarchical task planning under uncertainty presented at the Italian Workshop<br />

on Planning and Scheduling (Perugia, Italy).<br />

- Defined plan for Licentiate by Abdelbaki Bouguerra.<br />

- Publication of 2 papers on the use of planning to solve perceptual ambiguities (Int. Conf.<br />

on Intelligent Autonomous Systems, Amsterdam, NL; and ECAI Workshop on Cognitive<br />

Robotics, Valencia, Spain). Joint work with project J-445.<br />

- Publication of a paper on the use of sensor planning in olfaction (Int. Conf. on Intelligent<br />

Robots and Systems, Sendai, Japan). Joint work with project J-424.<br />

Partners:<br />

EC Network of Excellence on Planning: PLANET.<br />

Future developments:<br />

- Continue the study on the generation of on-the-fly plans to recover from failures in<br />

execution.<br />

- Journal submission of the work on hierarchical planning under uncertainty.<br />

- Licentiate by Abdelbaki Bouguerra to be produced by the end of 2005.


Annual Report <strong>2004</strong> 49<br />

Project: Robot team-work, J447<br />

Project leader: Robert Lundh<br />

Staff: Lars Karlsson, Alessandro Saffiotti<br />

Funding: CUGS and Faculty<br />

Synopsis:<br />

The objective of this project is to develop models and techniques to dynamically configure<br />

and re-configure a team of collaborating physical agents to adapt to the current tasks,<br />

situations and resources. Agents may be homogeneous or heterogeneous robots, and human<br />

agents may also be included in the team. The point of view is to see the team as a unique<br />

system, and each agent as providing set of functionalities. The configuration of the team is<br />

defined in terms of which agent provides which functionalities, to whom, and how. This<br />

project belongs to research line "Behavioural Plans", to which it adds the special focus on<br />

cooperation. The main "pull" of this project is academic.<br />

Partners:<br />

- EURON, the European Research Network<br />

- University of Murcia, Spain<br />

Results in <strong>2004</strong>:<br />

- Defined a framework for team configurations and implemented it in the Thinking Cap.<br />

- Published a paper about this framework at a workshop (ECAI Workshop on Agents in<br />

Dynamic and Real-Time Environments. Valencia, Spain).<br />

- Licentiate plan of Robert Lundh defined.<br />

- Set-up of an experimental platform, based on the Thinking Cap, for robot planning,<br />

navigation, and cooperation.<br />

Future developments:<br />

- Paper submission on configuration planning to IROS-05.<br />

- Work toward the licentiate of Robert Lundh (expected late 2005 – early 2006).<br />

- There will be a 6 month pause in 2006 due to parental leave.


50 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: RoboCup, J448<br />

Project leader: Kevin LeBlanc<br />

Staff: Robert Lundh, Kevin LeBlanc, Alessandro Saffiotti.<br />

Funding: CUGS and Faculty<br />

Synopsis:<br />

RoboCup is an international robot soccer competition. AASS is the leader of Team Sweden, a<br />

multi-university team currently including three Swedish universities (Orebro Univ, Lund<br />

Univ, and Blekinge Institute of Technology) and a Spanish one (Univ. of Murcia). Team<br />

Sweden has participated in all competitions since 1999, using the Sony AIBO robots as its<br />

robotic platforms. The objective of this project was to develop a team of autonomous robots<br />

able to compete in the RoboCup 2003 competition. This project belongs to the research line<br />

"Behavioural Plans", with a strong emphasis on the cooperation aspect. It has a mainly<br />

academic pull.<br />

Results in <strong>2004</strong>:<br />

- Participation in the RoboCup <strong>2004</strong> international competition in Lisbon, Portugal.<br />

- Presented a paper on cooperative object localization at the Int. Robocup Symposium<br />

(Lisbon, PT, July <strong>2004</strong>). Joint work with project J-463.<br />

- Presented a paper on fuzzy maps at the Int. Robocup Symposium (Lisbon, PT, July <strong>2004</strong>).<br />

Joint work with project J-415.<br />

- Presented a paper on localization with natural landmarks at the Int. Conf. on Information<br />

Processing and Management of Uncertainty (Perugia, Italy). Joint work with project J-<br />

415.<br />

Partners:<br />

Team Sweden (Orebro Univ, Lund Univ, and Blekinge Institute of Technology in Sweden;<br />

plus Univ of Murcia in Spain).<br />

Future developments:<br />

- This project will be discontinued in 2005.


Annual Report <strong>2004</strong> 51<br />

Project: Navigation System for Automatic Loaders, J449<br />

Project leader: Johan Larsson<br />

Staff: Mathias Broxvall, Alessandro Saffiotti.<br />

Funding: Robotdalen, Atlas Copco and Faculty<br />

Synopsis:<br />

This project comprises development of a robust and flexible navigation system for<br />

underground mine loaders (LHD, Load Haul Dump) that has only modest requirements in<br />

terms of infrastructure. The goal is to enable autonomous operation of these vehicles. This is<br />

accomplished by combining the mobile robotics skills at the AASS Mobile Robotics Lab with<br />

the knowledge of “real-world” applications of Atlas Copco Rock Drills AB. The idea is to<br />

have a navigation system that supports collections of sensors sufficient for operation in both<br />

open and closed environments. This project belongs to the research line "Behavioural plans".<br />

The objective is to use the B-plan technology to develop an autonomous system for Load-<br />

Haul-Dump operation in underground mines. The main "pull" is industrial.<br />

Results in <strong>2004</strong>:<br />

- Analyzed the state of the art in autonomous mining<br />

vehicles.<br />

- Defined the main approach and technologies.<br />

- Defined the sensors to be used, analyzing data<br />

collected in a test mine.<br />

- Developed a first version of a laboratory demonstrator<br />

running at high speed.<br />

Partners:<br />

Atlas Copco Rock Drills AB.<br />

Future developments:<br />

- Integrate RFID-based localization in the laboratory<br />

demonstrator, and test it in a mining environment.<br />

- Paper submission to the IFR conference.<br />

- Start the porting of the technique to the real vehicle.


52 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Cooperative perceptual anchoring, J463<br />

Project leader: Kevin LeBlanc<br />

Staff: Silvia Coradeschi, Alessandro Saffiotti<br />

Funding: Faculty and CUGS<br />

Synopsis:<br />

The objective of this project is to extend the notion of anchoring to capture "cooperative<br />

anchoring". This is the problem of how to create and maintain inter-agent agreement about the<br />

meaning of the words used in the exchange of information about a common physical<br />

environment. A typical example is the problem of establishing the correspondence between<br />

the linguistic symbols used by two different robots to refer to the same physical object.<br />

Cooperative anchoring is also needed for efficient human-robot cooperation. This project<br />

belongs to research line "Perceptual Anchoring", with a strong emphasis on the cooperation<br />

aspect. The main "pull" of this project is academic.<br />

Results in <strong>2004</strong>:<br />

- Developed experimental tool for the systematic evaluation of multi-robot localization<br />

under uncertainty.<br />

- Presented a paper on cooperative object localization at the Int Robocup Symposium<br />

(Lisbon, PT, July <strong>2004</strong>). Joint work with project J-448.<br />

- Defined Licentiate plan for Kevin LeBlanc.<br />

Partners:<br />

University of Murcia, Spain.<br />

Future developments:<br />

- Systematic experimental evaluation of different techniques for fuzzy information sharing.<br />

- Licentiate thesis by Kevin LeBlanc expected during 2005.


Annual Report <strong>2004</strong> 53<br />

2.2.3. Staff<br />

Alessandro Saffiotti, PhD, is a professor of Computer Science at the Centre for Applied<br />

Autonomous Sensors Systems of Örebro University, Sweden, where he heads the Mobile<br />

Robotics Lab. He has previously been a researcher with the University of Pisa (Italy), with<br />

SRI International (USA), and with the Universite Libre de Bruxelles (Belgium). His research<br />

interests encompass autonomous robotics, soft computing, and non-standard logics for<br />

common-sense reasoning. He has published more than 80 research papers in international<br />

journals and conferences, and co-edited a book on fuzzy logic techniques for autonomous<br />

navigation.<br />

He was a chair of the 1999, 2001 and 2003 IJCAI workshops on ``Reasoning with uncertainty<br />

in robotics'', of two workshops on “Anchoring symbols to sensor data” (at AAAI 2001 fall<br />

symposium and at AAAI <strong>2004</strong>), and of two workshops on “Cooperative robotics” (at IROS<br />

2002 and at ICRA 2005). In 2002 he co-organized the First European Summer School on<br />

cooperative robotics. In 2003 he was the chair of the 4-legged league at the International<br />

Robocup Competition. He will serve as chair for the poster track of IJCAI 2005. He is a<br />

member of IEEE, AAAI, and IAS.<br />

Mathias Broxvall, PhD, is a lecturer of Computer Science at the Centre for Applied<br />

Autonomous Sensor Systems of Örebro University. He presented his thesis, A Study in the<br />

Computational Complexity of Temporal Reasoning, at Linköping University within the field<br />

of temporal reasoning and constraint solving. His current research interests are autonomous<br />

robotics and planning. He has journal publications and articles in several well established<br />

international conferences. For teaching he has given programming, database, logics and<br />

artificial intelligence courses. On the side he has also contributed to and authored several<br />

large open-source projects.<br />

Silvia Coradeschi is an assistant professor at the Centre for Applied Autonomous Sensor<br />

Systems at Örebro University. She has received a master degree in Philosophy at the<br />

University of Florence, a master degree in Computer Science at the University of Pisa, and a<br />

PhD in Computer science at Linköping University. She is a member of the board of trustees<br />

of the RoboCup Federation and was general chair of the Third Robot World Cup Soccer<br />

Games and Conferences (RoboCup-99). She is also a member of the Advisory Board for the<br />

Seventeenth International Joint Conference on Artificial Intelligence (IJCAI-01) and member<br />

of the board of the European Coordinating Committee for Artificial Intelligence.<br />

Silvia Coradeshi is director of the undergraduate studies for the Computer Engineering<br />

Division at Örebro University and she is vice-head of the Technology Department. She has<br />

published 18 conference/journal papers and her main research interest is in establishing the<br />

connection (anchoring) between the symbols used to perform abstract reasoning and the<br />

physical entities, which these symbols refer to. She also works in multi-agent systems and<br />

cooperative robotics.


54 AASS – Center for Applied Autonomous Sensor Systems<br />

Lars Karlsson is an assistant professor at the Centre for Applied Autonomous Sensor<br />

Systems at Örebro University. He received a MSc. degree in Computer Science at Linköping<br />

University in 1993, and a PhD in 1999. He was a co-chair of the Third Robot World Cup<br />

Soccer Games and Conferences (RoboCup-99). He is the coordinator for the MSc program in<br />

Computer Engineering at Örebro University, and he is the director for graduate education in<br />

AASS. He has 18 conference/journal publications and his research interests include planning<br />

under uncertainty, reasoning about actions and integration between reasoning and<br />

action/perception in autonomous systems.<br />

Pär Buschka was born in Gothenburg, Sweden on April 22, 1966. He received the MSc<br />

degree in computer science and engineering in 1996 from Chalmers University of Technology<br />

in Gothenburg, Sweden. Since autumn 1999 he has been a graduate student at the Centre for<br />

Applied Autonomous Sensor Systems, Örebro University, Örebro, Sweden. His current<br />

research interests include mobile robot localization and navigation using hybrid maps.<br />

Ola Pettersson was born in Falkenberg, Sweden on March 7, 1972. He received the BSc<br />

degree in electrical engineering in 1994, and the MSc degree in electrical engineering in 1995<br />

(specialization in photonics and image analysis), both from Halmstad University, Halmstad,<br />

Sweden. In 2000 he received a Licentiate of Technology in computer science from Linköping<br />

University, Linköping, Sweden. Since fall 1996 he has been a graduate student at the Centre<br />

for Applied Autonomous Sensor Systems, Örebro University, Örebro, Sweden. His current<br />

research interests include mobile robot action control, planning, and execution monitoring.<br />

Zbigniew Wasik was born in Nowy Dwor Mazowiecki, Poland on October 13, 1973. He<br />

received both the BSc degree and the MSc degree in electrical engineering in 1998<br />

(specialization in Automation and Robotics) from Wroclaw University of Technology,<br />

Wroclaw, Poland. Since fall 1998 he has been a graduate student at the Centre for Applied<br />

Autonomous Sensor Systems, Örebro University, Örebro, Sweden. His current research<br />

includes a behaviour-based approach to real-time visual servoing of a mobile manipulator.<br />

Kevin LeBlanc was born in Moncton, New Brunswick, Canada, on November 11, 1977. He<br />

received his B.Sc. in Electrical Engineering with a Computer Engineering Option at the<br />

University of New Brunswick in May 2001. In the fall of 2002 he began graduate studies at<br />

the Centre for Applied Autonomous Sensor Systems, Orebro University, Orebro, Sweden. His<br />

research falls within the cooperative perception area; his primary focus deals with cooperative<br />

perceptual anchoring.<br />

Robert Lundh was born in Jämshög, Sweden on September 17, 1978. He received the MSc<br />

degree in Computer Technology in 2002 from Örebro University, Örebro, Sweden. Since late<br />

spring 2002 he has been a graduate student at the Centre for Applied Autonomous Sensor<br />

Systems, Orebro University, Orebro, Sweden. His current research is within the field of<br />

cooperative robotics.<br />

Abdelbaki Bouguerra was born in M'sila, Algeria on October 10, 1974. He received an<br />

Engineering degree in Computer Science in 1997 (in Computer Systems) from The National<br />

Institute of Computer Science, Algiers, Algeria, and a Master degree in Computer Science in<br />

2001 (specialization Industrial Computer Science) from the National Military Polytechnics<br />

School, Algiers, Algeria. He joined Schlumberger-Geoquest as a data management Engineer<br />

in the same year where he worked for approximately one year, and then he joined the<br />

department of computer science at Linköping University as a visiting scholar for six months.


Annual Report <strong>2004</strong> 55<br />

Since January 2003, he has been a graduate student at the Centre for Applied Autonomous<br />

Sensor Systems, Orebro University, Orebro, Sweden. His current research includes planning<br />

and execution for mobile robots.<br />

Johan Larsson was born in Norrköping Sweden, in July 1970. He received the MSc degree<br />

in mechanical engineering (specialization in mechatronics) in 1996, from the Royal Institute<br />

of Technology, Stockholm, Sweden. In 1998 he joined Atlas Copco Rock Drills, Örebro,<br />

where he has developed software for the underground drill rig control systems. Since<br />

February <strong>2004</strong> he has been a graduate student at the Centre for Applied Autonomous Sensor<br />

Systems, Örebro University, Örebro, Sweden. His current research focuses on the<br />

autonomous navigation of industrial vehicles in underground mines.


56 AASS – Center for Applied Autonomous Sensor Systems<br />

2.3 Intelligent Control Lab<br />

The objective of the lab is to build perception-based control systems able to perform humanlike<br />

motions and operations by bringing together the sensation and the control in mechatronic<br />

systems. We emphasize on two types of activities:<br />

• Development of new methodologies,<br />

technologies and equipment for<br />

implementing complex control systems.<br />

• Integrating above with soft computing<br />

methods, control algorithms and sensing<br />

technology to achieve high-speed motion<br />

control systems with embedded intelligence.<br />

2.3.1 Research directions<br />

Our work and expertise is concentrated in three major research directions:<br />

• Advanced Mechatronic Systems: we design, develop and prototype specific robotic<br />

constructions for performing dedicated stand-alone desktop operations or for integration<br />

with a mobile platform. Desired dynamic properties, balanced kinematics, minimum<br />

energy consumption, higher flexibility and compliance are combined for accomplishing<br />

maximum performance. Various interfacing and integration types of problems are<br />

addressed for achieving properties that outperform existing systems.<br />

• Advanced Control and Industrial Applications: we develop methods to control robots that<br />

are designed at our lab for performing complex behaviour like executing a motion for a<br />

minimum time, studying human arms motions for transferring them to a robot for given<br />

task. Another aspect is the industrial orientation of our work aimed at the transfer of the<br />

advanced technologies developed in the lab to industry.<br />

• Vision, Image and Signal Processing Systems: we apply, in a novel way, fuzzy similarity<br />

ideas to the development of new methods and algorithms for very efficient real-time<br />

vision and image processing, operating at high speed, and needed for any high speed<br />

motion control system. The concept of fired-rules-hyper-cube was introduced by us and<br />

implemented on FPGA-chips for fuzzy logic based control, high frequency signal and<br />

real-time image processing.<br />

In what follows we describe the work done during <strong>2004</strong> on specific projects from the above<br />

three research directions.


Annual Report <strong>2004</strong> 57<br />

2.3.2 Projects in <strong>2004</strong><br />

Project: Fast fuzzy logic image processing and fast vision system, J432<br />

Project leader: Ivan Kalaykov<br />

Staff: Gustav Tolt<br />

Funding: KK-foundation - IT and Faculty<br />

Synopsis:<br />

The project belongs to the research direction "Vision, image and signal processing". The<br />

objective is to develop techniques for high-speed image processing and high-speed vision<br />

system able to provide over 50-60 frames per second for the low and medium levels of image<br />

processing. This performance is needed for real-time image processing systems such as fast<br />

vision systems in visual-servoing tasks when it is necessary to control high-speed motion.<br />

This project is based completely on the academic challenge to outperform the current<br />

industrial vision systems, which generally limit the frequency band of robot motion control.<br />

However, the fast image processing algorithms can be used in various applications where the<br />

processing time is an important factor.<br />

Partners: None<br />

Results in <strong>2004</strong>:<br />

- One publication, two others in final stage of preparation.<br />

- Simulated image processing functions in VHDL-based; development system.<br />

- Doctoral dissertation by Gustav Tolt draft available; planned for defence in April 2005.<br />

Major contributions include:<br />

- Unified approach to image processing based on the fuzzy similarity principle.<br />

- High performance algorithms both in terms of speed and quality of the processing.<br />

- Set of hardware structures for implementing the typical image processing algorithms.<br />

- Embedded high-speed image processing algorithms using fuzzy logic.<br />

Future developments:<br />

Short-term goals:<br />

- Development and completing the theoretical issues of the unified approach to low and<br />

medium level image processing based on fuzzy similarity principle.<br />

- Experimental tests of the developed concepts and algorithms on prototype hardware<br />

system, possibly for some industrial applications under Robotdalen.<br />

Long-term goals:<br />

- Further development of the fuzzy similarity concept for higher level of image processing<br />

and for higher complexity of image-based scenarios.<br />

- Expansion of the research by opening new PhD student position(s), as this direction is<br />

foreseen as fundamental for the IC lab.<br />

- Experimental hardware platform by cooperation with the Mälardalens högskolan under a<br />

joint Robotdalen project.<br />

- Performing tests in industrial environments.


58 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Redundant robots, J441<br />

Project leader: Anani Ananiev<br />

Staff: Thorsten Michelfelder, Ivan Kalaykov<br />

Funding: Faculty<br />

Synopsis:<br />

The project belongs to the research direction "Advanced Mechatronic Systems". The<br />

objective is to overcome problems with strength, navigation and locomotion that have<br />

restricted the use of snake-like robots. The mechanical and the electronic design of the snake<br />

will be based on minimalist approach with as simple as possible mechanical construction and<br />

simplest control system. The development of environment-specific movement strategies is<br />

currently a hot topic of research.<br />

Partners:<br />

Velox Devices, LLC, New York, USA<br />

Results in <strong>2004</strong>:<br />

- One publication.<br />

- Working prototype with basic modes of motion.<br />

- Demo is available, demonstrated at ISR’<strong>2004</strong>, Paris.<br />

Major contributions include:<br />

- Unique approach for motion transmission system embodied in the robot using only one<br />

irreversible motor.<br />

- Optimised ratio of weight and force.<br />

Future developments:<br />

Short-term goals:<br />

- To complete the snake-robot with the minimum set of sensors and functionalities for<br />

performing a pre-specified set of tasks in rescue-related scenarios.<br />

- To study the electromechanical properties of the innovative driving mechanism and the<br />

respective control approaches for obtaining certain dynamical properties.<br />

- To study the constraints of the driving mechanism and the limitations on the total<br />

construction of a hyper-redundant robot of this type.<br />

Long-term goals:<br />

- To extend the approach for building hyper-redundant robots of other configurations for<br />

performing high-complexity tasks in industrial environments. This goal will be coordinated<br />

with ABB Robotics, which expressed their interests to be active industrial<br />

partner.<br />

- To build complete dynamical model of the hyper-redundant robot with this kinematics<br />

structure and unique driving mechanism


Annual Report <strong>2004</strong> 59<br />

Learning Control of Robot Arms by Emulating Human Actions, J460<br />

Project leader: Tom Duckett<br />

Staff: Alexander Skoglund: a PhD student at the Intelligent Control Lab (50%) and at the<br />

Learning Systems Lab (50%), Rainer Palm, Ivan Kalaykov.<br />

Note:<br />

This is a common project with the Learning Systems lab. For detailed description look at<br />

Section 2.3 (J460).


60 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Cooperating arms, J465<br />

Project leader: Ivan Kalaykov<br />

Staff: Anani Ananiev, Thorsten Michelfelder<br />

Funding: Faculty<br />

Synopsis:<br />

The project belongs to the research direction "Advanced Mechatronic Systems". The<br />

objective is to develop techniques for performing cooperating actions of two (or more) robotic<br />

arms in executing common tasks where one arm is needed to do the main action and the other<br />

is complementing the first, for example providing support. The cooperative actions are based<br />

on embedded learned/pre-programmed behaviours and visual guidance. Additional sensory<br />

information will be used depending on the concrete application. This project is based on<br />

purely academic idea, however certain applications are envisioned.<br />

Partners: None<br />

Results in <strong>2004</strong>:<br />

- Preparation of an experimental set-up.<br />

Future developments:<br />

- Decision to discontinue the project was made due to limited manpower and absence of<br />

possibility to employ a PhD student. Some issues on cooperating arms are foreseen as part<br />

of the hyper-redundant robot project J441.


Annual Report <strong>2004</strong> 61<br />

Project: Flexible food cell, J466<br />

Project leader: Ivan Kalaykov<br />

Staff: Anani Ananiev, Lars Jennergren<br />

Funding: KK-foundation<br />

Synopsis:<br />

The project belongs to the research direction "Advanced Mechatronic systems". The objective<br />

is to create an intelligent assembly cell for ready to eat meals. The production has to be<br />

customer oriented, which leads to shorter and more irregular production series with an<br />

increased number of different products. During the entire project the hygienic aspects and<br />

mechanical and thermal restriction of food assembly are considered. The project is started in<br />

co-operation with SIK (The Swedish institute for food and biotechnology). The work is<br />

strongly related to the food factory of the future, which is one of the major projects at SIK.<br />

The results will hopefully improve its capacity.<br />

Partners:<br />

SIK, Göteborg<br />

Results in <strong>2004</strong>:<br />

- Three publications.<br />

- Licentiate thesis officially presented and defended in August <strong>2004</strong>.<br />

Major contributions include:<br />

- Hygienic and robust manipulation of specific food groups.<br />

- A flexible cell layout that is easy to reconfigure for new product variants.<br />

- A demonstration cell that can assemble a set of pre-specified products.<br />

Future developments:<br />

- Increasing the level of intelligence in all phases of preparing the execution plan.<br />

- Increasing the robustness of the entire system by introducing continuous visual feedback<br />

during the plan execution (assembly of meals).<br />

- The project is discontinued as the employment of Lars Jennergren at SIK has finished and<br />

no further funding is available.


62 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Friction Steer Welding (FSW) Robot Welding, J467<br />

Leader: Anani Ananiev<br />

Staff: Mikael Soron, Ivan Kalaykov<br />

Funding:<br />

Robotdalen, ESAB Welding Equipment AB, Specma Automation, ABB Robotics and Faculty<br />

Project synopsis<br />

Friction Stir Welding (FSW) is a relatively new welding method invented by the TWI<br />

Company in UK in 1991. It is used for welding mainly of aluminium, for example in airplane<br />

and space industry. There exists a need for developing a technology for three-dimensional<br />

welding of large and small objects for various other industries such as car manufacturing. The<br />

goal of this project, supported by Robotdalen, is to contribute to finding proper solution based<br />

on the competence at the Intelligent Control Laboratory in robot kinematics and dynamics,<br />

and visual-servoing and force feedback control as well.<br />

Duration<br />

Started in September 2003, ends in 2005.<br />

Collaborations<br />

ESAB, Laxå<br />

Specma Automation, Laxå<br />

ABB Robotics, Västerås<br />

Results achieved in <strong>2004</strong><br />

- Survey and analysis of publications.<br />

- Concept of a licentiate thesis.<br />

- Preliminary test of feasible methods<br />

- Development and test of force-feedback system for ABB robot.<br />

Expected results 2005<br />

- Completed primary tests for the functionality of the demonstration platform.<br />

- Completed licentiate thesis of M. Soron.<br />

Major contributions include:<br />

- Developing techniques for force-feedback control of industrial robot with compensation<br />

of gravity in 3D space.<br />

- Development of fully operational demonstration platform with ABB robot force sensor<br />

and FSW-tool.<br />

Future developments:<br />

- Development of user-friendly environment for off-line planning and verifying of 3Dwelding<br />

trajectories.<br />

- Development of integrated hardware/software in the loop system for increasing the<br />

effectiveness of the set-up operations.


Annual Report <strong>2004</strong> 63<br />

Project: Vision-Based Control of Continuous Webs and Flows, J468<br />

Project leader: George Fodor<br />

Staff: Thomas Uppgård, George Fodor, Ivan Kalaykov<br />

Funding: KK-foundation and Faculty.<br />

Project synopsis<br />

The project belongs to two research directions “Advanced control and industrial applications”<br />

and “Vision, image and signal processing”. The objective is to develop and test new<br />

techniques for quality monitoring and direct control of web/texture materials flowing with<br />

high speed. This is one form of direct application of the results of the “Fast vision system”<br />

project in industry wherever appropriate.<br />

Duration<br />

Started in October 2003, continues till end of 2008.<br />

Collaboration<br />

ABB Automation Technology Products, Instrumentation and Control<br />

Results achieved in <strong>2004</strong><br />

- Survey and analysis of publications.<br />

- Concept of a licentiate thesis.<br />

Expected results 2005<br />

- Preliminary test of feasible methods<br />

- Publications<br />

Milestones<br />

March-April 2006: licentiate thesis<br />

Major contributions include:<br />

- Developing new techniques for quality monitoring and direct control of web/texture<br />

materials and real-time control of the respective machines.<br />

Relation to other projects<br />

Input from J432 (Fast fuzzy logic image processing and fast vision system): the processing<br />

unit and the respective hardware structure.


64 AASS – Center for Applied Autonomous Sensor Systems<br />

The Robot Air-hockey Player, integration project, J4XX<br />

Project leader: Ivan Kalaykov<br />

Staff: Gustav Tolt, Mikael Soron, ex-job students Lasse Nord, Daniel Magnusson<br />

Funding: KK-foundation – IT, Robotdalen and Faculty.<br />

Project synopsis<br />

The goal is to make interactive demonstrations where humans and robots share the same<br />

space or perform a co-operative task in the form of playing a game between a human and<br />

robot. The challenging problem of fast eye-to-hand reaction is in: (i) evaluating the strike of<br />

the opponent; (ii) detecting the direction of puck’s motion; (iii) predicting its trajectory and<br />

(iv) activating arm-hand motion to intercept the puck and implement counter strike to the<br />

opponent’s field. The main difficulty is the extremely short time interval to complete all these<br />

actions. To be winning, the human players must train certain time otherwise only good luck<br />

can provide victory. The task is very advanced for robot players. Extremely fast image<br />

processing and fast robots are only prerequisites for achieving such performance.<br />

Duration<br />

Started in January <strong>2004</strong>, continued till June <strong>2004</strong>.<br />

Collaboration<br />

None<br />

Results achieved in <strong>2004</strong><br />

- Developed effective control system for rapidly changing and poorly modelled<br />

environment with sensor noise and error.<br />

- Developed an accurate prediction procedure of target motion with the least computational<br />

load.<br />

- Developed a switching planning and execution control strategy, based on the estimated<br />

and predicted trajectory of the puck, before entering the robot’s play field.<br />

- Integration of all components and achieving reasonable (within the limitations caused by<br />

the available hardware components) behaviour of the entire hybrid in nature high-speed<br />

two-dimensional ballistic manipulation system.<br />

- M.Sc. thesis presented and accepted.<br />

Future developments:<br />

- Topics are clarified, but not possible to be planned for implementation, as it will depend<br />

on available resources in the next years for eventual continuation of the project.


Annual Report <strong>2004</strong> 65<br />

2.3.3 Staff<br />

Prof. Ivan Kalaykov received his Dipl. Eng. in Electrical Engineering, Ph.D. in Control<br />

Engineering from the Technical University of Sofia, Bulgaria, 1972 and 1985 respectively. In<br />

January <strong>2004</strong> he became a professor at the Dept. of Technology, Örebro University. He has<br />

been an Associate Professor at: Dept. of Control and Systems Engineering, Technical<br />

University of Sofia, since 1987; Dept. of Physics, Trömsoe University, Norway, 1998-1999;<br />

and the Dept. of Technology, Örebro University since 2000, where he is now the head of the<br />

Intelligent Control Lab. He has been a visiting researcher at the Control Laboratory of Dept.<br />

of Electrical Engineering, Delft University of Technology, Netherlands and Institute for<br />

Peripheral Microelectronics, University of Kassel, Germany. He has been also Chairman and<br />

Vice-chairman of the Bulgarian Union of Automation and Informatics (UAI - the professional<br />

society of control engineers).<br />

Ivan Kalaykov served as IPC-member of many scientific events and has more than 60<br />

conference/journal publications. His research interests include adaptive control systems,<br />

intelligent control systems, fuzzy logic control, fuzzy logic hardware, and visual servoing for<br />

robot manipulation. He is a member of IEEE, SPIE and EUSFLAT.<br />

Prof. George Fodor received his M.Sc. degree in Electrical Engineering from the<br />

Polytechnic Institute of Cluj, Romania, in 1979, and the Ph.D. degree in Computer Sciences<br />

from the Linköping University, Sweden, in 1995. He is currently the head of the Systems<br />

Development Dept. for Force Measurement and Systems at ABB Automation Products,<br />

Sweden. He is an Adjunct Professor at Western Michigan University, Kalamazoo, USA, from<br />

1997 and member of the Advisory Board of the Electrical and Computer Engineering Faculty<br />

at the same university from 1998. He is an associated professor at Örebro University, Sweden,<br />

from 2000. His research interests include discrete control, control of complex industrial<br />

systems, discrete fault detection and isolation, ontological control, software architectures. He<br />

is the author of one book and some 30 conference and journal articles.<br />

Doc. Anani Ananiev is an Associate Professor at the Centre for Applied Autonomous Sensor<br />

Systems at Örebro University. He received his Dipl.Eng. in Mechanical Engineering and<br />

Ph.D. in Robotics and Automation from the Technical University of Sofia in 1987 and 1992<br />

respectively. He is an associate professor (on leave) at the Dept. of Robotics and<br />

Mechatronics, Institute of Mechanics, Bulgarian Academy of Science. He has been a visiting<br />

researcher at the Robotics Laboratory of the Wuppertal University, Germany, 1994 -1998;<br />

and Dept. of Robotics at the Institute Superior Technico, Lisbon, 1995-1997. He has 65<br />

conference/journal publications, 27 patents and has received 2 bronze medals at INPEX IX<br />

(US Invention New Product Trade Show) in 1993. His research interests include robotics,<br />

lightweight robot arms, and hyper-redundant robots.<br />

Prof. Dimiter Driankov received the BSc Math degree, the MSc degree in Computer Science<br />

from the University of Sofia, Faculty of Mathematics, Sofia, Bulgaria, and the PhD degree in<br />

Computer Science from the Univ. of Linköping, Linköping, Sweden in 1973, 1975, and 1988<br />

respectively. From 1985 to 2000 he was with the Dept. of Comp. Sci., Univ. of Linköping<br />

where he was heading the Autonomous Systems Lab (1996-1999). At present he is a visiting<br />

researcher with the Division for Artificial Intelligence and Integrated Computer Systems at<br />

this department and a member of the Wallenberg Lab for Information Technology and


66 AASS – Center for Applied Autonomous Sensor Systems<br />

Autonomous Systems. Since 2001 he is a professor at the Technology Dept., Örebro Univ.,<br />

Örebro, Sweden acting as a research coordinator for the Applied Autonomous Sensor Systems<br />

Centre. During the period 1990--1997 he has spent a total of three years as Visiting Scientist<br />

at Siemens Corporate R & D, Munich, Germany.<br />

Dimiter Driankov is a member of the IEEE Technical Committee on Intelligent Control and<br />

on the editorial board of the Int. Journal of Uncertainty, Fuzziness and Knowledge-based<br />

Systems. He has co-authored and authored more than 40 conference, journal articles, and<br />

book chapters, 2 books, and 3 edited volumes in the areas of fuzzy logic and fuzzy control. He<br />

is a coordinator for a EC Marie Curie Training Site in the area of autonomous robotic<br />

systems. His current research interests and activities are in the areas of model-based fuzzy<br />

control, computational theories of perception, and perception-based control of autonomous<br />

vehicles.<br />

Christer Lindkvist was born in Örebro, Sweden, on December 23, 1954. He received his<br />

BSc degree in 1988 from Örebro University. From July 1, 1989 he works as teacher in the<br />

Department of Technology, Örebro University. In the fall of 2001 he became a graduate<br />

student with AASS, Örebro University. His current research interests include distributed<br />

component-based systems.<br />

Gustav Tolt was born in Örebro, Sweden, on January 14, 1975. He received MSc degree in<br />

engineering physics (specialization in signal processing and image analysis) from Chalmers<br />

University of Technology, Gothenburg, Sweden. Since February 2000 he is a graduate student<br />

at AASS, Örebro University. His research interests include high-speed image processing and<br />

computer vision.<br />

Lars Jennergren received his MSc in Mechanical engineering at the Technical University of<br />

Luleå, Sweden in 2002. His main subject was production engineering; this was also the area<br />

of his thesis work conducted at SKF, Gothenburg, Sweden. Since April 2002 he is a graduate<br />

student within a project conducted in co-operation between SIK, Swedish institute for food<br />

and biotechnology, and AASS, Örebro University, Sweden. His research includes<br />

requirements and building of a flexible assembly cell for ready-to-eat meals including topics<br />

such as production strategies, flexible cell layout, grasping and manipulation of fragile items,<br />

such as food.<br />

Thorsten Michelfelder was born in Freiburg im Breisgau, Germany, in 1977. He received his<br />

BEng degree in mechatronics at FH Karlsruhe. Now he is completing his MSc at Örebro<br />

University and is a part-time research assistant at AASS. His research interests include<br />

mechatronics systems and robotics.<br />

Thomas Uppgård was born in Avesta, Sweden on Mars 8, 1978. He received the MSc degree<br />

in Computer Engineering from Örebro University, Örebro, Sweden 2002. He is since fall<br />

2003 an industrial PhD student at the Centre for Applied Autonomous Sensor Systems at<br />

Örebro University in cooperation with ABB Automation Technology Products. His research<br />

interests are visual based control of continuous webs and flows.


Annual Report <strong>2004</strong> 67<br />

Alexander Skoglund is a Ph.D. student at the Dept. of Technology, Örebro University<br />

between the Learning Systems and Intelligent Control Laboratories at AASS. He received the<br />

B.Sc. degree in Electrical and Electronic Engineering in 1998 and his M.Sc. degree in<br />

Electrical and Electronic Engineering in 2002, both from Örebro University. Between 2000-<br />

2001 he worked at AerotechTelub as a radio engineer, and from 2001-2003 at AASS, Dept. of<br />

Technology, Örebro University as a research engineer. Since February 2003 he has been a<br />

graduate student with research interests in robotic manipulation and learning.<br />

Mikael Soron was born in Motala, Sweden, on February 12, 1975. He received his MSc<br />

degree in Computer Technology in 2003 from Örebro University, Örebro, Sweden. Since<br />

June 2003 he is an industrial PhD student at AASS, Örebro University, in co-operation with<br />

Robotdalen. His research interests include robotic control for Friction Stir Welding.


68 AASS – Center for Applied Autonomous Sensor Systems<br />

2.4 Learning Systems Lab<br />

Our objective is to advance the state-of-the-art in the theory and practice of learning and<br />

adaptation in autonomous sensor systems. This will be achieved by developing strongly<br />

autonomous agents with the capacity to learn from experience and thus to adapt to highly<br />

dynamic and uncertain environments and working scenarios.<br />

These situations are very difficult to model by traditional methods of numerical analysis due<br />

to the highly unpredictable nature of both the agent's sensory perceptions and the effects of<br />

motor actions, and the presence of other agents such as humans. We therefore focus on<br />

learning and adaptation through interaction of the agent with the user and environment. The<br />

techniques that we apply include unsupervised, supervised and reinforcement learning<br />

algorithms, including artificial neural networks, genetic algorithms, self-organisation, etc.<br />

2.4.1 Research directions<br />

The research focus of the Learning Systems Lab is the development of robots and<br />

autonomous systems that can improve performance by learning from their own sensor<br />

information and/or sensor-motor experience. We concentrate on three major research<br />

directions in particular:<br />

1. Navigation systems<br />

This covers learning of spatial representations and behaviours in mobile robotic systems<br />

that have various levels of autonomy, by application of state-of-the-art in sensor and<br />

measurement technology.<br />

2. Learning control<br />

This covers learning of robotic skills and behaviours from human demonstration, selforganisation<br />

and reinforcement learning, including control of both mobile robots and<br />

robotic manipulators.<br />

3. Perception systems<br />

This covers pattern recognition and self-organisation in robotics and automation,<br />

including recognition of people, objects and places by autonomous robots, and automatic<br />

sensory analysis in the Future Food Factory.<br />

The research methodology of the Learning Systems Lab is based on developing theoretically<br />

sound solutions to real world problems, and places strong emphasis on empirical methods,<br />

including use of performance metrics, quantitative comparisons of actual systems, and<br />

statistical tests of significance.<br />

In what follows we describe the work done in <strong>2004</strong> on specific projects from the above three<br />

research directions.


Annual Report <strong>2004</strong> 69<br />

2.4.2 Projects in <strong>2004</strong><br />

Project: Hierarchical learning of robot behaviours, J450<br />

Project leader: Tom Duckett<br />

Staff: Li Jun<br />

Funding: KK-foundation, Faculty and regional funding<br />

Synopsis:<br />

The project belongs to the research direction Learning Control. The project will develop a<br />

generic architecture for learning sensor-motor behaviours in robotic systems, without<br />

requiring pre-programmed symbolic representations. Instead, the robot will develop its own<br />

internal representations through a process of incremental on-line learning. One application of<br />

this technology would be programming by demonstration, where the human operator simply<br />

shows the robot what to do (e.g., "water my plants", "clean my bathroom", etc.). The<br />

behaviours acquired will be complex, non-linear and non-achievable by a purely reactive<br />

system, so the learning system must incorporate representations, which encode the temporal<br />

and spatial context of the task and environment. A particular challenge will be to carry out all<br />

of the learning in real-time. The project investigates the implementation of a hierarchy of<br />

fast, on-line learning algorithms that are integrated by layered learning. The techniques<br />

investigated include, but are not limited to, embedded machine learning algorithms such as<br />

self-organisation, recurrent artificial neural networks and reinforcement learning.<br />

Partners:<br />

University of Alicante, Spain (Assoc. Prof. Tomas Martinez).<br />

Results in <strong>2004</strong>:<br />

Li Jun successfully defended his Licentiate thesis in November <strong>2004</strong> (previously planned for<br />

May <strong>2004</strong>), and a journal article has been submitted based on this work.<br />

Future developments:<br />

Li Jun should be ready to defend Ph.D. Thesis around November 2005. This will<br />

involve incorporating reinforcement learning into the architecture for teaching by<br />

demonstration, based on the earlier work using growing RBF networks for function<br />

approximation in perception-based robot control. More substantial results and several more<br />

publications are urgently required.


70 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Enabling robot-human cooperation, J451<br />

Project leader: Tom Duckett<br />

Staff: Grzegorz Cielniak, Andre Treptow (Marie Curie fellow, Tuebingen University).<br />

Funding: KK-foundation, Faculty, regional funding and EU.<br />

Synopsis:<br />

The project belongs to the research direction Perception Systems. The ability to interact with<br />

people is an important requirement for robots, which operate in populated environments. In<br />

tasks such as cleaning, housekeeping, rehabilitation, entertainment, inspection and<br />

surveillance, so-called service robots need to communicate and cooperate with people. To<br />

enable this interaction, the robot needs to know how many people there are in the<br />

neighbourhood, their position, and who they are (the three fundamental problems of people<br />

detection, localisation and identification).<br />

The platform for this research is a mobile robot equipped with vision, thermal, omnidirectional<br />

vision and laser sensors. In current work, we are integrating methods for detection,<br />

localisation and identification of persons by a mobile robot using vision, thermal and laser<br />

data. The eventual goal is to obtain 95% recognition performance within a few seconds by a<br />

moving mobile platform on a database comprising the members of AASS. Possible themes for<br />

future research include recognition, interpretation and prediction of human behaviour.<br />

Partners:<br />

Autonomous Intelligent Systems Group, Freiburg University, Germany (Prof. Wolfram<br />

Burgard).<br />

University of Tuebingen, Computer Science Dept., Germany. (Prof. Andreas Zell).<br />

Results in <strong>2004</strong>:<br />

Two journal articles accepted for publication: one appeared in <strong>2004</strong> (J. Intelligent and Fuzzy<br />

Systems) and one will appear in 2005 (Int. J. Robotics Research). Paper presented at<br />

SAIS/SLSS Workshop in Lund, Sweden, April 15-16, <strong>2004</strong>. A major development was the<br />

visit of Andre Treptow, a Marie Curie fellow and Ph.D. student from Tuebingen University.<br />

This resulted in a working system for tracking of people in thermal images and then tracking<br />

of the face region in a greyscale image using Particle Filters, and some first results in<br />

identification using Eigenfaces.<br />

Future developments:<br />

Grzegorz Cielniak to defend Ph.D. Thesis around December 2005. Subsequent work for the<br />

Ph.D. will include person identification, e.g., by improved face recognition, integration of the<br />

two previous works on high-level/global tracking with Abstract Hidden Markov Models (with<br />

Freiburg Univ.) and lower-level/local tracking with Particle Filters (with Tuebingen Univ.),<br />

and final evaluation of the complete system with respect to the project goals.


Annual Report <strong>2004</strong> 71<br />

Project: Simultaneous localisation and mapping, J452<br />

Project leader: Tom Duckett<br />

Staff: Peter Biber (Marie Curie fellow, Tuebingen University).<br />

Funding: Faculty and EU (Marie Curie programme)<br />

Synopsis:<br />

The project belongs to the research direction Navigation Systems. Maps are essential for<br />

mobile robots navigating in non-trivial environments, being needed for tasks such as path<br />

planning, manipulation of objects, and communication with humans. To navigate in unknown<br />

environments, an autonomous robot requires the ability to build its own map while<br />

simultaneously maintaining an estimate of its own position. This is a hard problem because<br />

the same, noisy sensor data must be used for both mapping and self-localisation.<br />

Most existing solutions to the problem of simultaneous localisation and mapping (SLAM)<br />

work by decoupling the localisation and mapping processes, assuming that the data<br />

association problem (i.e., landmark identification) is already solved when measurements are<br />

updated into the map. However, this assumption is bound to fail eventually for robots<br />

operating in difficult or populated environments. This project investigates robust SLAM<br />

algorithms that take into account both the measurement uncertainty (e.g., due to sensor noise)<br />

and identification uncertainty (e.g., due to perceptual aliasing).<br />

Partners:<br />

BISS, University of Bremen, Germany (Dr. Udo Frese).<br />

WSI-GRIS, Tuebingen University, Germany (Prof. Wolfgang Strasser)<br />

Results in 2003:<br />

Journal article (IEEE Trans. Robotics) on multi-level relaxation accepted for publication (with<br />

Bremen Univ.). Paper on 3D modelling presented at IROS’04, Japan (with Tuebingen Univ.<br />

and Henrik Andreasson, AASS). A major development was the visit of Peter Biber, a Marie<br />

Curie fellow and Ph.D. student from Tuebingen University. This resulted in the development<br />

of a new approach for lifelong learning in dynamic environments, so that the robot’s map is<br />

adapted perpetually over time.<br />

Future developments:<br />

Future work will include further theoretical and practical developments, including more work<br />

on evolutionary algorithms for handling the data association problem in SLAM, and<br />

experiments in outdoor mapping.


72 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Navigation by smell, J453<br />

Project leader: Tom Duckett<br />

Staff: none yet.<br />

Funding: Faculty<br />

Synopsis:<br />

The project belongs to the research direction Navigation Systems. Smell is perhaps the least<br />

studied sense in robotic applications. Gas sensor systems known as "electronic noses" have<br />

been widely used under laboratory conditions, e.g., for food analysis, but so far there have<br />

been few applications on mobile platforms in real world environments, e.g., for use by<br />

intelligent service robots. There are a number of reasons why this should be so, including the<br />

complexity of the sample handling process and environmental influences such as air<br />

turbulence.<br />

This project investigates mechanisms for navigation using olfaction, especially concerning the<br />

problem of gas source localisation in indoor environments that are not artificially ventilated<br />

(thus a strong constant airflow cannot be assumed, as in other works). Several different<br />

approaches are considered, including gas concentration mapping, reactive sensor-motor<br />

behaviours, and re-implementation of the navigation strategies used by biological systems.<br />

Partners:<br />

Computer Science Dept., University of Tuebingen, Germany (Dr. Achim Lilienthal).<br />

Results in <strong>2004</strong>:<br />

Two journal articles were published in <strong>2004</strong> (RSJ J. Advanced Robotics, Robotics and<br />

Autonomous Systems) with Achim Lilienthal (Tuebingen Univ.)<br />

Future developments:<br />

Depends on whether an additional full time researcher can be recruited to the Learning<br />

Systems Lab.


Annual Report <strong>2004</strong> 73<br />

Project: Sensory analysis in the future food factory, J455<br />

Project leader: Tom Duckett<br />

Staff: Per Munkevik Gunnar Hall (SIK, Gothenburg).<br />

Funding: Faculty, regional funding, SIK, Gothenburg and Delfoi AB.<br />

Synopsis:<br />

The project belongs to the research direction Perception Systems. The most common way<br />

today to make descriptions, analyses and inspections of food products is to use people, either<br />

in the production line or in sensory evaluation panels. In the production line they discriminate<br />

invalid products from valid ones but they are also a possible source for contamination of the<br />

food. There are two kinds of sensory evaluation panels; one is a customer panel and the other<br />

is an expert panel used to describe the properties of the evaluated food product.<br />

This project tries to find a solution to make inspections, descriptions and sensory evaluations<br />

of food, especially ready meals, without using people. The main approach at the moment is to<br />

use a sensor system consisting of a digital camera and an electronic nose to get samples of<br />

meals. A segmentation algorithm is used to extract the contents of the meal. Several features<br />

are extracted for each component, e.g., concerning its shape and position on the plate and its<br />

sensory properties. A pattern recognition system is then used to make a quality evaluation of<br />

the meal.<br />

Partners:<br />

SIK (The Swedish Institute for Food and Biotechnology), Gothenburg.<br />

Results in <strong>2004</strong>:<br />

Paper presented at International Conference on Engineering and Food (ICEF9), Montpellier,<br />

France, March 7-11, <strong>2004</strong>. All research work completed for Lic. Thesis.<br />

Future developments:<br />

Per Munkevik to defend Lic. Thesis in March. 2005. Project ends unless further funding to<br />

Ph.D. can be found. Two journal articles to be submitted.


74 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Learning control of robot arms, J460<br />

Project leader: Tom Duckett<br />

Staff: Alexander Skoglund, Rainer Palm (AASS Intelligent Control Lab).<br />

Funding: KK-foundation, Faculty. In addition the three month stay of a student financed by<br />

EU (Marie Curie programme).<br />

Synopsis:<br />

The project belongs to the research direction Learning Control. To manually program a robot<br />

is a tedious job for anyone. It would be much more convenient to just show the robot what to<br />

do, and for the robot to learn the required behaviour automatically (this type of learning is<br />

often known as "teaching by demonstration" or "teaching by showing"). How to capture and<br />

apply a human's control abilities for driving a robot arm to perform human-like actions is the<br />

main objective of this research. Moreover, the goal is to create a solution such that the<br />

developed techniques are embedded in the control system of an actual robot arm.<br />

Our approach is to measure and model the human behaviour, without restricting the motion of<br />

the human. The eventual aim of the project is to substitute the human subject (e.g., an<br />

operator at a machine) with the robot arm. The platform for this project incorporates a<br />

"shapetape" sensor for human motion capture, which measures bend and twist at 16 sensor<br />

locations along the human arm, and a lightweight robot arm PANDI-1 developed in-house<br />

within the Intelligent Control Laboratory at AASS. Future work will investigate other sensors<br />

mounted on the robot arm to enable autonomous operation.<br />

Partners:<br />

Parma University, Italy (previous Marie Curie student, Jacopo Aleotti).<br />

Siemens AG, Munich, Germany. (Dr. Rainer Palm).<br />

Results in <strong>2004</strong>:<br />

Paper presented at International Conf. on Manipulation and Grasping (IMG’04), Genoa, Italy,<br />

July 1-2, <strong>2004</strong> (with Parma University). Initial experiments in reinforcement learning and<br />

development of a demonstration system based on a human arm model.<br />

Future developments:<br />

Integration of human arm demonstration system within the framework of supervised<br />

reinforcement learning, as a general methodology for teaching by showing. Specific<br />

experimental work on robotic manipulators. More substantial results and further publications<br />

are needed.


Annual Report <strong>2004</strong> 75<br />

Project: Object recognition by autonomous robots, J457<br />

Project leader: Tom Duckett<br />

Staff: Henrik Andreasson<br />

Funding: KK-foundation, Faculty and regional funding.<br />

Synopsis:<br />

The project belongs to the research direction Perception Systems. Object recognition has been<br />

a topic of interest for researchers in computer vision, artificial intelligence, the cognitive<br />

sciences and robotics. Without this ability, the possibilities for robots to carry out useful tasks<br />

remains limited. The object recognition systems that exist today are usually solved on a<br />

system-by-system basis, using recognition techniques that are hand-crafted for a small class<br />

of objects in one particular application.<br />

This project tries to find a more general way of doing object recognition without requiring<br />

pre-installed specifications or models of the object to be recognised. The main approach<br />

investigated in current work is using the motion of a robot to acquire an internal<br />

representation of a given object using structure from motion or optic flow. The main sensor<br />

used for current experiments is an Omni-directional camera.<br />

Partners:<br />

Autonomous Intelligent Systems Group, Freiburg University, Germany (Prof. Wolfram<br />

Burgard).<br />

University of Tuebingen, Computer Science Dept., Germany. (Prof. Andreas Zell).<br />

Results in <strong>2004</strong>:<br />

Paper on place recognition using local features presented at Symposium on Intelligent<br />

Autonomous, Portugal, July 5-7, <strong>2004</strong>, and extension of this work to the global localisation<br />

problem with Particle Filters accepted for ICRA’05, Barcelona, April 18-22 (with Tuebingen<br />

Univ.). A major development was the visit of Henrik Andreasson to Freiburg University as a<br />

Marie Curie fellow. This resulted in a new approach for fusing 3D-laser and colour<br />

information for environment modelling.<br />

Future developments:<br />

Fusion of 3D range-finder data and colour information for object recognition by mobile<br />

robots, focussing on this topic for the Ph.D. Thesis, and eventual defence around 2007.


76 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Semi-autonomous mapping by UAV-UGV cooperation, J417<br />

Project leader: Tom Duckett<br />

Staff: Martin Persson<br />

Funding: KK-foundation, AerotechTelub AB and Faculty.<br />

Synopsis:<br />

This project belongs to the research direction Navigation Systems. Mapping an outdoor<br />

environment implies new challenges for mobile robots. This project investigates the use of<br />

Semi-autonomous mapping, SAM, in this context. The basic idea is to use some a priori<br />

information in the form of a sketch map to assist the mapping process. The sensor<br />

measurements of the robot are used to add information to the map and to correct the sketch<br />

map where it is wrong. The sketch map may contain information extracted from an aerial<br />

image, hand-drawn map, geographic information system, etc. It may have low resolution,<br />

incorrect scale, and contain errors.<br />

The platform for this research is an integrated robotic system comprising an unmanned aerial<br />

vehicle, UAV, and its commands to an unmanned ground vehicle, UGV. The UAV is<br />

simulated in a simulation environment for aerial visual servoing (SEAVS) that uses<br />

orthographic satellite and aerial images. These are draped on an elevation grid giving realistic<br />

3D images from a nadir view. The UGV is a real ATRV-Jr mobile robot equipped with an<br />

array of positioning, vision and range finder sensors for autonomous outdoor navigation.<br />

Applications of this technology would include terrain and urban mapping, search and rescue<br />

operations, and planetary exploration.<br />

Partners:<br />

Aerotech Telub, AB.<br />

Results in <strong>2004</strong>:<br />

Research project on extraction of man-made structures from aerial images, paper submitted to<br />

forthcoming CIRA’05 workshop in Finland.<br />

Future developments:<br />

Investigate detection of the same structures by an outdoors-mobile robot using on-board<br />

sensors, extraction of relevant features from a hand-drawn sketch, and data fusion in a single<br />

map representation. More substantial results and further publications are needed.


Annual Report <strong>2004</strong> 77<br />

Project: Learning Optimal Control, J456<br />

Project leader: Tom Duckett<br />

Staff: none.<br />

Funding: Faculty<br />

Synopsis:<br />

This project documents the work carried out by Assoc. Prof. Tomas Martinez of Alicante<br />

University, Spain, on his research visits to AASS in 2003 and <strong>2004</strong>. The work concerns a<br />

visual servoing approach for a mobile manipulation task, in which the Peoplebot mobile robot<br />

has to move towards an object located on a table (docking) and then pick up that object with<br />

its gripper (grasping). The approach belongs to the family of techniques known as imagebased<br />

visual servoing. A novel reinforcement learning algorithm incorporating planning is<br />

used to learn a time-optimal control policy.<br />

Partners:<br />

University of Alicante, Spain (Assoc. Prof. Tomas Martinez).<br />

Results in <strong>2004</strong>:<br />

Paper published in proceedings of IEEE Int. Conf. Robotics, Automation and Mechatronics<br />

(RAM’04), Singapore, December 1-3, <strong>2004</strong>. Paper accepted for IEEE Int. Conf. Robotics and<br />

Automation (ICRA’05), Spain, April 18-22, 2005.<br />

Future developments:<br />

Further experiments and submit journal article.


78 AASS – Center for Applied Autonomous Sensor Systems<br />

2.4.3 Staff<br />

Tom Duckett is a Docent (Associate Professor) at the Dept. of Technology, Örebro<br />

University and leader of the AASS Learning Systems Lab. He received the B.Sc.(Hons)<br />

degree in Computer and Management Sciences from Warwick University, U.K., in 1991.<br />

After working in industry as an Analyst/Programmer for several years, he was awarded an<br />

M.Sc. with distinction in Knowledge Based Systems by Heriot-Watt University, U.K., in<br />

1995. His M.Sc. dissertation was carried out as an ERASMUS exchange student at Karlsruhe<br />

University, Germany.<br />

Tom Duckett received his Ph.D. on concurrent map building and self-localisation for mobile<br />

robot navigation from Manchester University, U.K., in 2000, including a research visit to<br />

Bremen University, Germany, on landmark selection for mobile robot navigation. He has<br />

authored 8 journal articles and 33 full paper refereed conference papers, and is a regular<br />

reviewer for many international conferences and journals. He also has 9 years of teaching<br />

experience at university level. His research interests include mobile robotics, navigation,<br />

SLAM, machine learning, AI, learning control, robotic olfaction, and recognition systems for<br />

autonomous robots.<br />

Li Jun is a Ph.D. student at the Dept. of Technology, Örebro University in the AASS<br />

Learning Systems Lab. He received the B.S. and M.S. degree from Gui Zhou University of<br />

Technology, Gui Zhou, China, in 1982 and 1985 respectively. His current research interests<br />

include theory and application of artificial neural network learning, specifically for<br />

autonomous mobile robotic systems.<br />

Grzegorz Cielniak is a Ph.D. student at the Dept. of Technology,<br />

Örebro University in the AASS Learning Systems Lab. He was born<br />

in Krapkowice, Poland in 1975. He received his MSc degree in<br />

robotics in 2000 at the Wroclaw University of Technology, Wroclaw,<br />

Poland. Since January 2001 he has been a graduate student at AASS.<br />

His current research interests include artificial intelligence, robot<br />

learning and vision systems.<br />

Henrik Andreasson is a Ph.D. Student at the Dept. of Technology,<br />

Örebro University in the AASS Learning System Lab since October<br />

2002. He received his M.Sc. degree in Mechatronics at the Royal<br />

Institute of Technology, Stockholm, Sweden in 2001. Since October<br />

2002 he has been a graduate student at AASS. His current research<br />

interests include robotic vision and learning.<br />

Per Munkevik is a joint Ph.D. student between the AASS Learning<br />

Systems Lab at the Dept. of Technology, Örebro University, and SIK,<br />

Gothenburg since November 2002. He received the M.Sc. degree in<br />

Computer Science in 2002 at Luleå University of Technology. His<br />

current research includes pattern recognition, artificial neural<br />

networks, sensory science and learning algorithms for food quality<br />

evaluation. The objective is to perform automatic sensory evaluations<br />

of food products, especially ready meals.


Annual Report <strong>2004</strong> 79<br />

Martin Persson was born in Lund, Sweden, on June 1, 1970. He received his M.Sc. in<br />

Applied Physics and Electronic Engineering from the University of Linköping, Sweden, in<br />

1994. AerotechTelub has employed him since 1994 as a system engineer working mainly with<br />

guidance, control and simulation models for dispenser weapon systems and stand-off missiles.<br />

Since 1999 he has been an industrial PhD student with AASS at Örebro University. He<br />

received his Licentiate degree from AASS, Örebro University in 2002. His research interests<br />

include visual servoing in aerial applications and semi-autonomous mapping for mobile<br />

robots.<br />

Alexander Skoglund is a Ph.D. student at the Dept. of Technology, Örebro University<br />

between the Learning Systems and Intelligent Control Laboratories at AASS. He received the<br />

B.Sc. degree in Electrical and Electronic Engineering in 1998 and his M.Sc. degree in<br />

Electrical and Electronic Engineering in 2002, both from Örebro University. Between 2000-<br />

2001 he worked at AerotechTelub as a radio engineer, and from 2001-2003 at AASS, Dept. of<br />

Technology, Örebro University as a research engineer. Since February 2003 he has been a<br />

graduate student with research interests in robotic manipulation and learning.


80 AASS – Center for Applied Autonomous Sensor Systems<br />

3. Publications<br />

3.1 Books (incl. PhD/Lic theses) and edited volumes<br />

1. Lindquist, Malin. Electronic Tongue for Water Quality Assessment, Licentiate thesis,<br />

Örebro University Studies in Technology 15, <strong>2004</strong>.<br />

2. B. Iliev. Minimum-time Sliding Mode Control of Robot Manipulators. Doctoral<br />

Dissertation, Örebro University Studies in Technology Series, <strong>2004</strong>.<br />

3. L. Jennergren. Flexible Assembly of Ready-to-eat Meals, Licentiate thesis, Örebro<br />

University Studies in Technology Series, <strong>2004</strong>.<br />

4. Pettersson, O. Model-Free Execution Monitoring in Behaviour-Based Mobile Robots.<br />

PhD thesis, Örebro University Studies in Technology Series, <strong>2004</strong>.<br />

5. S. Coradeschi and A. Saffiotti (Eds.) Proceedings of the AAAI-04 Workshop on<br />

Anchoring Symbols to Sensor Data. AAAI Press (Menlo Park, CA, <strong>2004</strong>).<br />

3.2 Chapters in edited volumes<br />

1. Loutfi, A., Lindquist M. and Wide P. Artificial Perceptual Systems, Book chapter, In<br />

Handbook of Sensor Networks, CRC Press, <strong>2004</strong><br />

3.3 Journals<br />

1. R. Palm. Synchronization of Decentralized Multiple-Model Systems by Market-Based<br />

Optimization. IEEE Trans. SMC B, Vol. 34, No 1 Feb. <strong>2004</strong>, pp. 665-672<br />

2. G. Cielniak and Tom Duckett. People Recognition by Mobile Robots. Journal of<br />

Intelligent and Fuzzy Systems, Vol. 15, No. 1, pp. 21-27, <strong>2004</strong><br />

3. Achim Lilienthal and Tom Duckett, Experimental Analysis of Gas-Sensitive Braitenburg<br />

Vehicles. RSJ Journal of Advanced Robotics, Vol. 18, No. 8, pp. 817-834, <strong>2004</strong>.<br />

4. Achim Lilienthal and Tom Duckett, Building Gas Concentration Gridmaps with a Mobile<br />

Robot. Robotics and Autonomous Systems, Vol. 48, No. 1, pp. 3-16, <strong>2004</strong>.<br />

5. E. Pagello, E. Menegatti, A. Bredenfel, P. Costa, T. Christaller, A. Jacoff, D. Polani, M.<br />

Riedmiller, A. Saffiotti, E. Sklar, T. Tomoichi. RoboCup-2003: New Scientific and<br />

Technical Advances. AI Magazine 25(2):81-98, <strong>2004</strong><br />

6. B. Kadmiry, Pr. D. Driankov: Fuzzy Gain Scheduler for Attitude Control of an<br />

Unmanned Helicopter (*) (Special issue) on IEEE Transactions on Fuzzy Systems<br />

Journal (TFS), ISSN: 0163-6706, Vol.12 /4, pp. 502-515, August <strong>2004</strong>


Annual Report <strong>2004</strong> 81<br />

3.4 Conference papers<br />

1. M. Lindquist, P. Wide, New Sensor System for Drinking Water Quality. In Sensors for<br />

Industry Conference, New Orleans, USA, Feb <strong>2004</strong>.<br />

2. B. Iliev, I. Kalaykov. Minimum-time sliding mode control for second-order systems.<br />

In Proc. American Control Conference, ACC'04, June 30-July 3, <strong>2004</strong>, Boston, USA.<br />

3. I. Hristozov, B. Iliev and S. Eskiizmirler. A combined feature extraction method for an<br />

electronic nose, In Proc. of Information Processing and Management of Uncertainty<br />

IPMU’ 04, Perugia, Italy, July <strong>2004</strong>.<br />

4. L. Robertsson and P. Wide. Analysis bacteriological growth using wavelet transform. In<br />

Proceedings IMTC’04, Como, Italy <strong>2004</strong><br />

5. I. Hristozov, B. Iliev and S. Eskiizmirler. A combined feature extraction method for an<br />

electronic nose, In Proc. of Information Processing and Management of Uncertainty<br />

IPMU’ 04, Perugia, Italy, July <strong>2004</strong>.<br />

6. Tolt, G. A Fuzzy Approach for Detecting Multi-junctions in Edgeness Images. Proc. of<br />

IASTED Conf. on Visualization, Imaging and Image Processing, pages 420-424,<br />

Marbella, Spain, <strong>2004</strong>.<br />

7. J. L. Granter, R. Gottipati, G. A Fodor, Fuzzy Logic Enabled Software Agents for<br />

Supervisory Control. Proc. of the FUZZ-IEEE Conference, Budapest, 27-29 July <strong>2004</strong>.<br />

8. T. Martínez-Marín and T. Duckett, Reinforcement Learning in a Visual Servoing<br />

Framework. Proc. IEEE Int. Conference on Robotics, Automation and Mechatronics<br />

(RAM'04), Singapore, December 1-3, <strong>2004</strong>.<br />

9. Peter Biber, Henrik Andreasson, Tom Duckett and Andreas Schilling. 3D Modelling of<br />

Indoor Environments by a Mobile Robot with a Laser Scanner and Panoramic Camera.<br />

Proc. IEEE/RSJ Int. Conference on Intelligent Robots and Systems (IROS <strong>2004</strong>), Sendai,<br />

Japan, September 28 - October 2, <strong>2004</strong>.<br />

10. Jacopo Aleotti, Alexander Skoglund and Tom Duckett. Teaching Position Control of a<br />

Robot Arm by Demonstration with a Wearable Input Device. Proc. IMG04, International<br />

Conference on Intelligent Manipulation and Grasping, Genoa, Italy, July 1-2, <strong>2004</strong>.<br />

11. Per Munkevik, Tom Duckett and Gunnar Hall. Vision System Learning for Ready Meal<br />

Characterisation Proc. International Conference on Engineering and Food (ICEF9),<br />

Montpellier, France, March 7-11, <strong>2004</strong>.<br />

12. Grzegorz Cielniak and Tom Duckett. People Recognition by Mobile Robots. Proc. AILS-<br />

<strong>2004</strong>, 2nd Joint SAIS/SSLS Workshop Lund, Sweden, April 15-16, <strong>2004</strong>.


82 AASS – Center for Applied Autonomous Sensor Systems<br />

13. Tom Duckett, Grzegorz Cielniak, Henrik Andreasson, Li Jun, Achim Lilienthal and Peter<br />

Biber. An Electronic Watchman for Safety, Security and Rescue Operations (abstract).<br />

Proc. SIMSafe <strong>2004</strong>, Improving Public Safety through Modelling and Simulation,<br />

Karlskoga, Sweden, June 15-17, <strong>2004</strong>.<br />

14. P. Buschka and A. Saffiotti. Some Notes on the Use of Hybrid Maps for Mobile Robots.<br />

Proc. of the 8th Int. Conf. on Intelligent Autonomous Systems (IAS) pp. 547-556.<br />

Amsterdam, NL, <strong>2004</strong>.<br />

15. M. Broxvall, L. Karlsson and A. Saffiotti. Steps Towards Detecting and Recovering from<br />

Perceptual Failures. Proc. of the 8th Int. Conf on Intelligent Autonomous Systems (IAS)<br />

pp. 793-800. Amsterdam, NL, <strong>2004</strong>.<br />

16. A. Loutfi and S. Coradeschi. Forming Odour Categories Using an Electronic Nose. Proc.<br />

of the European Conf. on Artificial Intelligence (ECAI) 119-124. Valencia, Spain, <strong>2004</strong>.<br />

17. R. Lundh, L. Karlsson and A. Saffiotti. Dynamic Configuration of a Team of Robots.<br />

Proc. of the ECAI-04 Workshop on Agents in Dynamic and Real-Time Environments.<br />

Valencia, Spain, <strong>2004</strong>.<br />

18. A. Loutfi, S. Coradeschi, L. Karlsson and M. Broxvall. Putting Olfaction into Action:<br />

Using an Electronic Nose on an Multi-Sensing Mobile Robot Proc. of the IEEE/RSJ Int.<br />

Conf. on Intelligent Robots and Systems (IROS). Sendai, Japan, <strong>2004</strong>.<br />

19. Janos L. Grantner, R. Gottipati, G.A. Fodor, Intelligent Fuzzy Controllers Laboratory,<br />

Proceedings of the <strong>2004</strong> ASEE Annual Conference.<br />

20. G. A. Fodor, The Case for Hierarchy-Mobile Agents in Industrial Informatics. Keynote<br />

talk. Proc. of the second IEEE International Conference on Industrial Informatics,<br />

INDIN'04, 24-26 June, Berlin, Germany, <strong>2004</strong>.<br />

21. G. A. Fodor, Formal and Architectural Competitive Factors in Industrial Informatics,<br />

Proc. of the second IEEE International Conference on Industrial Informatics, INDIN'04,<br />

24-26 June, Berlin, Germany, <strong>2004</strong>.<br />

22. L. Jennergren, I. Kalaykov, L. Ahrne. Requirements for assembly of ready-to-eat meals.<br />

Proc. of ICEF9 International Conference on Engineering and Food, Montpellier, France,<br />

7-11 March, <strong>2004</strong>.<br />

23. L. Jennergren, Optimizing the flexible assembly of ready-to-eat meals. Proc. of<br />

International Conference on Intelligent Manipulation and Grasping, Genoa, Italy, 1-2<br />

July, <strong>2004</strong>.<br />

24. L. Jennergren, I. Kalaykov. Human-free flexible assembly of ready-to-eat meals using<br />

visual feedback. Proc. of Food Factory <strong>2004</strong> Conference, France, 6-8 October, <strong>2004</strong>.


Annual Report <strong>2004</strong> 83<br />

25. A. Ananiev, I. Kalaykov, E. Petrov, B. Hadjiyski. Single-motor driven construction of<br />

hyper-redundant robot. Proc. of International Conference on Mechatronics and Robotics<br />

’04, Aachen, Germany, 13-15 September, <strong>2004</strong>, vol. 2, p. 543-547.<br />

3.5 Workshop and Symposium papers<br />

26. R. Palm. Multi-Step-Ahead Prediction in Control Systems using Gaussian Processes and<br />

TS-Fuzzy Models. In Proceedings 14th Workshop Fuzzy Systeme und Computational<br />

Intelligence. Schriftenreihe d. Inst. f. Angew. Informatik/ Automatisierungstechnik Univ.<br />

Karlsruhe (TH) Band 6, <strong>2004</strong>, Universitätsverlag Karlsruhe, pp. 42-54.<br />

27. Henrik Andreasson and Tom Duckett. Topological Localization for Mobile Robots using<br />

Omni-directional Vision and Local Features. Proc. IAV<strong>2004</strong>, The 5th Symposium on<br />

Intelligent Autonomous Vehicles, Lisbon, Portugal, July 5-7, <strong>2004</strong>.<br />

28. Tom Duckett, Grzegorz Cielniak, Henrik Andreasson, Li Jun, Achim Lilienthal, Peter<br />

Biber and Tomás Martínez. Robotic Security Guard - Autonomous Surveillance and<br />

Remote Perception (abstract). Proc. IEEE International Workshop on Safety, Security,<br />

and Rescue Robotics, Bonn, Germany, May 24-26, <strong>2004</strong>.<br />

29. Dimiter Driankov, Tom Duckett and Alessandro Saffiotti. A System for Vision Based<br />

Human-Robot Interaction (short paper). Proc. IEEE International Workshop on Safety,<br />

Security, and Rescue Robotics, Bonn, Germany, May 24-26, <strong>2004</strong>.<br />

30. D. Herrero Pérez, H. Martínez Barberá and A. Saffiotti. Fuzzy Self-Localization using<br />

Natural Features on an AIBO Robot. Proc. of the Int. RoboCup Symposium. Lisbon,<br />

Portugal, <strong>2004</strong>.<br />

31. J.P Cánovas, K. LeBlanc and A. Saffiotti. Multi-Robot Object Localization by Fuzzy<br />

Logic. Proc. of the Int. RoboCup Symposium. Lisbon, Portugal, <strong>2004</strong>.<br />

32. A. Chella, S. Coradeschi, M. Frixione and A. Saffiotti. Perceptual Anchoring via<br />

Conceptual Spaces. Proc. of the AAAI-04 Workhsop on Anchoring. San Jose, CA, <strong>2004</strong>.<br />

33. R. Lundh, L. Karlsson and A. Saffiotti. Dynamic Configuration of a Team of Robots.<br />

Proc. of the ECAI-04 Workshop on Agents in Dynamic and Real-Time Environments.<br />

Valencia, Spain, <strong>2004</strong>.<br />

34. K. Bergstrand, K. Carlsson, P. Wide, B. Lindgren. Sound Detection in Noisy<br />

Environment – Location Drilling Sound by using an Artificial Ear. Proceedings of the<br />

<strong>2004</strong> International workshop on Robot Sensing. ROSE’<strong>2004</strong>. Graz, Austria, <strong>2004</strong>.<br />

35. M. Broxvall, S. Coradeschi, L. Karlsson and A. Saffiotti. Have Another Look: On<br />

failures and recovery planning in perceptual anchoring. Proc. Of the ECAI-04 Workshop<br />

on Cognitive Robotics. Valencia, Spain, <strong>2004</strong>.<br />

36. A. Bouguerra and L. Karlsson. Hierarchical Task Planning under Uncertainty. Proc. Of<br />

the 3 rd Italian Workshop on Planning and Scheduling. Perugia, Italy, <strong>2004</strong>.


84 AASS – Center for Applied Autonomous Sensor Systems<br />

37. Lucia Vacariu, B. P. Csaba, I. A. Letia, G. A. Fodor, O. Cret, A Multi-Agent Cooperative<br />

Mobile Robotics Approach for Search and Rescue Missions, IFAC Symposium on<br />

Intelligent Autonomous Vehicles, 5-7 July, Lisbon, Portugal, <strong>2004</strong>.<br />

38. G. Fodor, Information-Effective Industrial Architectures, Workshop paper, Proc of the<br />

IECON <strong>2004</strong> Conference (The 30-th Annual Conference of the IEEE Industrial<br />

Electronics Society), Nov. 2-6, <strong>2004</strong>, Busan, Korea.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!