Development of an Augmented Reality system using ARToolKit

Development of an Augmented Reality system using ARToolKit and user invisible markers
Table of contents
Table of contents..............................................................................................................1
1. Introduction .................................................................................................................3
1.1 Research Goals...................................................................................................... 3
1.2 Research Approach .............................................................................................. 4
1.3 Research Outline .................................................................................................. 4
2. Augmented Reality and its applications....................................................................5
2.1 AR in relation to VR............................................................................................. 5
2.2 Display technologies ............................................................................................. 7
2.2.1 Head-attached displays ................................................................................. 8
2.2.1.1 HMD ........................................................................................................ 8
2.2.1.2 Head-mounted projector........................................................................ 9
2.2.1.3 Retinal displays..................................................................................... 10
2.2.2 Hand-held displays ...................................................................................... 10
2.2.2.1 PDA........................................................................................................ 11
2.2.2.2 Mobile Phone ........................................................................................ 11
2.2.2.3 Hand-held mirror displays .................................................................. 11
2.2.2.4 Hand-held video projectors ................................................................. 12
2.2.3 Spatial displays ............................................................................................ 12
2.2.3.1 Screen based video see-through displays............................................ 13
2.2.3.2 Spatial optical see-through displays.................................................... 13
2.2.3.3 Projection based spatial displays ........................................................ 14
2.3 Tracking .............................................................................................................. 14
2.3.1 Inertial tracking........................................................................................... 15
2.3.2 Acoustic tracking ......................................................................................... 16
2.3.3 Magnetic tracking........................................................................................ 17
2.3.4 Mechanical tracking.................................................................................... 17
2.3.5 Optical tracking ........................................................................................... 18
2.3.6 Hybrid tracking, outdoor tracking and collaborative AR tracking ....... 18
2.4 Registration ......................................................................................................... 19
2.4.1 Static errors.................................................................................................. 20
2.4.2 Dynamic errors ............................................................................................ 21
2.5 Calibration .......................................................................................................... 22
2.5.1 Manual calibration ...................................................................................... 22
2.5.2 Calibration-free AR..................................................................................... 23
2.5.3 Autocalibration ............................................................................................ 23
2.6 Interaction ........................................................................................................... 23
2.6.1 3D Data browsing ........................................................................................ 24
2.6.2 3D AR interfaces.......................................................................................... 24
2.6.3 Augmented surfaces .................................................................................... 24
2.6.4 Tangible AR ................................................................................................. 24
2.7 AR applications................................................................................................... 25
2.7.1 Medical ......................................................................................................... 25
2.7.1.1. Image guided surgery.......................................................................... 25
2.7.1.2. Surgery planning ................................................................................. 26
2.7.1.3. Surgical training .................................................................................. 27
2.7.1.4. Psychiatry............................................................................................. 27
2.7.2 Military......................................................................................................... 28
1