Shadow Multiplexing for Real-Time Silhouette ... - EDM - UHasselt

Figure 5. Collision detection overview (a) input, a virtual object we want to check collision with (b) the virtual object converted into apoint cloud (c) the point cloud is projected onto the demultiplexed shadows of the real object (d) red points are inside every silhouette afterprojection, while blue points are projected outside at least one silhouette.5.3. ApplicationsIn this section we will demonstrate the usefulness of ourmethod for interactive collision detection. The first applicationshows how we can reconstruct a visual hull from thesesilhouettes, which can then be used for collision detectionwith virtual objects. As a second application we show howthe silhouettes can be used for collision detection in imagespace.5.3.1 Visual Hull ReconstructionFigure 6. Artifacts due to (a) specular reflections and (b) refractionswill break down for mainly transparent materials. Occasionallysmall artefacts appear when highly specular materialsreflect their light directly toward the surface as shownin Figure 6.5.1.4 Blue-Green Response OverlapBecause we do not use a multispectral camera, the numberof multiplexed blue and green LED intensities was limitedby two per light source. This is due to the large responseoverlap between green and blue on CCD cameras. This isillustrated in Figure 3.5.2. TimingsThe method is implemented on an NVidia GForce 8800GTX. We store up to 4 silhouettes into a single texture, reducingrequired memory storage. It also takes advantage ofthe scalar processors. The number of render passes is alsoreduced by 4 and the erosion and dilation can be calculatedsimultaneously. For input images containing 6 silhouetteswith a resolution of 640 ×480 we achieve a framerate of 40fps.The visual hull of the object can be reconstructed usingclassical shape-from-silhouette techniques. Because thesemethods usually require silhouettes from the viewpoint ofmultiple cameras we have to perform a transformation onthe demultiplexed shadow. Since the setup is calibrated wecan use projective texture mapping for an efficient transformation.We model the diffuser on which we project ourmultiplexed shadows. Then we render it from the positionof the light source. Because the shadows are already demultiplexedon the GPU, this step can easily and efficiently beadded. An overview of this method is shown in the teaserimage.5.3.2 Image-Based Collision DetectionCollision detection can also be done directly in image space.Therefore we divide our virtual objects into small voxelsand project each voxel onto the input image. We can thendetermine if this voxel is projected inside or outside the realobject’s silhouette. When a projection falls inside every silhouette,we assume a collision has occured. This way collisionresponse can be handled directly in image space. Thisis similar to the work of De Decker et al. [8] . An overviewof this method is shown in Figure 5.6. ConclusionWe proposed a technique to efficiently obtain multiplefull resolution silhouettes of an object from multiplexedshadows using a single camera, allowing to construct a visualhull or provide image based collision detection in realtimeon a single pc. Because only one camera is required,