Hand Tracking, Finger Identification, and Chordic Manipulation on

the algorithms developed in this dissertation. By 1999 st<strong>and</strong>ards, 60 MFLOPS is
moderate performance available in quantities for less than $10 per processor. The
DSP is responsible for:
controlling the sensor array scan.
forming <strong>and</strong> ltering the scanned proximity images.
segmenting the proximity images into groups of pixels distinguishable as esh
contacts.
tracking motion of each esh contact across the stream of images.
identifying which part of which h<strong>and</strong>, i.e., ngertip, thumb, or palm, causes
each esh contact.
extracting h<strong>and</strong> motions from the contacts identi ed as ngers.
generating keyboard <strong>and</strong> mouse events for the host computer in response to
motions of particular nger combinations.
These steps are also summarized by the MTS block diagram in Figure 1.2.
One megabyte of ash EEPROM stores the program <strong>and</strong> multiple user con-
gurations on board. Two 10 kbps PS/2 ports are available for emulating IBM PC
keyboards <strong>and</strong> mice. With PS/2 converter boxes available from Kinesis Corp. [29],
mouse <strong>and</strong> keyboard emulation for Sun workstations <strong>and</strong> Macintosh computers is
also supported. A 1.2kbps RS-232C serial mouse port is included for interfacing to
older PCs. A 115kbps RS-232C serial port can exchange con guration <strong>and</strong> nger
tracking information with any host computer capable of running a Java 1.1 MTS
monitor application.
16