This award is funded under the American Recovery and Reinvestment Act of 2009 (Public Law 111-5).
This Small Business Innovation Research (SBIR) Phase II project addresses an opportunity to build on the recent enthusiastic market acceptance in touch interfaces with a new exciting feature-enhanced technology. The patented high-dimensional touchpad (HDTP) employs a tactile matrix sensors to capture nuances of finger contact that current touch interfaces cannot detect. Machine vision techniques are used to extract control information from measured tactile contact and direct it to control a system or device. The HDTP has all capabilities of available touch interfaces with far more continuously-variable parameters from a single finger and numerous new features. The SBIR Phase II project objectives are: 1) create a working HDTP prototype from the test system of SBIR Phase I; 2) characterize suitability of available tactile matrix sensors for commercial HDTP products; 3) develop expanded repertoire of touch interactions combining existing techniques with others unique to the HDTP; and 4) conduct human studies comparing the HDTP with other touch interfaces. Expected outcomes of this Phase II project are: a working prototype providing eight or more useful continuously-variable parameters (four or more in a small area); identification of best suited sensors; an expanded range of touch interaction techniques; human study results showing HDTP capabilities surpasses those of other touch interfaces.
The past eighteen months have seen the emergence of a new generation of touch interfaces that exploit multi-touch and gesture interactions to create user interfaces substantially more usable than other user interfaces. With the success of the iPhone, advanced touch interfaces are now appearing in a variety of products ranging from laptop and multi-user table-top computers to PDAs to competing smartphones to digital cameras. The heightened interest in touch interfaces and their increasing prevalence make finding ways to improve them especially important. Considerable effort is now being devoted to developing advanced touch interfaces. The proposed project will advance that research. As a high-dimensional touch interface operated in an intuitive way with a wide range of powerful new capabilities, a large number of possible applications, and well-suited for use in handheld devices, the HDTP has the potential to be very widely adopted. Because of the size and number of potential markets for the HDTP, even a modest market share in some of them could result in substantial profits. Further, the HDTP's sensitivity and adaptability makes it well-suited for use as an assistive device for the disabled, thus promoting the goal of universal access.
The NSF SBIR Phase II project is directed to the perfection and commercialization of NRI’s advanced "High-Dimensional Touch Pad" (HDTP). HDTP technology provides real-time sensing, tracking and controlling capabilities in six different dimensions—left-right, forward-back, degree of downward pressure and roll-angle, pitch-angle and yaw-angle of the fingertip—using a touch interface. During the first half of Phase II, a number of Windows based applications were successfully controlled in six dimensions using this technology. This led to commercialization efforts with positive results. Additionally, the performance of the roll and pitch angle movements was improved. In the third quarter of Phase II, NRI created an expanded gesture database for its HDTP technology and successfully developed a 5-motor robotic arm which used some of these advanced gestures. In the final quarter of Phase II several important advancements were made. First, the roll and pitch angles were refined, yielding excellent results. Efforts were also made to enhance the performance of an "artificial neural network," used for developing new gestures and making critical measurements. The focus then shifted to the development of a USB interface for devices such as game controllers and the Logitech 3D Connexion SpaceNavigator 6D joystick, which enabled the single-finger 6D control of NRI’s HDTP technology to work with a large number of products, including AutoCAD, Google Earth and Mathematica. Moreover, RF touch sensor technology was also designed and prototyped in order create a higher resolution touch interface. This included creating an adaption of the recently popular OLED displays found in a number of smartphones and PDA devices. Furthermore, while NRI’s technology has been largely developed using pressure sensor array technology, efforts are currently underway to apply visual image technologies and capacitive sensor technology found on popular mobile phones. Lastly, a new family of tactile grammars for 3D Computer-Aided Design and gestures allowing cursive handwriting were also developed.
