Location-Aware Augmented Communication

The location-aware AAC project is designed to provide location-based alternative communication to individuals with speech disabilities. While conventional picture based communication systems rely on a generic set of icons to represent commonly communicated ideas, this picture-to-speech system dynamically changes the available icon sets to represent information specific to the user's current locale (i.e. icons which represent ordering in a restaurant). While certain icon sets are persistent, others are available through a tab-based layout to bolster accessibility for the user.

AAC prototype: iPAQ 1945 & Belkin wireless PDA keyboard

The system uses GPS data obtained via a bluetooth receiver to update the communication choices. A database of coordinates/icons is stored on the pocketPC to allow the communication of locale specific information. Future versions will enable the use of a cellular phone as a modem to connect to web databases for true world-wide operation. Given the user's coordinates, the system supplies icons representing standard phrases people commonly use in a specific location.

The AAC component of the project has to date produced several deliverables.
We currently have a high quality speech synthesizer that runs on PocketPC devices such as the Compaq iPAQ. These systems are readily availble and allow for:

• Client/server architecture

• Network connectivity via Bluetooth, permits AAC users to not only make mobile telephone calls, but allows for alternative communication channels such as sending text to a remotely located user (i.e. an instant messenger client or to send text and/or synthesized audio to nearby user's mobile phones, thus enabling privacy in conversations).

• High quality voices which are implemented as dynamically loaded libraries. This permits the incorporation of new and more natural souding voices as they become available.

Example setup

HP iPAQ 1945
Belkin wireless PDA keyboard details
Server and Client programs developed by calit2.net

Using ActiveSync, the user installs the driver for the wireless keyboard as well as appplications to enable client and server communication. At this point, the user can begin using text-to-speech and picture-to-speech communication through the device.

As a result of this AAC project, developers can take advantage of a standard interface to a TTS engine to develop their own applications using speech as a service. Contact us for more information on the protocol.