GSI DEMO: Multiuser Gesture / Speech Interaction over Digital Tables by Wrapping Single User Applications

Simple item page
dc.contributor.authorTse, Edwardeng
dc.contributor.authorGreenberg, Sauleng
dc.contributor.authorShen, Chiaeng
dc.date.accessioned2008-02-27T22:07:10Z
dc.date.available2008-02-27T22:07:10Z
dc.date.computerscience2006-05-18eng
dc.date.issued2006-05-18eng
dc.description.abstractMost commercial software applications are designed for a single user using a keyboard/mouse over an upright monitor. Our interest is exploiting these systems so they work over a digital table. Mirroring what people do when working over traditional tables, we want multiple people to interact with the tabletop application and with each other via rich speech and hand gestures. In previous papers, we illustrated multi-user gesture and speech interaction on a digital table for geospatial applications Google Earth, Warcraft III and The Sims. In this paper, we describe our underlying architecture: GSI DEMO. First, GSI DEMO creates a run-time wrapper around existing single user applications: it accepts and translates speech and gestures from multiple people into a single stream of keyboard and mouse inputs recognized by the application. Second, it lets people use multimodal demonstration instead of programming to quickly map their own speech and gestures to these keyboard/mouse inputs. For example, continuous gestures are trained by saying Computer, when I do [one finger gesture], you do [mouse drag] . Similarly, discrete speech commands can be trained by saying Computer, when I say [layer bars], you do [keyboard and mouse macro] . The end result is that end users can rapidly transform single user commercial applications into a multi-user, multimodal digital tabletop system.eng
dc.description.notesWe are currently acquiring citations for the work deposited into this collection. We recognize the distribution rights of this item may have been assigned to another entity, other than the author(s) of the work.If you can provide the citation for this work or you think you own the distribution rights to this work please contact the Institutional Repository Administrator at digitize@ucalgary.caeng
dc.identifier.department2006-833-26eng
dc.identifier.doihttp://dx.doi.org/10.11575/PRISM/30700
dc.identifier.urihttp://hdl.handle.net/1880/45904
dc.language.isoEngeng
dc.publisher.corporateUniversity of Calgaryeng
dc.publisher.facultyScienceeng
dc.subjectComputer Scienceeng
dc.titleGSI DEMO: Multiuser Gesture / Speech Interaction over Digital Tables by Wrapping Single User Applicationseng
dc.typeunknown
thesis.degree.disciplineComputer Scienceeng
Files
Original bundle
Now showing 1 - 2 of 2
Thumbnail Image
Name:
2006-833-26.pdf
Size:
563.21 KB
Format:
Adobe Portable Document Format
Download
No Thumbnail Available
Name:
2006-833-26.ps
Size:
5.5 MB
Format:
Postscript Files
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.86 KB
Format:
Plain Text
Description:
Download
Collections
Science Research & Publications