|
|
|
HOME |
|
|
| Vocal Joystick Video Demonstrations |
06/2007The following video depicts the Voicebot picking up and moving a piece of candy using a Linx6 (by Lynxmotion) robotic arm. The video consists of 2 clips to demonstrate our forward and inverse kinematic control modes. These clips show that continuous vocal control is a viable option for controlling a robotic limb in 3-D.10/2006The following videos were shown as a part of the presentation of the Vocal Joystick system at the ASSETS 2006 conference in Portland, Oregon.08/2006The videos below show a VJ system with more degrees of freedom. The first video demonstrates playing video games using the VJ which allows movements in 8 directions. The second video demonstrates using five vowels plus pitch to control a simulated three-joint robotic arm. The third video demonstrate a four-way vowel classifier which enables diagonal movements via adaptive filtering. In addition, we have implemented a new velocity control scheme based on human perception of loud, normal and quiet voice. The vowel quality, loudness and discrete sounds can be adapted using an adaptation tool which is shown in the last video.Early videos04/200608/200506/2005UIST SubmissionAn edited video showing several real-world VJ applications, including browsing a news site, playing a computer game, using Google Maps and a visualization tool. The system is based on a four-way vowel classifier, and diagonal movements can be enabled by filering techniques. The velocity is normalized for each vowel so that the cursor moving speed in different directions is more uniform. Voice-less consonants are again used as discrete sounds, but with a more robust rejection scheme, to reject breathing and extraneous speech. 03/2005In this system, both vowel classification and velocity control are adapted to the user's voice, and the VJ performs more reliably than our first system. In addition, consonant-vowel patterns are used for discrete sounds to avoid false positives caused by breathing.11/2004Below are videos demostrating the first VJ system, where velocity is determined by amplitude and direction determined by the four cardinal directions in the compass rose. Note also that mouse clicks in this version are simulated using simple voice-less consonants, to ensure that there is no confusion with the vowel detector and the mouse-up/down controls. The two video demonstrations were performed by the two graduate student implementers of the VJ-engine: Here is Jon Malkin and Xiao Li demonstrating the VJ system. |