GSoC Accelerometer-based Gestures Update

Bobby Martin bobbymartin2 at gmail.com
Wed Jun 4 21:48:28 CEST 2008


"Alexey Feldgendler" <alexey at feldgendler.ru> wrote:

> On Wed, 04 Jun 2008 08:51:54 +0200, Paul-Valentin Borza <
> paulvalentin at borza.ro> wrote:
>
>  The classifier is based on multivariate gaussian mixtures. I've
>> written the discriminant functions and just finished writing the
>> estimation/training functions (yes, this classifier also needs to
>> be trained). The classifier is great because it can adapt/learn
>> new values on the fly while in use. So, when this classifier
>> classifies enough frames as gestures/motion, it passes these
>> frames to the recognizer that has a unigram grammar of hidden
>> Markov models.
>>
>
> One thing that worries me is whether continuous recognition is something
> feasible within Freerunner's battery life and CPU time constraints. Even if
> the gesture recognizer manages to put the device to sleep when there is no
> signal and wake up on motion, there will still be a lot of idle processing
> to do while the user is walking.
>

I would think that you just wouldn't have it wake on motion... clicking Aux
before starting gesture recognition
(if the neo is asleep) seems a reasonable prerequisite.

 By the way, it would be great if you guys would have ideas for
>> gestures. Although creating a new gesture will be trivial, it would be
>> good for me to know how many I have to create. The demo app will
>> enable auto-answer when picked up from the table, auto-hang-up and
>> snooze the alarm when hit. Any more ideas?
>>
>
> Is the recognizer able to factor out rotation of the coordinate system? In
> other words, will it recognize the same gesture if the phone is turned
> compared to the orientatin used in training, e.g. if the snooze gesture is
> done from another side?
>
> Some gesture ideas:
>
<snip a bunch of great ideas>

Paul, you might also consider:
* holding the moko out & angling the front of it up repeatedly turns up
volume
* angling front down repeatedly turns down volume
* a set of 5 or 10 standard, easily distinguishable gestures that the user
can map to favorite programs

This is an exciting project; it's great to hear that you've made so much
progress already!

Bobby


> --
> Alexey Feldgendler <alexey at feldgendler.ru>
> [ICQ: 115226275] http://feldgendler.livejournal.com
>
>


-- 
If it doesn't make you smile, you're doing something wrong.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.openmoko.org/pipermail/openmoko-devel/attachments/20080604/47559f55/attachment.htm 


More information about the openmoko-devel mailing list