Can I use Microsoft Kinect gesture recognition to operate the playing vol and speed?

• May 9, 2012 - 16:17

Hello, here's my question. I would like to connect musescore to kinect so that I can handle some easy operation with simple gestures (e.g. volumn up/down, slow/haste ) .
How can I write a plugin that connects musescore and microsoft kinect?
Many thanks. :)


Comments

That's an awesome idea. The best way to do this would be to code an external software and to make it talk to MuseScore via OSC. There is no documentation of the OSC messages but you can check osc.cpp in the source code. The nightlies are OSC capable. There is a message for volume and tempo.

In reply to by [DELETED] 5

Very useful suggestion. I was considering to write a .js plugin file linked to the /mscore/playPanel.cpp so that it works like a plugins while running musescore. Now I'll try to develop a third software (generally using visual studio 2010 Express or above) to access via OSC.
Maybe in future I can modify vol and tempo of different music Part by waving left hand or right hand. Thank you :)

Do you still have an unanswered question? Please log in first to post your question.