Voice to MIDI

VST, AU, AAX, etc. plug-in Virtual Instruments discussion
KVRist
60 posts since 19 Mar, 2005 from Vienna, Austria

Post Thu Dec 08, 2011 9:18 am

Hi there!

Is there a solution out there that reliably converts audio into MIDI on the fly, so I "dum diddle dum" into the mic and say my Vienna Symphonic violin instantly plays along?

I do a search every other year, but so far none of the solutions was fast or reliable enough. So here is my try for 2011. I hope I can get rid of my MIDI keyboard one day :)

Thanks
Zsolt

KVRist

Topic Starter

60 posts since 19 Mar, 2005 from Vienna, Austria

Post Thu Dec 08, 2011 10:16 am

zmarx wrote:Hi there!

Is there a solution out there that reliably converts audio into MIDI on the fly, so I "dum diddle dum" into the mic and say my Vienna Symphonic violin instantly plays along?

I do a search every other year, but so far none of the solutions was fast or reliable enough. So here is my try for 2011. I hope I can get rid of my MIDI keyboard one day :)

Thanks
Zsolt
Just tested Digital Ear. Seems to be quite fast, but hard to decide as the demo version interrupts every 10 seconds or so for 10 seconds and then it crashes after a minute - so Digital Ear probably won't get my money ...

KVRist
65 posts since 3 Apr, 2010

Post Thu Dec 08, 2011 12:02 pm

Saw a video recently suggesting you could do this via the iPad/iPhone app Thumbjam:

http://www.sonicstate.com/news/2011/11/ ... pilot-v20/

KVRian
600 posts since 27 Dec, 2006

Post Thu Dec 08, 2011 2:19 pm

I don't know of any instant analyze -> play solutions. But Melodyne can analyze (even polyphonic*) audio material and you can convert it to midi. But since Melodyne is no VST host, it can't load a sampler which would be able to convert the midi data to audio. It has a build in synthesizer to check whether or not the audio material has been analyzed correctly.

Depending on the complexity of the audio material you may need to correct the result manually, but generally Melodyne is quite reliable concerning the analyzed notes. It's just the best solution on the market to date. The latest release has some interesting additional features.

*) that depends on the edition of Melodyne. For polyphonic material you need the Editor edition.

Edit: just try the demo version:

www.celemony.com

User avatar
KVRAF
8016 posts since 2 Aug, 2005 from Guitar Land, USA

Post Thu Dec 08, 2011 3:17 pm

Fretkeys link, this is what I use, provided you're on Windows.

Also there's Voicekeys there, too, a Reaktor ensemble, never tried it myself.
The only site for experimental amp sim freeware & MIDI FX: http://runbeerrun.blogspot.com
https://m.youtube.com/channel/UCprNcvVH6aPTehLv8J5xokA -Youtube jams

User avatar
KVRAF
3922 posts since 15 Dec, 2009

Post Wed Dec 14, 2011 11:07 am

I've also tested a lot of these to use voice as input, but still nothing really workable. Best so far of the VSTs is Midifier.

Image

User avatar
KVRAF
8016 posts since 2 Aug, 2005 from Guitar Land, USA

Post Wed Dec 14, 2011 2:51 pm

I remember the Kznaudio Midifier, and just demoed it again. The latency is really bad while I play guitar!

Christian Budde's VST analyzer initially reports the latency at 9309 samples.
The only site for experimental amp sim freeware & MIDI FX: http://runbeerrun.blogspot.com
https://m.youtube.com/channel/UCprNcvVH6aPTehLv8J5xokA -Youtube jams

User avatar
KVRian
591 posts since 4 Jul, 2011 from UK

Post Thu Dec 15, 2011 4:36 am

Reaper has a free plugin called Reatune: http://wiki.cockos.com/wiki/index.php/U ... io_to_midi

KVRist
86 posts since 28 Apr, 2008

Post Thu Dec 15, 2011 4:44 am

Native Instruments 'The Mouth' does exactly what you want.

You also need Reaktor though.

http://www.native-instruments.com/#/en/ ... the-mouth/

There's a great video of it in use by Tim Exile on the NI site and YouTube.

It's the MIDI out option that will interest you.

http://www.youtube.com/watch?v=zzyr66QhrOw

User avatar
KVRAF
3922 posts since 15 Dec, 2009

Post Thu Dec 15, 2011 7:13 am

Looks really cool, anyone tried the midi out on it yet?

Midifier has atrocious latency yes, but I guess that explains its better than average performance.

Reatune is not too bad either, but I think to get any of these working reliable, one should have a chain of gate, eq, compressor and tuner in front to make the input as readable as possible, but haven't really experimented too much with it.

KVRist
86 posts since 28 Apr, 2008

Post Fri Dec 16, 2011 2:37 am

I've tested The Mouth's MIDI out and fed it to Trillian for bass lines and it was excellent.

KVRer
1 posts since 3 Sep, 2012

Post Mon Sep 03, 2012 6:58 am

I have been experimenting with this myself and have had mixed results using the Sonuus i2m device. It hasn't been cheap, however. I also needed to buy a super fast laptop computer, some pretty expensive virtual instrument software, and several other outboard gadgets. It does work, but I'm still having some tracking problems, especially with a few of the particular voices, several of which I had hoped to use. My plan has been to eventually be able to use this in my live solo performances while playing my guitar so I had to come up with something totally hands free. So far it is not reliable enough to debut in front of an audience but I am still hoping to get it there one of these days. I'm tired of only having neck strap harmonica or kazoo to play solo parts over my guitar during breaks in my vocals. I have written to TC Helicon, Roland, and just about everybody else I could think of to see if they could develop an affordable stand alone device to do this but so far I haven't even heard back from anybody.

KVRAF
4237 posts since 26 Jun, 2004

Post Mon Sep 03, 2012 8:04 am

V'ger, have you used The Mouth?
I am wondering how Midifier compares, latency aside.

Something as good as The Mouth that doesnt need Reaktor would be nice...
ImageImageImageImage

User avatar
KVRAF
3922 posts since 15 Dec, 2009

Post Mon Sep 03, 2012 1:27 pm

No haven't. Like you say the Reaktor player is a bit off-putting but there is a nice deal on Komplete with Mouth and other things included now so might jump on it.

@Bones1223: What's your complete chain? Are you using Auto-tuners?

Return to “Instruments”