Hi,
we at zplane released a new technology demonstration and it would be great if you could give some feedback.
It works on single-voiced input files like vocals or single-voiced instruments.
After some initial analysis (pitches, key, tuning frequency), the user can synthesize three additional voices and is able to change the scale (major, minor, etc) of the input/output.
Personally, I think it is fun to play with this program, but I am keen to hear your opinion about it.
The demo (Win32 only) can be found at the bottom of this page:
meloscaline
Let me know what you think,
Alex
audio harmonization with voice leading
-
- KVRist
- 101 posts since 18 Mar, 2005 from Atlanta
-
- KVRAF
- 10286 posts since 17 Sep, 2004 from Austin, TX
-
- KVRAF
- 10286 posts since 17 Sep, 2004 from Austin, TX
You've got to be kidding me - I've never seen anything like that.
I threw pitch-bending chords (a synth sound I made, but sounds a lot like a tremoloed
guitar) and it faithfully changed it to "lokrian" mode.
I want user-definable modes!
How did you do that? Do you make audio-to-midi products?
Although...
That's too bad since I'd really like this as a VST plug-in and, once some people around
here check this out, I suspect they will to.
Of course, these are just my first impressions but every nice.
I threw pitch-bending chords (a synth sound I made, but sounds a lot like a tremoloed
guitar) and it faithfully changed it to "lokrian" mode.
I want user-definable modes!
How did you do that? Do you make audio-to-midi products?
Although...
Is this because this is a technology that you sell to be licenced and used in a host?zplane wrote:pricing and licensing
A single onetime payment as well as royalties depending on sold items is possible. Please contact us for further information about our licensing model.
That's too bad since I'd really like this as a VST plug-in and, once some people around
here check this out, I suspect they will to.
Of course, these are just my first impressions but every nice.
-
- KVRAF
- 10286 posts since 17 Sep, 2004 from Austin, TX
Interesting. Your elastique algorithm does a decent job of trying to track all
sorts of polyphonic or nonsensical noise and at least changing it into something listenable. I find that quite odd.
Granted, I'm forcing it to do very strange things just to see what happens but then that's because it seems to do what it was designed to do to melodies flawlessly.
I know quite a few people that I'll be showing this to today since they thought
that computer music lacked the intelligent harmonizers they've grown to rely on in
hardware units.
sorts of polyphonic or nonsensical noise and at least changing it into something listenable. I find that quite odd.
Granted, I'm forcing it to do very strange things just to see what happens but then that's because it seems to do what it was designed to do to melodies flawlessly.
I know quite a few people that I'll be showing this to today since they thought
that computer music lacked the intelligent harmonizers they've grown to rely on in
hardware units.
-
- KVRist
- Topic Starter
- 101 posts since 18 Mar, 2005 from Atlanta
Indeed we are not planning to make a product out of this, but intend to license this technology to other companies.
I have to admit that I am not aware of any (hardware) harmonizer that detects key and implements voices leading rules as well as harmony estimation. Could you point me to them?
Cheers,
Alex
I have to admit that I am not aware of any (hardware) harmonizer that detects key and implements voices leading rules as well as harmony estimation. Could you point me to them?
Cheers,
Alex
-
- KVRAF
- 10286 posts since 17 Sep, 2004 from Austin, TX
How can I say this...? I can't quite follow the terminology that you're using,
so I'm not the person to answer this question. I will, however, try to describe what I've used and you can decide if that's what you're refering to.
There are harmonizers, marketed to guitar players and vocalists, that will harmonize according to a pre-selected mode. They can't do what meloscaline does by "forcing it to key" but as long as you input something reasonably like the key/mode you select it will play, say, a relative fourth harmony instead of a invariant number of semitones harmony.
Which is to say that, while there are "intelligent harmonizers" I think that anyone would prefer meloscaline. I know I'm impressed with it. I hope your company doesn't mind me capturing the output of this demo? I'd like to grab someone more competent in music theory and put this thing through the paces this afternoon. It's a nice coincidence that exactly such a thing as meloscaline was what a group of us were discussing yesterday. Now I can show it to them.
so I'm not the person to answer this question. I will, however, try to describe what I've used and you can decide if that's what you're refering to.
There are harmonizers, marketed to guitar players and vocalists, that will harmonize according to a pre-selected mode. They can't do what meloscaline does by "forcing it to key" but as long as you input something reasonably like the key/mode you select it will play, say, a relative fourth harmony instead of a invariant number of semitones harmony.
Which is to say that, while there are "intelligent harmonizers" I think that anyone would prefer meloscaline. I know I'm impressed with it. I hope your company doesn't mind me capturing the output of this demo? I'd like to grab someone more competent in music theory and put this thing through the paces this afternoon. It's a nice coincidence that exactly such a thing as meloscaline was what a group of us were discussing yesterday. Now I can show it to them.
-
- KVRist
- Topic Starter
- 101 posts since 18 Mar, 2005 from Atlanta
AFAIK, usual harmonizers usually work with fixed (relative) intervals that are adjusted to fit the key. meloscaline makes an estimate of the best fitting harmony for each pitch and then determines what the most logical voice progression would be, so we don't think in intervals, but in harmonies.
Cheers,
Alex
Cheers,
Alex
-
- KVRAF
- 10286 posts since 17 Sep, 2004 from Austin, TX
Hmm I think that's what I'm trying to say.
There's definitely something that'll give you non-fixed intervals.
I'll get someone to grab one and tell me what's going on with it and show them yours because I know they'll love it. Luckily, though a lowly sax player myself, I live near the world-famous Willie's American Guitars so a big pile of people who think of nothing but gear are nearby and can give lucid feedback.
There's definitely something that'll give you non-fixed intervals.
I'll get someone to grab one and tell me what's going on with it and show them yours because I know they'll love it. Luckily, though a lowly sax player myself, I live near the world-famous Willie's American Guitars so a big pile of people who think of nothing but gear are nearby and can give lucid feedback.
-
- KVRian
- 1480 posts since 14 Jun, 2003
Intelligent harmonizers can use pitch detection to track single note input and transpose to coorect key/pitch.
the digitech ips-33b is an old one, the digitech vocalist series also and the new TC hardware and their Harmony4 plugin for TDM and powercore.
theres also an old discontinued vst plugin called decabuddy.
theres definately a need for intelligent harmonizers, there was a thread asking about imogen heaps "hide and seek" which is almost all harmonizer.
the digitech ips-33b is an old one, the digitech vocalist series also and the new TC hardware and their Harmony4 plugin for TDM and powercore.
theres also an old discontinued vst plugin called decabuddy.
theres definately a need for intelligent harmonizers, there was a thread asking about imogen heaps "hide and seek" which is almost all harmonizer.
-
- KVRist
- Topic Starter
- 101 posts since 18 Mar, 2005 from Atlanta
Ok, I know these and I know they are called intelligent, but personally, I hesitate use the term intelligent for them...Tony Ostinato wrote:Intelligent harmonizers can use pitch detection to track single note input and transpose to coorect key/pitch.
Cheers,
Alex
-
- KVRist
- Topic Starter
- 101 posts since 18 Mar, 2005 from Atlanta
I will try to provide a small mp3 later this day.fred2112 wrote:Can we ear a mp3 sample ?
Cheers,
(a)
-
- KVRist
- Topic Starter
- 101 posts since 18 Mar, 2005 from Atlanta
Here's a short cello example, perhaps not the best, but it shows some abilities:
download
First, the original phrase is played, then it is automatically harmonized (3 additional voices), and finally the complete harmonization is played in major instead of minor.
But I would suggest to try out the demo rather than listen to this small mp3.
Cheers,
Alex
download
First, the original phrase is played, then it is automatically harmonized (3 additional voices), and finally the complete harmonization is played in major instead of minor.
But I would suggest to try out the demo rather than listen to this small mp3.
Cheers,
Alex
-
- KVRian
- 1440 posts since 16 Jul, 2003 from Zwollywood, The Netherlands (Europe)
I've tried the demo, and it works cool.
I just wonder, in what way is the demo restricted?
Is it going to expire after some time? Or is it just that you can't use audio longer then 60 seconds?
I just wonder, in what way is the demo restricted?
Is it going to expire after some time? Or is it just that you can't use audio longer then 60 seconds?
-- Regards MrM --