U-HE Zebra 3 Alpha Prototype Developments

VST, AU, AAX, CLAP, etc. Plugin Virtual Instruments Discussion
Post Reply New Topic
RELATED
PRODUCTS
Zebra Legacy (Zebra2) Zebralette 3

Post

Urs wrote: Thu Oct 19, 2023 6:40 am Let me preempt high expectations here.

There will not be any dedicated resynthesis or sample playback. The tools we are building are optimised for human interaction, which I think offers spectacular results. Any form of sample import is a matter of convenience, but resynthesis or sample playback was never the aim of these tools.

While we did recently show that we can analyse samples and generate vectorised curves from them, I think I was also clear that it's a bit hit and miss. Some material is a better fit for this than some other. Importing individual waveforms is pretty easy and straight forward. Importing and vectorising a dozen or so frames from even a simple sample does not necessarily produce the expected results when morphing: The transitions may be seamless, but they hardly ever sound exactly like the in-between frames of the sample. It takes some manual work to achieve this, and often enough it simply isn't possible. It's pretty good when it happens though, and then I guess it's safe to say "this is a bit like resynthesis".

However, converting arbitrary samples to spline based waveforms resembles wavetable synthesis, not resynthesis.

We have also planned to support classic wavetable scanning like Hive does. We furthermore have plans for Hive and Z3 to import samples of arbitrary pitch, which internally will be converted to wavetables with up to 256 frames. Those will have the same properties as any wavetable, it's just an easier way to create a wavetable from an arbitrary sample. It is my understanding from what people tell me that the tools available for this are not exactly gratifying, which is, I guess, why people frequently ask for it.

This again is wavetable synthesis, not resynthesis.

What we will offer in Zebra's new oscillators though is pretty extensive manipulation of harmonic amplitude/envelope and pitch/frequency. But this again is not accessible on a per-harmonic basis. Instead, high-level oscillator effects and spectrum warping offer realtime manipulation through modulators. These tools can do some crazy stuff.

In any case, we will not be advertising any of it as resynthesis or sample playback.
Hi Urs,

I've been following all of these threads and have been waiting for the Hive 2 improvement that takes a sound byte and turns it into a wave table. I see that you've mentioned it here. I'm not clear from what is said above how things are likely to work with this. Part of what you say sounds like you've had difficulty with the results of doing this--hit or miss. In another part in the post above you mention importing "samples of arbitrary pitch, which internally will be converted to wavetables with up to 256 frames". So it sounds like a sample based wavetable creator tool will work to some extent.

Maybe the part I'm not fully understanding is the Wavetable vs resynthesis differences mentioned above. To me, if a arbitrary sample of say, a 5 second morphing bell sound to wind sound is converted to a 256 frame wavetable, and the sound from the wavetable sounds the same as the sound from the sample, then essentially, that's what a person would expect from resynthesis. Are you just saying that even though the converted results end up as a wavetable, it is still not resynthesis, and this is why you are not advertising it as resynthesis? To me, I'm less concerned about what it is called, than the results in the end. I'm just trying to understand how accurate the tool will be with converting the sampled sound to a wavetable that sounds the same. It sounds to me like this process is still hit or miss. Could you clarify and explain further? I'm seeking to understand. Thank you! :)
Vendor‑Dependent Copy Protection: Customers lose. Pirates win.:mad:
(Also: I'm Accused of lying about Linux—it boots, runs my pro audio workflow, stays stable, updates--though yearly dismissed as “niche”. Yet I'm the deluded one.)
:roll:

Post

I´m very exited for this one. Can´t wait to be Zebrafied.

Urs, whatever some people say or think about your plugins, the Love and passion you put in IS visible !

.....the rest is voting with zhä Money
"Plugin has turned Drug now"....and the business knows it.

Post

jsp1979 wrote: Thu Oct 19, 2023 8:00 pm
bmanic wrote: Thu Oct 19, 2023 7:31 pm
Teksonik wrote: Thu Oct 19, 2023 5:21 pm No, I will not read or respond to any replies from you or any of your sycophants..... :uhuhuh:
Wow aren't you courageous. Shout insults and leave the room. A show of great character. :tu: :lol:
This is his standard sign-off these days. He's reminding me more and more of another long-time KVR member who has the same level of self-importance, tact, and belief that his viewpoint is only reasonable one ever. Grrrrrrr! :D
Hehehe!!! I see what you did there with your hint as to whom you were referring. :D
Vendor‑Dependent Copy Protection: Customers lose. Pirates win.:mad:
(Also: I'm Accused of lying about Linux—it boots, runs my pro audio workflow, stays stable, updates--though yearly dismissed as “niche”. Yet I'm the deluded one.)
:roll:

Post

Teksonik wrote: Thu Oct 19, 2023 5:21 pm
Urs wrote: Thu Oct 19, 2023 8:00 am Let me tell you how I perceive this: Some random guy on the internet has entitlement issues and needs to yell at clouds.
Let me tell you how I perceive your response:

Some random developer on the internet who has been getting his arsed kissed here for so long that his ego has become inflated when in fact it's taken him and his team well over a decade to develop an update for a relatively simple synth and still hasn't fixed a two year old crash level bug in another one of his plugins.

U-he might have been one of the top developers a couple of decades ago but now? Meh just a mediocre developer.

No, I will not read or respond to any replies from you or any of your sycophants..... :uhuhuh:
Wow! Just WOW! Uncalled for and untrue--despite your opinion. :roll:
Vendor‑Dependent Copy Protection: Customers lose. Pirates win.:mad:
(Also: I'm Accused of lying about Linux—it boots, runs my pro audio workflow, stays stable, updates--though yearly dismissed as “niche”. Yet I'm the deluded one.)
:roll:

Post

audiojunkie wrote: Fri Oct 20, 2023 3:22 pmCould you clarify and explain further?
Happily.

So, let's first try to define resynthesis. Resynthesis as I understand it takes a sample, any sample, and creates somewhat independent envelopes of volume and pitch for each harmonic, and possibly even inharmonic frequencies. On playback then, a large number of sine oscillators apply these individual envelopes on volume and pitch, but the rate at which these envelopes are applied are independent from the base pitch of the note. Furthermore, there are probably means to interpolate those envelopes between multiple samples of the same instrument, such as to mimic formants of an instrument and such. On top, there are probably means to contract or expand timing and loudness of these envelopes in groups or in dependence of their relative pitch to the fundamental.

In short: Reynthesis is a super dynamic process that aims at deluxe sample playback with various manipulations to either blend or morph or mangle the original sound.

Now, here's what we do:

We take a sample, any sample of any pitch, and deconstruct it into an array of single cycle waveforms. That could be 5 cycles, but it could also be 2000 cycles, depending on pitch and length of the sample. From this array of cycles we pick, say 3 or 10 or 217 cycles, that according to some metrics seem representative for the sample as a whole. As one example, we pick the cycles that are spectrally the most different from each other.

In Hive, we will then simply take the selected cycles, upsample them to Hive's internal wavetable size (256 frames of 2048 samples) and then you'll have something that resembles the original sample as a wavetable. The wavetable will not have any pitch envelope, nor will there be independent control over volume envelope for each harmonic. And of course, it's a wavetable - it doesn't contain inharmonic frequencies.

In Zebra 3, we pick a much smaller number of cycles from that array. We currently operate with a maximum of 16 frames. We vectorise them and put them on the timeline relative to where we picked them from. We had some high hopes that it would be easy to create the intermediate waveform by morphing, but it turns out that our best effort to automatically morph waveforms isn't good enough to offer instant gratification. Hence my words of caution.

We do however offer means in Z3 to do crazy inharmonic things. I do believe though that it's much more fun using this with hand drawn curves than with curves harvested from a sample. I might be wrong on this, but then I'm also not a nutter for samples, and thus I've only ever tried with a few examples that I had or made myself. My best success was a filter sweep that I recorded from Repro and that after a bunch of attempts actually sounded quite good.

Hence, I don't think this is going to be an instant gratification tool for people who are looking for resynthesis.

However, for people who seek a way to turn samples of instruments into Hive wavetables, it might be really, really good. I haven't really experimented with that at all, yet, I simply was in an endless crunch to have Zebralette at the point shown in the video in the OP, then crunch for NKS2, then crunch for MPE, and now crunch back for Zebralette.

On that it looks pretty good for a beta this year maybe. Big maybe. I hope to have it ready for NAMM. Depends on how things go.
Last edited by Urs on Fri Oct 20, 2023 3:57 pm, edited 2 times in total.

Post

VELLTONE MUSIC wrote: Fri Oct 20, 2023 11:12 am Look man,already lost desire,motivation or whatever to be in your or other guru developer sect...neither gonna follow,nor gonna contribute to your or else delusional ideas ,that you know better what artists,musicians,designers so on REALLY IMPORTANT PART of the equation people who ask you developers to add or fix whatever you ALWAYS miss for years,but still fed you with hard earned money.I spend 6 years already of research and development of system/technology that you are no gonna understand practical aplication after 100 years,so i'm just curious,what if suddenly all your customers stop to buy, ...
Let's see ... For Zebra2 (including Dark Zebra) I have got through the years 56 sound sets. I have browsed and heard many in choosing them. Arksun, Unfinished, TTU, Sonic Underground, Treeswift, Big tone, Zen, Bjulin, and many more. Interestingly enough, no sound set at all from velltone.

Ah vell ...

Post

Urs wrote: Fri Oct 20, 2023 3:53 pm
audiojunkie wrote: Fri Oct 20, 2023 3:22 pmCould you clarify and explain further?
Happily.

So, let's first try to define resynthesis. Resynthesis as I understand it takes a sample, any sample, and creates somewhat independent envelopes of volume and pitch for each harmonic, and possibly even inharmonic frequencies. On playback then, a large number of sine oscillators apply these individual envelopes on volume and pitch, but the rate at which these envelopes are applied are independent from the base pitch of the note. Furthermore, there are probably means to interpolate those envelopes between multiple samples of the same instrument, such as to mimic formants of an instrument and such. On top, there are probably means to contract or expand timing and loudness of these envelopes in groups or in dependence of their relative pitch to the fundamental.

In short: Reynthesis is a super dynamic process that aims at deluxe sample playback with various manipulations to either blend or morph or mangle the original sound.

Now, here's what we do:

We take a sample, any sample of any pitch, and deconstruct it into an array of single cycle waveforms. That could be 5 cycles, but it could also be 2000 cycles, depending on pitch and length of the sample. From this array of cycles we pick, say 3 or 10 or 217 cycles, that according to some metrics seem representative for the sample as a whole. As one example, we pick the cycles that are spectrally the most different from each other.

In Hive, we will then simply take the selected cycles, upsample them to Hive's internal wavetable size (256 frames of 2048 samples) and then you'll have something that resembles the original sample as a wavetable. The wavetable will not have any pitch envelope, nor will there be independent control over volume envelope for each harmonic. And of course, it's a wavetable - it doesn't contain inharmonic frequencies.

In Zebra 3, we pick a much smaller number of cycles from that array. We currently operate with a maximum of 16 frames. We vectorise them and put them on the timeline relative to where we picked them from. We had some high hopes that it would be easy to create the intermediate waveform by morphing, but it turns out that our best effort to automatically morph waveforms isn't good enough to offer instant gratification. Hence my words of caution.

We do however offer means in Z3 to do crazy inharmonic things. I do believe though that it's much more fun using this with hand drawn curves than with curves harvested from a sample. I might be wrong on this, but then I'm also not a nutter for samples, and thus I've only ever tried with a few examples that I had or made myself. My best success was a filter sweep that I recorded from Repro and that after a bunch of attempts actually sounded quite good.

Hence, I don't think this is going to be an instant gratification tool for people who are looking for resynthesis.

However, for people who seek a way to turn samples of instruments into Hive wavetables, it might be really, really good. I haven't really experimented with that at all, yet, I simply was in an endless crunch to have Zebralette at the point shown in the video in the OP, then crunch for NKS2, then crunch for MPE, and now crunch back for Zebralette.

On that it looks pretty good for a beta this year maybe. Big maybe. I hope to have it ready for NAMM. Depends on how things go.
Thank you for this clarifying response! I greatly appreciate it! :)
Vendor‑Dependent Copy Protection: Customers lose. Pirates win.:mad:
(Also: I'm Accused of lying about Linux—it boots, runs my pro audio workflow, stays stable, updates--though yearly dismissed as “niche”. Yet I'm the deluded one.)
:roll:

Post

audiojunkie wrote: Fri Oct 20, 2023 3:22 pm Maybe the part I'm not fully understanding is the Wavetable vs resynthesis differences mentioned above.
If you want a practical example of Resynthesis, here's a video of it being used in Parawaves Rapid.

KVR S1-Thread | The Intrancersonic-Design Source > Program Resource | Studio One Resource | Music Gallery | 2D / 3D Sci-fi Art | GUI Projects | Animations | Photography | Film Docs | 80's Cartoons | Games | Music Hardware |

Post

Here's a video from Tone2 on that subject:


Post

Urs wrote: Fri Oct 20, 2023 3:53 pm However, for people who seek a way to turn samples of instruments into Hive wavetables, it might be really, really good. I haven't really experimented with that at all, yet, I simply was in an endless crunch to have Zebralette at the point shown in the video in the OP, then crunch for NKS2, then crunch for MPE, and now crunch back for Zebralette.

On that it looks pretty good for a beta this year maybe. Big maybe. I hope to have it ready for NAMM. Depends on how things go.
If you did that for Hive, I'd probably buy it on the spot. Big reason why I bought Tone2's Icarus2 which seems to do it well enough for an idiot like me.
<list your stupid gear here>

Post

How good is the Aliasing on this thing?
You can be creative in any right place on Earth, and not only in the wealthiest cities. Bring the world feelings from everywhere, and not only feelings of capitalistic or jail environment.
― Aleksey Vaneev


https://linuxdaw.org

Post

El°HYM wrote: Fri Oct 20, 2023 7:55 pm How good is the Aliasing on this thing?
It's great, it's oversampled 8000x, so the aliasing has no aliasing, for the best quality.
Last edited by beely on Fri Oct 20, 2023 8:07 pm, edited 1 time in total.

Post

But the Aliasing is good? Makes everything more crispy! :?
You can be creative in any right place on Earth, and not only in the wealthiest cities. Bring the world feelings from everywhere, and not only feelings of capitalistic or jail environment.
― Aleksey Vaneev


https://linuxdaw.org

Post

Thanks for the resynthesis youtube examples guys! :)
Vendor‑Dependent Copy Protection: Customers lose. Pirates win.:mad:
(Also: I'm Accused of lying about Linux—it boots, runs my pro audio workflow, stays stable, updates--though yearly dismissed as “niche”. Yet I'm the deluded one.)
:roll:

Post

El°HYM wrote: Fri Oct 20, 2023 8:06 pm But the Aliasing is good? Makes everything more crispy! :?

Post Reply

Return to “Instruments”