Physical modeling is dead! Google tone transfer is here ...

VST, AU, AAX, CLAP, etc. Plugin Virtual Instruments Discussion
Post Reply New Topic
RELATED
PRODUCTS

Post

Act fast - before:
- Google is split up and they can't funnel ad/search revenue into R&D/side projects: https://apnews.com/article/google-justi ... 5d4db06044
- Google discontinues cool technologies they've made that people become accustomed to, just 'cuz: https://killedbygoogle.com/

Post

This is cool ... it isn't new... We've had resynthesis for a long time. It isn't a replacement for physically modeled synths which seek to replicate the mechanics of wave motion, membranes, strings and tubes. It will be useful regardless.

Post

nathanj wrote: Tue Oct 20, 2020 8:45 pm Maybe just change the name by removing physical modelling. It’s a bit misleading.

And you get people like me who love physical modelling coming in chests puffed ready for a brawl ;)
Thanks for your suggestion, but i'm currently in the mood to piss off some physical modelling fanboys :box: :wink: I've been way too nice lately ... yin and yang, you know :wink:

I could imagine that one day this technology might make other technologies obsolete, f.e. multisamples or physical moddeling, which aim on authenticity. At the moment it's hypothetic because i dont know if this technology can work in realtime.

Post


Post

But it is nothing like physical modelling. This is Resynthesis.


It's like saying FM is Dead. Granular synthesis is here!!!

Post

audiot wrote: Tue Oct 20, 2020 8:15 pm Maybe someone who knows a bit about DSP stuff, could give an opinion on wether this will be available in realtime soon? I'm really curious ...
When NPUs are commonplace we might shave a few hours off.

The audio engine is comprised of three main modules: Partials; Noise; Reverb/Filter. The machine learns how best to tune these modules over the course of several hours until it arrives at the best match to the intended sound. It is educated trial and error.



This video gives a good visual representation of what is happening without going deep into how neural networks operate: But the basic concept is more simple than the name might suggest. I've yet to jump in but if you understand DSP it certainly opens the door.
Last edited by Unaspected on Tue Oct 20, 2020 9:51 pm, edited 1 time in total.

Post

nathanj wrote: Tue Oct 20, 2020 9:11 pm But it is nothing like physical modelling. This is Resynthesis.


It's like saying FM is Dead. Granular synthesis is here!!!
I havent said that it's the same :shrug: Physical modelling, resynthesis, scripted multisamples ... who cares. They all aim on authenticity. Will battery cars or hydrogen engines replace the combustion engine? Maybe! It's just a sensational thread title ... it's click bait :wink: I dont want to discuss technical details. What i've heard in the clips, was a new level of detail in the articulations and i thought it would be nice to share my enthusiasm :hyper:

And sorry for the car allegory :D

Post

audiot wrote: Tue Oct 20, 2020 8:43 pm Oh ... 2 downvotes already. Sorry for bringing this thread up. I promise that my next topic will be something like "Synth X vs Synth Y" ... or something like that :D
:hihi:

Thanks for bringing this up! :tu:

(Besides, I predicted PM would have made a mark several years ago, but it never did, so there's that. I had high hopes for my virtual twenty metre carbon flute, but oh well...)
Thu Oct 01, 2020 1:15 pm Passing Bye wrote:
"look at SparkySpark's post 4 posts up, let that sink in for a moment"
Go MuLab!

Post

Interesting.

Looks like a good way to profile tones, so maybe they could use this along with PM to make it more convincing.
:borg:

Post

Unaspected wrote: Tue Oct 20, 2020 9:38 pm
audiot wrote: Tue Oct 20, 2020 8:15 pm Maybe someone who knows a bit about DSP stuff, could give an opinion on wether this will be available in realtime soon? I'm really curious ...
When NPUs are commonplace we might shave a few hours off.

The audio engine is comprised of three main modules: Partial; Noise; Reverb/Filter. The machine learns how best to tune these modules over the course of several hours until it arrives at the best match to the intended sound. It is educated trial and error.



This video gives a good visual representation of what is happening without going deep into how neural networks operate: But the basic concept is more simple than the name might suggest. I've yet to jump in but if you understand DSP it certainly opens the door.
Interesting :tu: I've also watched a few videos about tensorflow.js a few months ago, but i didnt had the time to go deeper.

A few music companies like Sonible are already experimenting with AI ... although i sometimes have the feeling, that AI is more of a marketing term to some companies. Let's see!

Post

Nietzsche is also dead, which incidentally is a bugger to spell

Post

hotmitts wrote: Tue Oct 20, 2020 10:01 pm Nietzsche is also dead, which incidentally is a bugger to spell
Well, maybe his first name was PM.

:D :D :D :D :D :D :D
Thu Oct 01, 2020 1:15 pm Passing Bye wrote:
"look at SparkySpark's post 4 posts up, let that sink in for a moment"
Go MuLab!

Post

I remember reading about this project a few years ago when it was named something else. Nice to see that they're still working on it.

Machine learning is the future. Can't wait to see what the future holds for AI oriented DSP. I've been saying this for a while ever since Zynaptiq and iZotope have hopped onto machine learning.
Last edited by SeeingInMidi on Tue Oct 20, 2020 11:48 pm, edited 1 time in total.

Post

vurt wrote: Tue Oct 20, 2020 7:54 pm tell me in words :cry:

cloud crap

Post

hotmitts wrote: Tue Oct 20, 2020 10:01 pm Nietzsche is also dead, which incidentally is a bugger to spell
Friedrich Nietzsche is overrated! Oprah > Nietzsche

Post Reply

Return to “Instruments”