A local AI music generator that is trainable!
-
- KVRAF
- 2152 posts since 15 May, 2017
So, I have known about this for a couple of weeks, but, haven't had the time to try it, but, I will for sure very soon.
It a an AI that you run local on your machine that is very similar to SUNO. It is called Ace Step 1.5 and is open source.
There a couple of cool things about this, one, there is a base model you can use to train the model on your music and there is even a VST.
It does have a flaw in that, I found it's actually a flaw in all AI generated music is that there will be some background noise on the tracks. So, most of the time, you need to clean up the track in a DAW.
If you search YouTube for Ace Step 1.5, you will find a lot of great videos about it.
One thing you should know, it's a Python application, so, it needs a lot of other support files to run. You should be comfortable with this level of working with Python and Python Environments, too. You should also be comfortable with using GitHub as well. However, it does have very clear and easy to follow setup and in most cases, it's pretty much automatic for the setup and operation.
My use case for this would be generating guitar stuff, like finger style classical, Spanish or Blues, then converting that into MIDI.
You should also need to be comfortable with ComfYUI, which is what you would use to train the AI
You can also use ChatGPT if you have any problems with installation. ChatGPT is very accurate with coding.
Here a the links:
(when you open the links, you need to scroll down to see the read me for each page.)
Ace Step main GitHub page: https://github.com/ace-step/ACE-Step-1.5
Ace Step setup page: https://github.com/ace-step/ACE-Step-1. ... INSTALL.md
It a an AI that you run local on your machine that is very similar to SUNO. It is called Ace Step 1.5 and is open source.
There a couple of cool things about this, one, there is a base model you can use to train the model on your music and there is even a VST.
It does have a flaw in that, I found it's actually a flaw in all AI generated music is that there will be some background noise on the tracks. So, most of the time, you need to clean up the track in a DAW.
If you search YouTube for Ace Step 1.5, you will find a lot of great videos about it.
One thing you should know, it's a Python application, so, it needs a lot of other support files to run. You should be comfortable with this level of working with Python and Python Environments, too. You should also be comfortable with using GitHub as well. However, it does have very clear and easy to follow setup and in most cases, it's pretty much automatic for the setup and operation.
My use case for this would be generating guitar stuff, like finger style classical, Spanish or Blues, then converting that into MIDI.
You should also need to be comfortable with ComfYUI, which is what you would use to train the AI
You can also use ChatGPT if you have any problems with installation. ChatGPT is very accurate with coding.
Here a the links:
(when you open the links, you need to scroll down to see the read me for each page.)
Ace Step main GitHub page: https://github.com/ace-step/ACE-Step-1.5
Ace Step setup page: https://github.com/ace-step/ACE-Step-1. ... INSTALL.md
-
musicdevelopments musicdevelopments https://www.kvraudio.com/forum/memberlist.php?mode=viewprofile&u=223336
- KVRAF
- 6010 posts since 9 Jan, 2010
Thanks, BluGenes, that is very interesting!
Let us know if you managed to set it up and use it.
BTW someone, please send me an RTX 5090
Thanks!
Attila
Let us know if you managed to set it up and use it.
BTW someone, please send me an RTX 5090
Thanks!
Attila
https://www.musicdevelopments.com
Home of RapidComposer, Melodya, MIDI Mutator and Syne
Summer Sale • June 3-15 • 40% off RapidComposer, Melodya, MIDI Mutator, Syne
Home of RapidComposer, Melodya, MIDI Mutator and Syne
Summer Sale • June 3-15 • 40% off RapidComposer, Melodya, MIDI Mutator, Syne
- KVRist
- 291 posts since 10 Feb, 2018 from Cumbria, UK
I'll have one as well please
I don't think it'll run on my GeForce 710 with 2Gb Vram
Symphony No 1 - https://youtu.be/nVVJMyjOVAY
New Album: Secret Whispers - https://open.spotify.com/album/4XtNkk6z6tngFaubnC3fME
New Single: Shiny Emeralds https://youtu.be/kaLThaPDrhg
http://www.blues-house.com/
New Album: Secret Whispers - https://open.spotify.com/album/4XtNkk6z6tngFaubnC3fME
New Single: Shiny Emeralds https://youtu.be/kaLThaPDrhg
http://www.blues-house.com/
-
- KVRAF
- Topic Starter
- 2152 posts since 15 May, 2017
Yea, me too! lol.. well, I did get it to run more or less "right of the box", but, it does have issues. I have a pretty low end bottom of the scale GPU too, with 8 gigs. My card is older and does not support the newer specs that AI uses, but, the code does have some work arounds for that. Also, to really get the best out of this, I have to actually run it with VS Code and let VS code optimize it for my system. One big problem is, it's settings are persistent without a way to save them. It only saves some of the parameters too, so, I have to add a save button, etc. It has specific settings to generate the best quality, and those are never saved. So, I need to code that myself.
You work by starting with the "simple" generation, which actually just generates a more complicated prompt. That process can take a few minutes then you use the new prompt to generate the actual music.
I haven't got paste that point yet, so, what kind of music quality it generates, I can't say just yet. When I did work on this, I did record video of my process, so, I will post all of that when I can get back to it..(next day or so)
You work by starting with the "simple" generation, which actually just generates a more complicated prompt. That process can take a few minutes then you use the new prompt to generate the actual music.
I haven't got paste that point yet, so, what kind of music quality it generates, I can't say just yet. When I did work on this, I did record video of my process, so, I will post all of that when I can get back to it..(next day or so)
-
- KVRAF
- Topic Starter
- 2152 posts since 15 May, 2017
Ok, well good news and bad news. The bad news first, I gave up. My hardware just won't cut it. But, the good news is, you can use it from a web site for free. Just create an account, or login with, like, Google Account, and you are good to go. It's pretty much the same thing as if you download it locally.
Getting really good results to!
https://acemusic.ai
Getting really good results to!
https://acemusic.ai
- KVRist
- 291 posts since 10 Feb, 2018 from Cumbria, UK
Just had a go on the cloud version. Very similar to Suno.
Not great but it'll get there given time.
I still prefer to work with midi though, much more flexible.
Not great but it'll get there given time.
I still prefer to work with midi though, much more flexible.
Symphony No 1 - https://youtu.be/nVVJMyjOVAY
New Album: Secret Whispers - https://open.spotify.com/album/4XtNkk6z6tngFaubnC3fME
New Single: Shiny Emeralds https://youtu.be/kaLThaPDrhg
http://www.blues-house.com/
New Album: Secret Whispers - https://open.spotify.com/album/4XtNkk6z6tngFaubnC3fME
New Single: Shiny Emeralds https://youtu.be/kaLThaPDrhg
http://www.blues-house.com/
-
- KVRAF
- Topic Starter
- 2152 posts since 15 May, 2017
What I wanted to do is just generate solo tracks, like guitar, and convert that to midi. I found probably the best VST for that at the moment, it's by Aurally Sound called Prism. It even writes the velocities pretty much correctly.Mykyndryd_ wrote: Thu May 14, 2026 5:28 pm Just had a go on the cloud version. Very similar to Suno.
Not great but it'll get there given time.
I still prefer to work with midi though, much more flexible.
https://aurallysound.com/pages/prism-audio-to-midi
-
- KVRAF
- Topic Starter
- 2152 posts since 15 May, 2017
Not really related, but, I think this will be really cool. You will soon be able to run your VST plugins from a chromium based browser. I am kind of part way there myself as I do have a working midi editor for my web site. Would be cool run run my own VST's and edit like that. Not sure what the benefits would be, but, it would be new.
Anyways, it will be presented and discussed at the ADC- Conference in Japan, June 1-3 2026, (Audio Developers Conference)
Anyways, it will be presented and discussed at the ADC- Conference in Japan, June 1-3 2026, (Audio Developers Conference)
-
- KVRAF
- Topic Starter
- 2152 posts since 15 May, 2017
Ok, so, I have to admit, I really really like Suno. I have been playing with it for about a week and I liked it to the point were I went ahead a paid a year for the service as a Premier member, which for me was about $225 bucks. I think I can safely say this will be a great resource for me.
-
- KVRAF
- Topic Starter
- 2152 posts since 15 May, 2017
So, just quick my 2 cents on Suno.. wow! So, it does a really good job when you train on your style and then cover yourself. This was trained on some country style licks I know and the I just ran a cover of my model and this is the result. Now, it's _Mostly_ me, but, the AI did cover a lot of it, including, the backing and the vocals.
This to me, is just a great tool to have!
https://suno.com/s/rD5RvCyOqDbDKT3E
This to me, is just a great tool to have!
https://suno.com/s/rD5RvCyOqDbDKT3E
-
- KVRAF
- Topic Starter
- 2152 posts since 15 May, 2017
Ok, so, now up to 4 cents.. lol
I really do find this very useful. In my opinion, I don't see a threat to anything, like this could kill music production. If anything, it will enhance it. I guess it depends on how you use it too. I found that even using my own recordings of me myself and I, it did a great job with creating the feel and groove I wanted.
Yea, it's different and all, but, I think in a good way.
Ok, so, at this point I have generated about 50 or so songs, and this playlist is a sampling of that. It spans a few genres that I actually like, but may not be your cup of tea. A couple of these are using my guitar playing style (the blues songs), which I trained a model on or made it influence the song. One was edited and remixed in Reaper. But, the point is, you won't know just by listening.
https://suno.com/playlist/50551f70-7719 ... 3e9d8557d6
I really do find this very useful. In my opinion, I don't see a threat to anything, like this could kill music production. If anything, it will enhance it. I guess it depends on how you use it too. I found that even using my own recordings of me myself and I, it did a great job with creating the feel and groove I wanted.
Yea, it's different and all, but, I think in a good way.
Ok, so, at this point I have generated about 50 or so songs, and this playlist is a sampling of that. It spans a few genres that I actually like, but may not be your cup of tea. A couple of these are using my guitar playing style (the blues songs), which I trained a model on or made it influence the song. One was edited and remixed in Reaper. But, the point is, you won't know just by listening.
https://suno.com/playlist/50551f70-7719 ... 3e9d8557d6
-
- KVRian
- 806 posts since 26 Aug, 2005 from Oregon, USA
Good for you! One day you will also learn how to write music
.
-
- KVRAF
- Topic Starter
- 2152 posts since 15 May, 2017
Yes maybe so! lol Hope that happens soon! I can't wait!ksandvik wrote: Wed May 27, 2026 1:55 pm Good for you! One day you will also learn how to write music.
Maybe you can help me, what exactly is that process? What do I need to do to write music?
Is it an idea for a song? What do I do with that idea? Do I contact a recording studio? Do I say, hey I have an idea about a song, and this is it. Do I have to hire musicians for the parts? Do I have play all the parts? I wrote the lyrics, do I hire someone to sing those lyrics? What exactly is that process?
Yea, not an easy choice there. So, yea, proto-typing it kind of helps. After 40 plus yeas in this industry, I think I have a clue.
-
- KVRAF
- Topic Starter
- 2152 posts since 15 May, 2017
What I should have said above, maybe you should understand a tool when you see one, as obviously you can not..
but, anyway, this video may be helpful for not only AI generated music, but any music however you generate it, even with RC.
I'd recommend pay attention to this..
but, anyway, this video may be helpful for not only AI generated music, but any music however you generate it, even with RC.
I'd recommend pay attention to this..
