A local AI music generator that is trainable!

Official support for: musicdevelopments.com
Post Reply New Topic
RELATED
PRODUCTS

Post

So, I have known about this for a couple of weeks, but, haven't had the time to try it, but, I will for sure very soon.

It a an AI that you run local on your machine that is very similar to SUNO. It is called Ace Step 1.5 and is open source.

There a couple of cool things about this, one, there is a base model you can use to train the model on your music and there is even a VST.

It does have a flaw in that, I found it's actually a flaw in all AI generated music is that there will be some background noise on the tracks. So, most of the time, you need to clean up the track in a DAW.

If you search YouTube for Ace Step 1.5, you will find a lot of great videos about it.

One thing you should know, it's a Python application, so, it needs a lot of other support files to run. You should be comfortable with this level of working with Python and Python Environments, too. You should also be comfortable with using GitHub as well. However, it does have very clear and easy to follow setup and in most cases, it's pretty much automatic for the setup and operation.

My use case for this would be generating guitar stuff, like finger style classical, Spanish or Blues, then converting that into MIDI.

You should also need to be comfortable with ComfYUI, which is what you would use to train the AI

You can also use ChatGPT if you have any problems with installation. ChatGPT is very accurate with coding.

Here a the links:
(when you open the links, you need to scroll down to see the read me for each page.)
Ace Step main GitHub page: https://github.com/ace-step/ACE-Step-1.5
Ace Step setup page: https://github.com/ace-step/ACE-Step-1. ... INSTALL.md

Post

Thanks, BluGenes, that is very interesting!
Let us know if you managed to set it up and use it.

BTW someone, please send me an RTX 5090 :wink:

Thanks!
Attila
https://www.musicdevelopments.com
Home of RapidComposer, Melodya, MIDI Mutator and Syne
Summer Sale • June 3-15 • 40% off RapidComposer, Melodya, MIDI Mutator, Syne

Post

musicdevelopments wrote: Sun May 10, 2026 1:01 pm BTW someone, please send me an RTX 5090 :wink:
I'll have one as well please :wink:

I don't think it'll run on my GeForce 710 with 2Gb Vram :hihi:

Post

Yea, me too! lol.. well, I did get it to run more or less "right of the box", but, it does have issues. I have a pretty low end bottom of the scale GPU too, with 8 gigs. My card is older and does not support the newer specs that AI uses, but, the code does have some work arounds for that. Also, to really get the best out of this, I have to actually run it with VS Code and let VS code optimize it for my system. One big problem is, it's settings are persistent without a way to save them. It only saves some of the parameters too, so, I have to add a save button, etc. It has specific settings to generate the best quality, and those are never saved. So, I need to code that myself.

You work by starting with the "simple" generation, which actually just generates a more complicated prompt. That process can take a few minutes then you use the new prompt to generate the actual music.

I haven't got paste that point yet, so, what kind of music quality it generates, I can't say just yet. When I did work on this, I did record video of my process, so, I will post all of that when I can get back to it..(next day or so)

Post

Ok, well good news and bad news. The bad news first, I gave up. My hardware just won't cut it. But, the good news is, you can use it from a web site for free. Just create an account, or login with, like, Google Account, and you are good to go. It's pretty much the same thing as if you download it locally.

Getting really good results to!

https://acemusic.ai

Post

Just had a go on the cloud version. Very similar to Suno.
Not great but it'll get there given time.

I still prefer to work with midi though, much more flexible.

Post

Mykyndryd_ wrote: Thu May 14, 2026 5:28 pm Just had a go on the cloud version. Very similar to Suno.
Not great but it'll get there given time.

I still prefer to work with midi though, much more flexible.
What I wanted to do is just generate solo tracks, like guitar, and convert that to midi. I found probably the best VST for that at the moment, it's by Aurally Sound called Prism. It even writes the velocities pretty much correctly.

https://aurallysound.com/pages/prism-audio-to-midi

Post

Not really related, but, I think this will be really cool. You will soon be able to run your VST plugins from a chromium based browser. I am kind of part way there myself as I do have a working midi editor for my web site. Would be cool run run my own VST's and edit like that. Not sure what the benefits would be, but, it would be new.

Anyways, it will be presented and discussed at the ADC- Conference in Japan, June 1-3 2026, (Audio Developers Conference)


Post

Ok, so, I have to admit, I really really like Suno. I have been playing with it for about a week and I liked it to the point were I went ahead a paid a year for the service as a Premier member, which for me was about $225 bucks. I think I can safely say this will be a great resource for me.

Post

So, just quick my 2 cents on Suno.. wow! So, it does a really good job when you train on your style and then cover yourself. This was trained on some country style licks I know and the I just ran a cover of my model and this is the result. Now, it's _Mostly_ me, but, the AI did cover a lot of it, including, the backing and the vocals.

This to me, is just a great tool to have!

https://suno.com/s/rD5RvCyOqDbDKT3E

Post

Ok, so, now up to 4 cents.. lol

I really do find this very useful. In my opinion, I don't see a threat to anything, like this could kill music production. If anything, it will enhance it. I guess it depends on how you use it too. I found that even using my own recordings of me myself and I, it did a great job with creating the feel and groove I wanted.

Yea, it's different and all, but, I think in a good way.

Ok, so, at this point I have generated about 50 or so songs, and this playlist is a sampling of that. It spans a few genres that I actually like, but may not be your cup of tea. A couple of these are using my guitar playing style (the blues songs), which I trained a model on or made it influence the song. One was edited and remixed in Reaper. But, the point is, you won't know just by listening.

https://suno.com/playlist/50551f70-7719 ... 3e9d8557d6

Post

Good for you! One day you will also learn how to write music :-).

Post

ksandvik wrote: Wed May 27, 2026 1:55 pm Good for you! One day you will also learn how to write music :-).
Yes maybe so! lol Hope that happens soon! I can't wait!

Maybe you can help me, what exactly is that process? What do I need to do to write music?

Is it an idea for a song? What do I do with that idea? Do I contact a recording studio? Do I say, hey I have an idea about a song, and this is it. Do I have to hire musicians for the parts? Do I have play all the parts? I wrote the lyrics, do I hire someone to sing those lyrics? What exactly is that process?

Yea, not an easy choice there. So, yea, proto-typing it kind of helps. After 40 plus yeas in this industry, I think I have a clue.

Post

What I should have said above, maybe you should understand a tool when you see one, as obviously you can not..

but, anyway, this video may be helpful for not only AI generated music, but any music however you generate it, even with RC.

I'd recommend pay attention to this..


Post Reply

Return to “MusicDevelopments”