Yeah, for web apps you have to make sure your phone is not on silent and the ringer volume is up. This is why most audio apps for phones will force you to use their native app.

I was looking into a way around this and I don't think it exists without building out an entire phone app.

Im building some web audio things and iOS is really a pain. Sometimes the audio plays, sometimes not, sometimes it get stuck playing in the bg. The silent mode button is also something i forget often haha thanks for reminding me again (my phone is always on silent because i get about 15 spam calls a day…)

Have you tried setting `navigator.audioSession.type = playback`?

Thank you! This one liner worked. I searched for a solution for this when I was building this app and am not sure why I couldn't find this.

Looks like this has been possible since iOS 17 but is not well documented.

Thanks!

Thanks!

For 1) another commenter had a simmilar idea. I think a GAN would be able to do this. It's just a matter of collecting the data

For 2) SUNO's stem separation is pretty good. The open sources ones (like spleeter) are also not bad, but they are pretty hit or miss.

For 3) This is a really cool idea. The deep dream images produced the fur and eyeball textures because they used imagenet data which had a bunch of dogs and other animals in it. The trick would be finding a good data set to use for this. May be there is a public source of animal sounds floating around you could try this with.

And yeah think people 100% generating songs is pretty wack, but I could see why it would be fun to someone who is not a musician.

The weights are ~300MB and are on hugging face here. https://huggingface.co/zhinit/kick-gen-v1

It was a lot of work to get a good DSP to work on the web hahah. Yes, I am writing the DSP in C++ and compiling to WASM. Im using multithreading so the audio work is done in the AudioWorklet while the UI is run in the main thread. I was thinking of writing another article on this because it's pretty interesting and a bit complex.

I sound designed some of the kicks myself and some of them are from sample packs. I just renamed them all to have German names.

If I wanted the model to run completely in the frontend I would need the user to download 300MB of weights and it would probably be tricky making sure it works on everyone's hardware. So I though about this but it didn't seem like the best option. I'm pretty sure it is possible though.

And yes I put rate limiting so no one goes crazy on my credits.

Im glad you're enjoying it!

Im not selling a product here so I'm not going to worry about it for my purposes.

This is the hot topic in AI ethics.

Is it just learning the same way that a human learns from hearing songs on the radio and playing them, or is it just a compression algorithm? There is not a clear answer here but it seems like the legal system so far is letting things slide and agreeing with the former argument.

(This can also be applied to other areas like open AI reading the NYT)

To do this, I think you are right that you would need to 'downgrade' modern recordings to sound old so that you have both sides of the training data covered.

This would be a cool project to work on. Ideally you would buy some vintage gear and then run the audio through both, but that would be very expensive. You could may be find some vst emulations though and get decent results.

Interesting! I had not seen this. On their website they mention diffusion but not the other models so it might not be identical but its definitely similar.

That's fair :) I also could've phrased my comment a bit more politely.

It reminded me of the (possibly apocryphal) story about Liam Gallagher trashing a hotel room on tour - when asked by a reporter "why? It's been done before." he supposedly replied "yeah, but not by me".

Sometimes the "by me" is the interesting / fun / instructive part.

I sound design a lot of stuff (in fact I made some of the default kicks in the app), but this is just a different tool, and I wanted some practice training and deploying a generative AI model.

Seems like if you build some more scaffolding around it, it wouldn't be bad. I think AI video isn't quite there yet so you probably would want to lean into that. For example you could ask for an animated or cartoon music video so the real shots don't look weird. Also if you gave it some guidance on what a good music video is like it would probably help as well. But yeah idk may be that's not the goal here.