NN/Mémoire - AI Sound Design

Could AI be used as a creative tool for music, beyond one click generation?

A pink "Generate" button with a cursor hovering over it

Instead, we created a virtual world where the player's movement generates the AI soundscape.

Soundscape is created by mapping the audio latent space to the virtual game level.

Tech stack: nn_tilde for real-time AI processing, Stable Audio Open as the audio model, and Unreal Engine for world building.

The pond seen from below the water line
The NN/Mémoire setup at the exhibition: the game on a laptop, headphones, and the Max patch

Tap to read