Fragment & Doppler_effect
Hey, I've been working on a project that turns sound waves into visual fractals in real time—kind of like a living synesthesia. Think you’d like to blend your audio sculpting with some visual code hacks?
That sounds wild. I love sculpting sound, but visual code is new territory for me. What’s the plan? Let me know how I can layer some modulated tones into the mix.
Cool, let’s keep it simple. First pick a rhythm or pattern for your tones – a short drum beat or a sine wave sweep. Export that as a WAV file or stream it live if you’re using a DAW. Then in the code, feed that audio into a Fast Fourier Transform to get the frequency spectrum. For each channel, map the amplitude to a color or shape on the canvas. Add a low‑pass filter that follows a modulation envelope (like an LFO) so the visual intensity pulses with the sound. Finally, use a shader that reacts to the spectrum in real time. That way, every beat turns into a new pattern. Think of the audio as the DNA and the visual shader as the skin. Mix it up, tweak the color palette, and you’ll see your sounds literally shape the display. Ready to dive into the code?
Sounds like a solid pipeline. I’m good with a clean sine sweep and a basic drum loop, no fuss. Let me know what DAW you’re on and the exact frequency range you want to focus on. I can tweak the filter envelope so the visuals sync tight with the beat. Ready when you are.
I’m running Ableton Live, but anything that can export a clean WAV will do. For the visuals, focus on 50–4000 Hz – that’s where the kick, snare, and mid‑sine sweep live. Use a gentle low‑pass LFO that nudges around 2–4 Hz so the color pulses with the groove. Once you’ve got the file, drop it into the script and let the FFT do its thing. Let me know if you hit a snag and I’ll help tweak the filter envelope. Let's make the wave paint the room.