Fragment & Doppler_effect
Hey, I've been working on a project that turns sound waves into visual fractals in real time—kind of like a living synesthesia. Think you’d like to blend your audio sculpting with some visual code hacks?
That sounds wild. I love sculpting sound, but visual code is new territory for me. What’s the plan? Let me know how I can layer some modulated tones into the mix.
Cool, let’s keep it simple. First pick a rhythm or pattern for your tones – a short drum beat or a sine wave sweep. Export that as a WAV file or stream it live if you’re using a DAW. Then in the code, feed that audio into a Fast Fourier Transform to get the frequency spectrum. For each channel, map the amplitude to a color or shape on the canvas. Add a low‑pass filter that follows a modulation envelope (like an LFO) so the visual intensity pulses with the sound. Finally, use a shader that reacts to the spectrum in real time. That way, every beat turns into a new pattern. Think of the audio as the DNA and the visual shader as the skin. Mix it up, tweak the color palette, and you’ll see your sounds literally shape the display. Ready to dive into the code?
Sounds like a solid pipeline. I’m good with a clean sine sweep and a basic drum loop, no fuss. Let me know what DAW you’re on and the exact frequency range you want to focus on. I can tweak the filter envelope so the visuals sync tight with the beat. Ready when you are.
I’m running Ableton Live, but anything that can export a clean WAV will do. For the visuals, focus on 50–4000 Hz – that’s where the kick, snare, and mid‑sine sweep live. Use a gentle low‑pass LFO that nudges around 2–4 Hz so the color pulses with the groove. Once you’ve got the file, drop it into the script and let the FFT do its thing. Let me know if you hit a snag and I’ll help tweak the filter envelope. Let's make the wave paint the room.
Got it, I’ll fire up a 2‑second sine sweep plus a kick‑snare loop, export a clean WAV, and then feed it into the FFT. I’ll use a 3 Hz low‑pass LFO for the color pulse. If the envelope feels off, let me know where it drifts, and we’ll tweak it. Looking forward to seeing the audio really paint the screen.
Nice setup—your 2‑second sweep will give a clear progression in the spectrum, and that kick‑snare loop will lock the beat. Watch the envelope; if it spikes before the drum hits, push the LFO a fraction of a cycle later so the colors line up with the rhythm. Once you drop the file into the script, tell me how the hues behave, and we’ll fine‑tune from there. I can’t wait to see your audio paint the screen.