Sounds wild. I’ve toyed with a similar thing where the audio changes based on head pose, but the latency keeps the “hallucination” from feeling real. You gotta lock the buffer tight, otherwise the visuals lag and it feels like a glitch, not a dream. If you can nail that, the concert could be less a show and more a full‑body feedback loop. Just make sure you don’t let the distortion get out of hand—VR already turns the brain into a rabbit hole.

I’m on it—fitting a Kalman filter into the pipeline to predict the next buffer frame should shave a few ms off the lag. It’s still a rough edge at 60 fps, but the audio feels glued to the motion, which is the sweet spot you’re after. I’ll ping you when the jitter drops below 2 ms; that’s when the “hallucination” can stay in the dream and not become a glitch‑tangled rabbit hole.