PulseFrame
Solo build · 2026 · Open source · MIT
- Problem
- DJs play the music; a VJ runs the visuals behind it. VJ software costs money, and you can only customize it so far. I wanted the freedom to design my own: a visual layer built around my mixes.
- Solution
- A browser engine that picks beats, energy and BPM out of live audio and drives every scene in real time — no track metadata, no timeline.
- Why it matters
- Hand-written from raw audio DSP (reading the sound wave itself) to the WebGL scenes (3D graphics in the browser). MIT open source, and already running my own sets.
Beatbox Viz
Solo build · 2026 · Prototype · actively evolving
- Problem
- I've been a beatboxer for over ten years — making music with my mouth. I wanted to make that language visible: an interactive toy that turns the sounds I make into something you can see.
- Solution
- The mic catches each beatbox hit — kick (B), hat (T), snare (K) — and classifies it within milliseconds. A letterform for that sound bursts onto your webcam feed in 3D, timed to the hit.
- Why it matters
- Where PulseFrame listens to music, this listens to you. Onset detection tuned to 50–80ms — the threshold where the sound and the letter feel like a single event.