Captures audio from the currently active Chrome/Edge tab, shows a live spectrum, maps editable frequency bands to Patternflow knobs, and sends normalized knob deltas over WebSocket.
The extension uses the same Patternflow mark as the web app for its toolbar icon and popup header.
- Open
chrome://extensions. - Enable Developer mode.
- Click Load unpacked.
- Select this folder:
tools/patternflow-audio-extension. - Open a tab that is playing audio.
- Click the Patternflow Audio extension button.
- Set the device host to
patternflow.localor the board IP address. - Press Start.
Use the extension for YouTube, Spotify Web, browser games, or any other tab
or system audio. The built-in http://patternflow.local/ page remains useful
for microphone input and audio-file experiments, but browser tab/system capture
is often blocked there because the ESP32 serves normal HTTP.
For WebSocket-only debugging, press WS Test instead of Start and move the K1-K4 sliders. This bypasses tab capture and audio analysis completely.
Spectrum: live frequency strength display. Drag across it to set the active band's range.Add Band: starts with one band, then adds more bands as needed.Output: min/max Patternflow knob output from 0.0 to 1.0.Clamp / gain: optional input low/high clamp and sensitivity.K: target Patternflow knob index.Smoothing: global response smoothing.WS Test: connect to the device and send manual K1-K4 movements.
The extension sends delta messages like d=0,v=0.125 to ws://<device>:81.
Future direction: expand the popup into a larger controller page for live performance and mapping.
- Real-time spectrum and waveform visualizers.
- Drag-to-select frequency bands on the spectrum.
- Per-band mapping curves, invert, gate, attack, release, and smoothing.
- Pattern-specific presets saved in Chrome storage.
- Larger K1-K4 output meters and connection diagnostics.
- Beat/transient helpers for kick-style triggers or preset stepping.