music-video-gen/flow-state
Dejvino cb320557e6 Phase 1: offline audio pipeline
Whole-track analysis into a frame-indexed FeatureTrack. Nothing reads a
live AnalyserNode: realtime preview maps currentTime to a frame index,
export counts frames, both read the same rows.

- fft.js: radix-2 with precomputed tables, allocated once per track
- analyze.js: STFT at hop 1/60s with CENTRED windows (a window that starts
  at the timestamp reports energy arriving up to 23ms later, which reads as
  visuals lagging the music). Energy features normalised against the track's
  own percentiles; absolute stats kept in summary for the look generator.
- tempo.js: autocorrelation + grid F-measure, beat grid, downbeats
- segment.js: self-similarity novelty, boundaries snapped to the bar grid
- FeatureTrack: assembles everything, plus the lookahead fields. buildSlope
  rises through the bars leading into a higher-energy section, so a build can
  ramp into the drop rather than react after it lands.
- clicktrack.js: mixes clicks onto the detected grid for validation by ear

Three real bugs found and fixed by the tests:
- 174 BPM read as 87. Mean-energy-per-beat scores a half-tempo grid
  identically to the true one; only an F-measure penalises the missed
  onsets via recall.
- 90 BPM read as 180. Offbeat hi-hats make a double-tempo grid score
  perfectly on both precision and recall, so the grid is now interpreted
  metrically afterwards: a systematic strong/weak alternation means the
  real beat is every other grid point.
- Beat grid drifted ~30ms over 30s from integer-frame offsets. Onset peaks
  are now parabolically interpolated and the grid least-squares fitted.

Gates: 11/11 node tests against synthetic ground truth (tempo within 2%
across 90-174 BPM, beat alignment under half a frame, segmentation within
2s of a known boundary, graceful on silence, 6-minute analysis in 1.0s);
5/5 browser checks including audio-driven vs fixed-step frame parity.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-08-05 11:10:01 +02:00
..
src Phase 1: offline audio pipeline 2026-08-05 11:10:01 +02:00
test Phase 1: offline audio pipeline 2026-08-05 11:10:01 +02:00
tools Phase 0: determinism spine 2026-08-05 10:59:30 +02:00
.gitignore Phase 0: determinism spine 2026-08-05 10:59:30 +02:00
checks.html Phase 0: determinism spine 2026-08-05 10:59:30 +02:00
index.html Phase 0: determinism spine 2026-08-05 10:59:30 +02:00
package-lock.json Phase 0: determinism spine 2026-08-05 10:59:30 +02:00
package.json Phase 0: determinism spine 2026-08-05 10:59:30 +02:00
PLAN.md Plan: flow-state ambient/EDM video generator 2026-08-05 10:49:14 +02:00
vite.config.js Phase 0: determinism spine 2026-08-05 10:59:30 +02:00