Skip to content

E1 · Audio -> beat-quantised chord grid + verb detection #3

Description

@ophiocus

Part of the Chord-chart video generator epic (parent #2).

Scope

Ingest an audio file or a video's audio track and produce the sound grid: a beat-quantised sequence of detected chords, plus the identified verb and its core progression.

Steps:

  • Decode input (audio, or extract audio from video).
  • Detect tempo and a beat grid.
  • Run chord recognition over the full mix (not per-instrument) — chord label per beat/segment.
  • Verb detection: find the span, at the current tempo, holding the main recognisable melodic phrase, and extract its core chord + progression.

Output (data contract for downstream epics)

A serialisable grid of cells (start_time, end_time, beat_index, chord_label) covering the whole track, plus a core_progression (ordered chord list) and the verb's time span. This is the input E2 edits and E3 consumes.

Done when

A test song produces the grid + core progression as data (dumped/inspectable), with tempo and beat positions attached. No UI required in this epic — data only.

Dependencies

None. Can start in parallel with E4.

Labels: chord-video, enhancement, prio:P1

Metadata

Metadata

Assignees

No one assigned

    Labels

    chord-videoChord-chart video generator featureenhancementNew feature or requestprio:P1Do next

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions