feat(frontend): local transcription in the browser#1770

Draft

surt91 wants to merge 121 commits into

mainfrom

Commits on May 13, 2026

docs: map existing codebase

authored and
surt91
committed
docs: initialize project — lokale Spracherkennung mit Transformers.js

authored and
surt91
committed
chore: add project config

authored and
surt91
committed
docs: complete project research (stack, features, architecture, pitfalls)

authored and
surt91
committed
docs: define v1 requirements (35 requirements)

authored and
surt91
committed
docs: create roadmap (5 phases)

authored and
surt91
committed
docs(01): capture phase context

ccthmanthey
authored and
surt91
committed
docs(state): record phase 1 context session

ccthmanthey
authored and
surt91
committed
docs(state): record phase 1 context session

ccthmanthey
authored and
surt91
committed
docs(01): research phase domain (infra + backend extension)

authored and
surt91
committed
docs(01): create phase 1 plans and walking skeleton

authored and
surt91
committed
fix(01): revise plans based on checker feedback

authored and
surt91
committed
docs(01): complete phase 1 planning with pattern map and state update

authored and
surt91
committed
docs(01): annotate roadmap with wave dependencies

authored and
surt91
committed
feat(01-01): add transcribe-local backend extension with TDD tests

authored and
surt91
committed
feat(01-01): configure Vite for Transformers.js and wire frontend extension

authored and
surt91
committed
docs(01-01): complete infrastructure and backend extension plan

authored and
surt91
committed
docs(phase-01): update tracking after wave 1

authored and
surt91
committed
docs(01-02): regression verification - backend and E2E tests pass with COOP/COEP headers

ccthmanthey
authored and
surt91
committed
docs(phase-01): update tracking after wave 2

authored and
surt91
committed
docs(phase-01): complete phase execution and verification

authored and
surt91
committed
docs(02): capture phase context for Core Transcription Pipeline

authored and
surt91
committed
docs(state): record phase 2 context session

authored and
surt91
committed
docs(02): research phase domain for Core Transcription Pipeline

authored and
surt91
committed
docs(02): create phase plans for Core Transcription Pipeline

authored and
surt91
committed
docs(02): create phase plan for Core Transcription Pipeline

authored and
surt91
committed
feat(02-01): add Whisper Web Worker with singleton pipeline and WebGPU detection

ccthmanthey
authored and
surt91
committed
feat(02-01): add audio resampling utility with OfflineAudioContext

ccthmanthey
authored and
surt91
committed
docs(02-01): complete Whisper Worker & Audio Utils plan

ccthmanthey
authored and
surt91
committed
feat(02-02): add localTranscribe i18n keys to en.ts and de.ts

ccthmanthey
authored and
surt91
committed
test(02-02): add failing tests for useLocalTranscribe hook

ccthmanthey
authored and
surt91
committed
feat(02-02): implement useLocalTranscribe hook with full pipeline orchestration

ccthmanthey
authored and
surt91
committed
docs(02-02): complete useLocalTranscribe hook plan

ccthmanthey
authored and
surt91
committed
docs(phase-2): update tracking after execution (2/2 plans complete)

authored and
surt91
committed
test(02): persist verification report and human UAT items

authored and
surt91
committed
docs(phase-2): mark phase complete, advance state to Phase 3

authored and
surt91
committed
docs(03): capture phase context

ccthmanthey
authored and
surt91
committed
docs(state): record phase 3 context session

ccthmanthey
authored and
surt91
committed
docs(03): research phase domain for UI integration

authored and
surt91
committed
docs(03): UI design contract for phase 3 integration

authored and
surt91
committed
docs(state): record phase 3 UI-SPEC session

ccthmanthey
authored and
surt91
committed
docs(03): create phase 3 UI integration plans

authored and
surt91
committed
docs(03): create phase plan for UI integration

ccthmanthey
authored and
surt91
committed
feat(03-01): add cancelDownload to useLocalTranscribe hook and i18n keys for download banner

ccthmanthey
authored and
surt91
committed
feat(03-01): create LocalTranscribeButton, DownloadProgressBanner, and wire into ChatInput

ccthmanthey
authored and
surt91
committed
docs(03-01): complete local transcribe UI integration plan

ccthmanthey
authored and
surt91
committed
fix(frontend): mock useLocalTranscribe in ChatInput tests

authored and
surt91
committed
docs(phase-03): update tracking after wave 1

authored and
surt91
committed
test(03-02): unit tests for LocalTranscribeButton and DownloadProgressBanner

ccthmanthey
authored and
surt91
committed
docs(03-02): partial summary for UI unit tests plan (checkpoint pending)

ccthmanthey
authored and
surt91
committed
fix(frontend): use whisper-small with q8 dtype for reliable transcription

authored and
surt91
committed
docs(03-02): complete human verification — approved with fixes

authored and
surt91
committed
docs(phase-03): update tracking after wave 2

authored and
surt91
committed
docs(phase-03): verification passed — all must-haves verified

authored and
surt91
committed
docs(phase-03): complete phase execution

authored and
surt91
committed
Changed model loading behaviour to button click only.

ccthmanthey
authored and
surt91
committed
docs(04): capture phase context

ccthmanthey
authored and
surt91
committed
docs(state): record phase 4 context session

ccthmanthey
authored and
surt91
committed
docs(04): add UI design contract for error handling phase

authored and
surt91
committed
docs(state): record phase 4 UI-SPEC session

authored and
surt91
committed
docs(04): research phase domain for error handling

authored and
surt91
committed
docs(04): create phase plans for error handling

authored and
surt91
committed
docs(04): create phase plan for error handling

authored and
surt91
committed
feat(04-01): add worker network error codes and i18n keys

ccthmanthey
authored and
surt91
committed
feat(04-01): add isSupported gating, error code mapping, empty check, cancel toast

ccthmanthey
authored and
surt91
committed
docs(04-01): complete error handling production code plan

ccthmanthey
authored and
surt91
committed
fix(frontend): add missing i18n keys to texts/index.ts type bridge

authored and
surt91
committed
docs(phase-04): update tracking after wave 1

authored and
surt91
committed
test(04-02): fix broken tests and add error handling test coverage

ccthmanthey
authored and
surt91
committed
docs(04-02): complete error handling test coverage plan

authored and
surt91
committed
fix(frontend): check mic permission before starting model download

authored and
surt91
committed
docs(04-02): update summary with mic-check-before-download fix

authored and
surt91
committed
docs(phase-04): add verification report

authored and
surt91
committed
docs(phase-04): complete phase execution

authored and
surt91
committed
docs(05): capture phase context

authored and
surt91
committed
docs(state): record phase 5 context session

authored and
surt91
committed
docs(05): add UI design contract for polish & refinement phase

authored and
surt91
committed
docs(05): UI design contract approved

authored and
surt91
committed
docs(phase-05): research phase domain for polish & refinement

authored and
surt91
committed
docs(05): create phase 5 plans for polish & refinement

authored and
surt91
committed
docs(05): create phase plan

authored and
surt91
committed
feat(frontend): add silence detection, elapsed time tracking, and i18n keys

ccthmanthey
authored and
surt91
committed
feat(frontend): add RecordingTimer, PrivacyBadge components and ChatInput integration

ccthmanthey
authored and
surt91
committed
docs(05-01): complete local transcription polish features plan

ccthmanthey
authored and
surt91
committed
docs(phase-05): update tracking after wave 1

authored and
surt91
committed
test(frontend): add Phase 5 feature tests for RecordingTimer, PrivacyBadge, silence detection, and elapsed time

ccthmanthey
authored and
surt91
committed
docs(05-02): complete Phase 5 feature test coverage plan

ccthmanthey
authored and
surt91
committed
fix(frontend): fix auto-stop at 2min not clearing interval and missing onstop handler

authored and
surt91
committed
docs(phase-05): update tracking after wave 2

authored and
surt91
committed
docs(phase-05): complete phase execution

authored and
surt91
committed
docs(phase-01): update Nyquist validation to compliant

authored and
surt91
committed
docs(phase-04): update Nyquist validation to compliant

authored and
surt91
committed
docs(phase-05): update Nyquist validation to compliant

ccthmanthey
authored and
surt91
committed
Milestone 1 Audit

ccthmanthey
authored and
surt91
committed
docs(06): capture phase context

authored and
surt91
committed
docs(state): record phase 6 context session

authored and
surt91
committed
docs(06): create phase 6 plans for tech debt and documentation cleanup

authored and
surt91
committed
docs(06): create phase plan

authored and
surt91
committed
style(06-01): remove planning references and fix lint violations in local transcription files

ccthmanthey
authored and
surt91
committed
docs(06-01): add JSDoc to exported types and component props in local transcription modules

ccthmanthey
authored and
surt91
committed
docs(06-01): complete local transcription code cleanup plan

ccthmanthey
authored and
surt91
committed
docs(06-02): update PROJECT.md model references from whisper-base to whisper-small q8

ccthmanthey
authored and
surt91
committed
docs(06-02): update REQUIREMENTS.md model references from whisper-base to whisper-small q8

ccthmanthey
authored and
surt91
committed
docs(06-02): complete documentation model reference alignment plan

ccthmanthey
authored and
surt91
committed
docs(phase-06): update tracking after wave 1

ccthmanthey
authored and
surt91
committed
docs(06): add code review report

ccthmanthey
authored and
surt91
committed
docs(phase-06): complete phase execution

ccthmanthey
authored and
surt91
committed
fix(06): CR-01 add null guard for workerRef in transcription send

authored and
surt91
committed
fix(06): CR-02 resolve promise when MediaRecorder already inactive

authored and
surt91
committed
fix(06): WR-01 add zero-length guard in computeRMS

authored and
surt91
committed
fix(06): WR-02 add null guard before worker postMessage in startRecording

authored and
surt91
committed
fix(06): WR-03 clamp warning threshold to zero in RecordingTimer

authored and
surt91
committed
fix(06): WR-04 stop MediaRecorder before cleanup on unmount

authored and
surt91
committed
docs(06): update REVIEW.md status to fixed

authored and
surt91
committed
style(06): fix prettier formatting in CR-01 postMessage call

authored and
surt91
committed
chore: archive v1.0 milestone files

authored and
surt91
committed
chore: remove REQUIREMENTS.md for v1.0 milestone

authored and
surt91
committed
chore: archive v1.0 phase directories and write retrospective

authored and
surt91
committed
fix: replace sharp by a stub
surt91
committed
style: fix linter issues
surt91
committed
fix: knip should ignore stubs
surt91
committed