Golive

Author: KSemenenko

AGENTS.md

@@ -324,6 +324,7 @@ Repo-specific design rules:
 - Go Live chrome MUST stay operational and generic; do not surface the loaded script title or script preview subtitle in the Go Live header/session bar just because a script is open.
 - Go Live back navigation MUST return to the actual previous in-app screen when known, and only fall back to library when there is no valid in-app return target; it must never hardcode teleprompter as the back target.
 - Go Live local recording MUST capture the same composed program feed that the active live/record session publishes; recording a black frame or a different source than the current program feed is a regression.
+- Go Live local recording artifacts MUST contain both decodable video and decodable audio from the real program feed, and their saved resolution/quality must match the active source or chosen output profile instead of silently degrading to a lower-quality fallback.
 - Go Live recording status and runtime panels MUST show the real recording details the browser runtime knows, including the resolved output profile and live session/file telemetry when available; blank recording metadata during an active local recording is a regression.
 - Go Live audio meters MUST show real browser audio activity for microphone, program, and recording paths; static placeholder bars or seeded fake levels in the Audio tab are regressions.
 - Go Live MUST have one active browser-side broadcast spine per setup: choose LiveKit or VDO.Ninja for the upstream transport, but do not run both as the same session's primary publish path at once.

README.md

@@ -31,7 +31,7 @@ Architecture map: [docs/Architecture.md](docs/Architecture.md)
 - TPS-focused editor for prompt-ready scripts
 - RSVP/Learn mode with ORP-style word rendering
 - browser-side media scene, device setup, and live preview
-- Go Live runtime with LiveKit and VDO.Ninja outputs
+- Go Live runtime with VDO.Ninja-first standalone output plus optional LiveKit mode
 - browser-local document and settings storage
 - browser-realistic acceptance tests through Playwright
 

docs/Features/GoLiveRuntime.md

@@ -15,7 +15,7 @@ The current page layout is a production-style studio surface:
 - right rail for the current live preview plus a larger stream, audio, and runtime panel that can comfortably show real output telemetry, metadata, and mix controls
 - source-card `ON AIR` badges and the preview red live dot only turn on when recording or streaming is actually active; idle routing and armed sources stay visually non-live
 - full-program mode collapses both side rails so the center canvas follows the design's focused monitor state
-- destination cards are built from persisted local outputs plus a dynamic browser-stored `ExternalDestinations` list; seeded fake provider rows are forbidden
+- destination cards are built only from the persisted browser-stored `ExternalDestinations` list; local recording is controlled from `REC` plus runtime metadata, not rendered as a fake destination row
 
 The runtime now owns real browser media outputs for the composed program scene and the current audio bus:
 
@@ -24,19 +24,22 @@ The runtime now owns real browser media outputs for the composed program scene a
 - `Go Live` builds one browser-side program stream from the scene camera cards by drawing the selected primary camera full-frame and then layering additional included cameras as positioned overlays on a canvas
 - the scene `AudioBus` is mixed into one program audio track through `AudioContext`, delay, and gain nodes before the final program stream is published or recorded
 - OBS browser output stays browser-only and exposes the composed program audio inside an OBS Browser Source environment
-- LiveKit publishing uses the vendored browser SDK and publishes real composed `MediaStreamTrack` objects for video and audio
+- `VDO.Ninja` publishing uses the vendored official browser SDK and publishes the same composed `MediaStream` that powers preview, recording, and OBS
+- `LiveKit` publishing remains available only as an explicit optional managed-transport mode
 - local recording uses the browser `MediaRecorder` API against the same composed program stream and prefers `showSaveFilePicker()` for real local file writing when the browser allows it, with download fallback otherwise
+- saved local recording artifacts must decode into visible program video plus audible program audio; a black frame or silent file is a runtime regression even if metadata looks populated
 - recording export profiles are honest browser probes only: the runtime checks `MediaRecorder.isTypeSupported()` and `MediaCapabilities.encodingInfo()` before choosing the resolved MIME type and falls back to a supported browser codec/container when the requested profile is unavailable
 - stream start, stop, recording start, recording stop, and source switching update the active browser output session instead of only flipping local UI state
 - the session timer and right-rail `Status` / `Runtime` cards are driven from live session/runtime state, not hardcoded demo telemetry
 - active local recording surfaces resolved runtime metadata in the right rail, including the recording profile, save mode, and live captured file size when the browser exposes those details
 
-Relay-only destinations stay configuration surfaces:
+Downstream destinations stay browser-honest configuration surfaces:
 
-- YouTube, Twitch, custom RTMP, and similar RTMP-style targets still persist credentials and routing in browser storage
+- YouTube, Twitch, custom RTMP, and similar targets still persist credentials and routing in browser storage
 - `Go Live` only exposes quick arm/disarm toggles and readiness summaries for those targets
 - detailed destination credentials, ingest URLs, and provider-specific configuration live in `Settings`
-- these targets do not publish directly from the browser runtime; they require an external relay or ingest layer outside this standalone WASM app, and `Go Live` must not mark the session live unless a direct browser live output actually starts
+- direct browser publish is allowed only when the active standalone spine really supports it, with `VDO.Ninja` treated as the primary path for browser-driven `YouTube` / `Twitch` workflows
+- custom RTMP remains visually constrained unless a real browser-compatible publish path is confirmed
 
 ## Broadcast Spine Decision
 
@@ -54,7 +57,8 @@ Current implementation focus:
 
 - browser-local recording from the composed program feed
 - OBS browser output
-- LiveKit publishing in the current code path
+- `VDO.Ninja` publishing in the current code path
+- `LiveKit` kept only as an explicit optional managed mode
 - no shipped universal browser-only path yet for every final platform target
 
 Target rollout after this architecture pass:
@@ -118,13 +122,13 @@ sequenceDiagram
     Settings->>Studio: Persist device preferences
     Settings->>Scene: Persist scene cameras and audio bus
     User->>Settings: Configure the active spine and browser-compatible publish targets
-    Settings->>Studio: Persist local outputs and external destination list
+    Settings->>Studio: Persist external destination list and recording/export preferences
     User->>GoLive: Open Go Live
     GoLive->>Studio: Load live routing settings
     GoLive->>Scene: Load current scene sources
     GoLive->>Sources: Render real scene cameras and mic status
     GoLive->>Preview: Mount the current on-air scene camera
-    GoLive->>Sidebar: Summarize persisted destination readiness
+    GoLive->>Sidebar: Summarize persisted external destination readiness
     User->>GoLive: Arm one or more destinations
     GoLive->>Studio: Persist output targets
     User->>Sources: Select a different scene camera
@@ -219,7 +223,7 @@ flowchart LR
     Vdo["VDO.Ninja publish / WHIP"]
     LiveKit["LiveKit publishTrack(...)"]
     Targets["Browser-compatible publish targets"]
-    Platforms["YouTube / Twitch / RTMP<br/>constrained unless browser path exists"]
+    Platforms["YouTube / Twitch / RTMP<br/>only when the active spine exposes a real browser path"]
     Obs["OBS browser audio bridge"]
 
     Scene --> Factory
@@ -248,7 +252,7 @@ flowchart LR
 - `Settings` must expose a visible CTA into `Go Live` so device setup and live routing stay discoverable as separate flows.
 - the shared header shell must keep `Go Live` reachable from every non-`Go Live` routed page because it is a primary studio action
 - `Go Live` may arm local recording and downstream relay targets at the same time, but only one upstream browser transport spine may be active for a session.
-- hardcoded destination instances are forbidden; the external destination list must come from persisted browser settings and may contain zero, one, or many platform entries
+- hardcoded destination instances are forbidden; the right-rail destination list must come from persisted external destinations only and may contain zero, one, or many platform entries
 - `Go Live` must reuse the browser-composed scene and not invent a separate media graph.
 - `Go Live` must auto-seed the first available browser camera into the scene when the scene is empty and devices are available.
 - `Go Live` must show the selected program source in the center monitor and the currently on-air source in the right preview rail until the operator explicitly takes the selected source live.
@@ -262,13 +266,15 @@ flowchart LR
 - `VirtualCamera` mode normalizes to OBS armed by default, so browser sessions keep the legacy desktop-capture workflow unless the user explicitly turns OBS off
 - Camera source inclusion is persisted through `MediaSceneState`.
 - Destination credentials and endpoints are persisted only in browser storage for this standalone runtime.
+- `VDO.Ninja` browser publishing must use the vendored official SDK shipped in the repo, not a CDN copy.
 - LiveKit browser publishing must use the vendored SDK shipped in the repo, not a CDN copy.
 - `VDO.Ninja` is the default production upstream spine for the strict standalone browser mode; `LiveKit` is reserved for explicit optional managed-transport modes and must not quietly become a second co-equal default publish path.
 - OBS browser integration must stay a thin browser bridge; no server relay or backend media graph is introduced.
-- local recording must stay browser-local and use the same active program media session as OBS / LiveKit so record and source switching stay in sync
+- local recording must stay browser-local and use the same active program media session as OBS / `VDO.Ninja` / optional `LiveKit` so record and source switching stay in sync
 - local recording must prefer real local file writing through the File System Access API when the browser exposes it, but must fall back to browser download instead of pretending save-to-disk is universally available
 - recording codec/container export must never advertise unsupported browser encoders as if they are guaranteed; the runtime must probe support and choose a real fallback profile
 - local recording metadata shown in `Go Live` must come from browser runtime state, including honest file-size/save-mode/profile details when available, instead of placeholder labels or blank cards
+- browser acceptance for local recording must verify the saved artifact itself, not only the in-page runtime metadata, so regressions such as black video or silent audio cannot hide behind populated telemetry
 - the `Audio` tab must project real browser telemetry: the microphone row comes from a direct browser microphone monitor, while `Program` and `Recording` come from the mixed program audio feed and must fall back to idle instead of seeded percentages when no signal is active
 - right-rail telemetry must never show fake packet-loss, jitter, ping, or upload metrics when the browser runtime does not actually own those measurements
 - downstream platforms such as YouTube and Twitch may be shown as first-class live-publish targets when the chosen VDO-driven standalone path supports them; custom RTMP must stay visibly constrained unless a real browser-compatible path is confirmed

docs/Features/VendoredStreamingSdkReleases.md

@@ -6,8 +6,9 @@
 
 - `livekit/client-sdk-js`
 - `steveseguin/vdo.ninja`
+- `steveseguin/ninjasdk`
 
-The repo pins both SDKs to exact GitHub release tags and exact GitHub release URLs. The vendored files live under `src/PrompterOne.Shared/wwwroot/vendor/` so the browser runtime does not depend on floating CDN or `latest` endpoints.
+The repo pins these runtime artifacts to exact GitHub release tags and exact GitHub release URLs. The vendored files live under `src/PrompterOne.Shared/wwwroot/vendor/` so the browser runtime does not depend on floating CDN or `latest` endpoints.
 
 ## Source Of Truth
 
@@ -20,6 +21,7 @@ The repo pins both SDKs to exact GitHub release tags and exact GitHub release UR
 
 - LiveKit Client SDK JS: `v2.18.0`
 - VDO.Ninja: `v29.0`
+- VDO.Ninja SDK: `v1.3.18`
 
 ## Flow
 
@@ -51,4 +53,5 @@ flowchart LR
 ## Notes
 
 - LiveKit does not ship the built browser bundle as a GitHub release asset in the current release format, so the sync flow builds the exact pinned release tag from the tagged source tarball and copies only the resulting browser artifacts into the repo.
-- VDO.Ninja is vendored as a runtime JS tree from the exact pinned release source tarball because its browser runtime spans multiple JS entrypoints and runtime-loaded dependencies.
+- VDO.Ninja is vendored as a runtime JS tree from the exact pinned release source tarball because its broader browser runtime spans multiple JS entrypoints and runtime-loaded dependencies.
+- The official standalone browser publishing SDK comes from `steveseguin/ninjasdk` and is vendored from exact pinned GitHub release assets plus the matching license files from the release tarball.

scripts/vendored_streaming_sdks.py

@@ -155,6 +155,23 @@ def sync_vdo_ninja(sdk: dict) -> None:
             copy_js_tree(source_root / runtime_directory, vendor_directory / runtime_directory)
 
 
+def sync_release_assets_with_license_tarball(sdk: dict) -> None:
+    vendor_directory = REPO_ROOT / sdk["vendorDirectory"]
+    reset_directory(vendor_directory)
+
+    with tempfile.TemporaryDirectory(prefix=f"{sdk['id']}-") as temp_dir_name:
+        temp_dir = Path(temp_dir_name)
+        archive_path = temp_dir / "release.tar.gz"
+        download_to(sdk["sourceTarballUrl"], archive_path)
+        source_root = extract_tarball(archive_path, temp_dir)
+
+        for license_file in sdk.get("licenseFiles", []):
+            copy_file(source_root / license_file, vendor_directory / Path(license_file).name)
+
+        for asset in sdk.get("assets", []):
+            download_to(asset["url"], vendor_directory / asset["name"])
+
+
 def sync_sdk(sdk: dict) -> None:
     strategy = sdk["syncStrategy"]
     print(f"Syncing {sdk['id']} from {sdk['releaseTag']} using {strategy}")
@@ -167,6 +184,10 @@ def sync_sdk(sdk: dict) -> None:
         sync_vdo_ninja(sdk)
         return
 
+    if strategy == "release-assets-with-license-tarball":
+        sync_release_assets_with_license_tarball(sdk)
+        return
+
     raise SystemExit(f"Unsupported sync strategy: {strategy}")
 
 
@@ -187,6 +208,11 @@ def verify_sdk(sdk: dict) -> list[str]:
         if not (vendor_directory / artifact_name).exists():
             errors.append(f"{sdk['id']}: missing artifact {artifact_name}")
 
+    for asset in sdk.get("assets", []):
+        asset_name = asset["name"]
+        if not (vendor_directory / asset_name).exists():
+            errors.append(f"{sdk['id']}: missing asset {asset_name}")
+
     for root_file in sdk.get("rootFiles", []):
         if not (vendor_directory / root_file).exists():
             errors.append(f"{sdk['id']}: missing root file {root_file}")

src/PrompterOne.App/wwwroot/index.html

@@ -42,6 +42,8 @@ <h2 id="app-shell-error-title">PrompterOne hit a shell error</h2>
     <script src="_content/PrompterOne.Shared/media/go-live-media-compositor.js"></script>
     <script src="_content/PrompterOne.Shared/media/go-live-output-support.js"></script>
     <script src="_content/PrompterOne.Shared/vendor/livekit-client/v2.18.0/livekit-client.umd.js"></script>
+    <script src="_content/PrompterOne.Shared/vendor/vdo-ninja-sdk/v1.3.18/vdoninja-sdk.js"></script>
+    <script src="_content/PrompterOne.Shared/media/go-live-output-vdo-ninja.js"></script>
     <script src="_content/PrompterOne.Shared/media/go-live-output.js"></script>
     <script src="_content/PrompterOne.Shared/editor/editor-source-panel.js"></script>
     <script src="_content/PrompterOne.Shared/learn/learn-rsvp-layout.js"></script>

src/PrompterOne.Shared/GoLive/Models/GoLiveText.cs

@@ -109,7 +109,9 @@ public static class Surface
         public const string RuntimeEngineLiveKitValue = "LiveKit";
         public const string RuntimeEngineObsBrowserValue = "OBS browser";
         public const string RuntimeEngineObsLiveKitValue = "OBS + LiveKit";
+        public const string RuntimeEngineObsVdoNinjaValue = "OBS + VDO.Ninja";
         public const string RuntimeEngineRecorderValue = "Recorder";
+        public const string RuntimeEngineVdoNinjaValue = "VDO.Ninja";
         public const string SceneSlidesId = "scene-slides";
         public const string SceneSlidesLabel = "Slides";
         public const string SecondarySceneId = "scene-secondary";