Transcription extension v2#173
Open
jspada200 wants to merge 8 commits into
Open
Conversation
# Summary This commit introduces a new transcription route for the DNA browser extension, allowing it to capture Google Meet audio and stream transcripts directly into the DNA system via a WebSocket. The implementation includes: - A new `ExtensionTranscriptionProvider` to handle transcripts from the browser extension. - WebSocket endpoints for health checks and transcript ingestion. - Updates to the `bootstrap.sh` script to include instructions for setting up the extension. - Documentation enhancements detailing the new transcription pipeline and configuration options. - Frontend updates to integrate the extension's functionality, including UI components for managing the extension's connection status. ## Testing - [x] Changes tested locally - [x] All relevant automated tests run successfully - [x] Verified no existing workflows are broken ## How I Tested Tested the integration of the browser extension with the backend and verified the transcript ingestion process. Signed-off-by: James Spadafora <spadjv@gmail.com>
Signed-off-by: James Spadafora <spadjv@gmail.com>
Signed-off-by: James Spadafora <spadjv@gmail.com>
Signed-off-by: James Spadafora <spadjv@gmail.com>
jspada200
changed the title
…r refactor. Signed-off-by: James Spadafora <spadjv@gmail.com>
jspada200
changed the title
This commit introduces a shared key mechanism to enhance the security of the transcription feature in the DNA browser extension. Key changes include: - Added environment variable `DNA_EXTENSION_KEY` to the backend for validating the key sent from the extension. - Implemented key validation logic in the backend to ensure only authorized extensions can connect. - Updated the frontend to allow users to input and save the DNA key, which is then used for activation. - Enhanced WebSocket connection handling to close connections if the key is missing or invalid. - Added tests to verify the key validation process and its integration with the transcription workflow. This change aims to prevent unauthorized access to the transcription service and ensure a secure connection between the extension and the backend. Signed-off-by: James Spadafora <spadjv@gmail.com>
This commit updates the DNA Chrome extension's manifest and frontend components to improve connectivity and user experience. Key changes include: - Added support for `*://localhost/*` and `*://127.0.0.1/*` in the manifest to allow connections from any scheme. - Updated the README to reflect the new match patterns for local development. - Introduced a status message in the TranscriptionMenu component to inform users when the DNA extension is being searched for. - Modified the useTranscriptionExtension hook to periodically check the installation state of the extension, improving responsiveness in the UI. These changes aim to streamline the integration process and provide clearer feedback to users regarding the extension's status. Signed-off-by: James Spadafora <spadjv@gmail.com>
Signed-off-by: James Spadafora <spadjv@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This change adds a DNA specific chrome extension for transcription. It is designed to work with whisperlive and DNA.
First from the DNA app, the user launches the transcription. This sends all the details needed to the chrome extension. Next the user give permission to the extension to transcribe the meet tab. Segments are then captured, transcribed with whisperlive, and sent to DNA backend.
Testing
How I Tested
Transcribed my own call
TODO