ASLtoTTS

ASL-Interpreter-demo.mp4

Full-stack web application that utilizes the user's webcam to interpret American Sign Language (ASL) gestures. It continuously checks the webcam feed to recognize hand gestures and analyze the landmark positioning on the person's hand to determine the corresponding ASL letter. The interpreted letter is then displayed in a textbox using Text to Speech for accessibility.

Features:

• Real-time hand gesture recognition using the webcam
• Analysis of landmark positioning for accurate ASL letter determination
• Output displayed in a textbox with Text to Speech functionality
• Users have the option to train the model for improved accuracy

Tech Stack

• Frontend: React
• Backend: Python)
• Machine Learning: TensorFlow, OpenCV

Getting Started:

To run locally we must run the backend script and frontend seperately each in a different powershell tab

1. Clone this repository

git clone https://github.com/georgge293/ASL-Interpreter.git

2. Run backend script

cd pythonScripts
python main.py

3. Run Frontend react app

cd frontend
npm install
npm start