Skip to content

An AI ASL Translator Virtual Camera

Notifications You must be signed in to change notification settings

gamerwaves/HandSpeak

Repository files navigation

NOTICE: Python Ver 3.10 & MACOS ONLYONLY

HandSpeak: Real-Time ASL Detection to OBS Virtual Camera via NDI

This project streams ASL hand detection output directly to OBS using NDI and MediaPipe Hands.

🚀 Setup Instructions

1. Clone the Repository

git clone https://github.com/gamerwaves/HandSpeak.git

cd HandSpeak

2. Create a Virtual Environment

python3 -m venv venv

source venv/bin/activate  # On Windows: venv\Scripts\activate

Note:
If you're not using bash, the activation command may vary..


3. Install Dependencies

pip install -r requirements.txt

4. Download and Install OBS Studio


5. Download the DistroAV Plugin

Note:
On Linux, you also need to install ndi-sdk using your distribution's package manager.


6. Run the Detection Script

python main.py

This will start a TKinter window that will start MediaPipe hand tracking and send frames over NDI.


7. Edit NDI Source in OBS

  • In OBS, double-click NDI Source under Sources.
  • Click the small dropdown arrow beside the source name.
  • Select the NDI stream titled ASL-Detection-NDI.

8. Usage

  • You can now use this virtual camera in Zoom, Google Meet, Discord, etc. Use as a regular camera input..

✅ Notes

  • Make sure OBS and the Python script are on the same network (localhost is fine).
  • DistroAV requires the latest OBS version for it to work properly.

🧠 Credits

  • Built with MediaPipe, OpenCV, and NDI.
  • OBS integration via obs-websocket and obs-ndi.
  • README.md by ChatGPT :)

About

An AI ASL Translator Virtual Camera

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages