Control your computer with just your hands.

• Hand gesture recognition for mouse control
• Two modes: GUI window or background operation
• ASL recognition model (American Sign Language) support
• Multi-monitor support
• Standalone executables - no Python installation required

• Windows 10/11
• Webcam
• For Python users: Python 3.8-3.11

1. Download the .exe file from the latest release on GitHub Releases
2. Run hand-tracking.exe for GUI mode or hand-tracking-no-window.exe for background mode

git clone https://github.com/Hawk3388/hand-tracking.git

cd hand-tracking
pip install -r requirements.txt
python src/hand-tracking.py            # GUI mode
python src/hand-tracking-no-window.py  # Background mode

pip install pyinstaller==6.12.0
python src/build_exe.pyy

This creates two executables in the dist/ folder.

• Mouse Control: Move your hand to control the cursor
• Click: Make a fist to click
• Mode Switch: Thumb + Middle finger to toggle between mouse and ASL modes
• Multi-monitor: Move hand to screen edges to switch monitors

• Mouse Mode: Hand movements control cursor, fist = click
• ASL Mode: Recognizes American Sign Language gestures
• Exit: Press 'q' in GUI mode or Ctrl+C in console mode

Special thanks to:

• ASL Now Fingerspelling Dataset for the ASL training data
• MediaPipe by Google for the hand tracking model

MIT License - see LICENSE file