ISL Translator
Real-time recognition of Indian Sign Language alphabet signs from a webcam, shown as on-screen text.
- Python
- TensorFlow
- ResNet50
- OpenCV
How it works
- Problem
Bridge part of the communication gap for Deaf and hard-of-hearing people by translating static ISL alphabet signs into text as they are made.
- Approach
- Transfer learning on ResNet50 (ImageNet weights, frozen base) with a small custom classification head.
- Around 51,000 images: a public Kaggle ISL alphabet dataset plus roughly 800 self-collected images per letter.
- Augmentation (rotation, flips, zoom) and regularisation (L2, dropout, early stopping).
- An OpenCV pipeline that classifies webcam frames live.
- Outcome
About 96.4% test accuracy. The most common confusions were J and K, U and V, and C, I and L. Static signs only, and sensitive to lighting and background.
- Context
BSc final-year project, University of Hertfordshire





