Let’s talk
← All work

Hackathon build · Accessibility · Hackathon

Sign Language AR Glasses

Gesture and alphabet models read Indian Sign Language from a camera and show the translated words as live captions inside smart glasses.

Sign Language AR Glasses, Accessibility · Hackathon

Why I built it

Most people can’t read sign language, so deaf signers are left out of everyday conversations. Captions in the listener’s glasses close that gap without an interpreter.

How it works

A camera reads Indian Sign Language: MediaPipe tracks the hands, and gesture and alphabet models turn the signs into words. The words appear as live captions inside smart glasses worn by the listener, and can also be spoken aloud with text-to-speech.