Thirdeye GitHub

DrishtiGuide for Android

See with
sound.

Point your phone at the world around you. Press Volume Up and hear what’s in front of you, in Malayalam.

Set up the app

For blind and low-vision people. Built in Kerala.

Button finderInteractive example
An ivory TV remote on a yellow worktop. Its power button sits above the number pad, and mute is on the bottom row.
Find

താഴത്തെ വരിയിൽ ഇടതുവശത്താണ് മ്യൂട്ട് ബട്ടൺ.

Mute is on the left of the bottom row.

One familiar
volume key.

Keep your thumb on the side of the phone. The same button lets you look, ask, or interrupt.

Tap to look

Press Volume Up once. DrishtiGuide takes a photo and describes the scene aloud.

Hold to ask

Hold Volume Up while you ask a question in Malayalam, English, or Hindi. Release it to send your question with the photo.

Press to interrupt

Press Volume Up during a reply to stop playback. Use that same press to start your next request.

The DrishtiGuide Android app speaking a Malayalam reply, with the microphone control and setup checklist.
DrishtiGuide on Android

Set up your
third eye.

You’ll need an Android phone, a computer, and a Sarvam API key.

  1. Start the server

    Configure the API key and phone token on your computer, then run ./run.sh.

    Server setup guide
  2. Install the Android app

    Build the APK, install it on your phone, and enable the Volume Up accessibility service.

    Android build and install
  3. Pair and listen

    Open /pair on the computer and scan its QR code with the phone. Start the service and try a quick press.