DEV Community

Gajanan Patil
Gajanan Patil

Posted on

Get subtitles for any audio/video being played in browser

Overview of My Submission

Browser extension that streams selected tab's audio to Deepgram's transcription service and displays result on active tab.

This extension will require a Deepgram API key for transcription. Get it from here

Submission Category:

Accessibility Advocates

Link to Code on GitHub

GitHub logo gajananpp / captioner

Get subtiles for any audio/video being played in browser.

Captioner

lint build

Get subtiles/captions for any audio/video being played. Deepgram hackathon submission.

InstallationUsageBuild From SourcePrivacyFAQs

Demo PNG

Installation

This extension is published on chrome web store.

Add from Chrome web store

Usage

This extension will require a Deepgram API key for transcription. Get it from here

Check demo video

Build from source:

git clone https://github.com/gajananpp/captioner.git

cd captioner

npm install

npm run build
Enter fullscreen mode Exit fullscreen mode

This will output extension in dist folder which you can load in your browser by following this steps.

Privacy

The only external api call this extension makes is to wss://api.deepgram.com/v1/listen passing it the audio blobs from selected audio source as payload.

FAQs

Q: With which browsers is this extension compatible ?
This extension will work with chrome and other chromium based browsers like edge, brave etc. and can be tweaked to work with firefox and other browsers.


Q: From where can this extension be installed ?
This…

Additional Resources / Info

FAQs :-

Q: With which browsers is this extension compatible ?
This extension will work with chrome and other chromium based browsers like edge, brave etc. and can be tweaked to work with firefox and other browsers.

Q: From where can this extension be installed ?
This extension is published on chrome web store. Click below to view it in chrome web store or can be built and loaded from source.

Add from Chrome web store

Q: Subtitles are slower than audio/video ?
Since unlike Youtube's auto-generated captions where captions are generated when video is uploaded, here it can't seek audio blobs beforehand(could be possible by checking n/w requests having media type responses) so there is a lag. Lag may get reduced by adjusting the timeslice of AudioRecorder. WIP for reducing lag.

Top comments (4)

Collapse
 
bekahhw profile image
BekahHW

Great job on this!

Collapse
 
gajananpp profile image
Gajanan Patil

Thank you !!! 😀

Collapse
 
unitybuddy profile image
Mr. Unity Buddy

Great project, @gajananpp 🔥

Collapse
 
gajananpp profile image
Gajanan Patil

Thank you !!! 😀