DEV Community πŸ‘©β€πŸ’»πŸ‘¨β€πŸ’»

Cover image for Voice Collab Deepgram - Let's harness the power of voice πŸ—£πŸ‘©β€πŸ’»
Santhosh Kumar D
Santhosh Kumar D

Posted on

Voice Collab Deepgram - Let's harness the power of voice πŸ—£πŸ‘©β€πŸ’»

There is so much you can do with your voice but you need the right tools to make it happen as you like, this is where Deepgram comes into play. You get Real-Time speech-to-text translation.

Overview of My Submission

Voice Collab Deepgram is a VS Code extension that Lets you harness the power of voice to collaborate and interact with your code and the people you work with. Often as a software developer, you might feel like you're alone (at least I feel that way when I work on hackathon projects or working on something intense) so this extension not only gets the voice input but also talks with you. For every action phrase that it triggered there is voice feedback so it makes the experience more humanly.

Click here to get the extension from VS Code marketplace or type voice collab deepgram in your VS Code extension explorer

Submission Category: Wacky Wildcards

🎬 YouTube - Live Demo

πŸ’» GitHub Repo

GitHub logo Santhoshkumard11 / Voice-Collab-Deepgram

Let's harness the power of voice to collaborate and interact with your code and the people you work with

Voice Collab Deepgram πŸ”Š πŸ‘¨β€πŸ’»πŸ‘©β€πŸ’» 🦻


Build Status License: MIT

Let's harness the power of voice to collaborate and interact with your code and the people you work with

GIF

πŸ”₯ What it can do? (everything with just voice)

  • β–Ά Trigger your Azure DevOps pipeline build
  • πŸ“ž Call a person on Microsoft Teams
  • πŸ—£ Open Microsoft Teams Chat of a person
  • πŸ“© Open Outlook of a person
  • πŸ” Get total pipeline runs
  • πŸ˜… Crack a programmer joke
  • πŸ“ Tell a funny programmer story
  • πŸ€– Chat with Sandy (Powered By OpenAI's GPT-3 model) - Optional
  • πŸ‘Ύ Generate code (Powered by OpenAI's Codex model) - Optional
  • πŸ”’ Lock Screen
  • More Coming soon!

βš™ Setup the environment - Windows

  • Requires - Python 3.7 and above
  • Requires - node ^12
  • Once you install the extension, hit Ctrl+r to open Run and type %USERPROFILE%\.vscode\extensions
  • Search for sandy-codes-py voice collab extension
  • Open a Powershell/command prompt inside the extension…

Architecture Diagram

Architecture Diagram

πŸ”₯ What it can do? (everything with just voice)

  • β–Ά Trigger your Azure DevOps pipeline build
  • πŸ“ž Call a person on Microsoft Teams
  • πŸ—£ Open Microsoft Teams Chat of a person
  • πŸ“© Open Outlook of a person
  • πŸ” Get total pipeline runs
  • πŸ˜… Crack a programmer joke
  • πŸ“ Tell a funny programmer story
  • πŸ”’ Lock Screen
  • πŸ€– Chat with Sandy (Powered By OpenAI's GPT-3 model) - Only if you have the Beta access
  • πŸ‘Ύ Generate code (Powered by OpenAI's Codex model) - Only if you have the Beta access
  • More Coming soon!

🦾 Few of the commands you can use

Description Trigger phrases
Triggering Azure DevOps pipeline say - start build or trigger pipeline build
Create the requirements.txt file say - create requirements.txt or create requirements file
Get all Azure DevOps pipeline runs count say - get total pipeline runs
Call someone on Microsoft Teams say - call megan (this name could any name from MSFT_ACCOUNT_NAME_LIST list in _constants.py file)
Email someone on Outlook say - email megan
Open up someone's Microsoft Teams Chat say - open megan's chat
Speak out 5 commands you can use say - show help or help or what are the commands I can use
Speak out all the commands you can use say - help more or list all the commands I can use
Push the code to remote say - git push or push code (still in progress)
Commit code and lock the screen say - taking a break or break time
Lock the user screen say - lock screen
Crack a random programmer joke say - crack a joke or joke about programmers or make me feel better
Narrate a random programmer story say - tell a story or story time
Chat with Sandy (OpenAI API Key required) say - hey sandy or sandy and then say the phrase you wanna ask Example: Am I the best programmer in the world?
Generate code (OpenAI API Key required) say - hey codex or codex and then say what you want Example: Create a Python class with name Employee, Create a Python dictionary with country and it's capitals

Conclusion

This is a developer-friendly VS Code extension that can be expanded with a bit of work. It's more focused on developers who need things to be done with voice. Just turn it on and enjoy the conversation while you work.

Detailed instructions can be found on the repo's README.md file.

My Specs - Tested

  • Python 3.7
  • Deepgram Python SDK
  • HP Omen 15 (2018)
  • 16 GB RAM DDR4
  • Intel Core i7-8750H @2.20 GHz
  • GTX 1060 - 6 GB GDDR5
sandy_codes_py image

Let's connect

LinkedIn - 10K Fam

Instagram

Twitter

Top comments (0)

🌚 Life is too short to browse without dark mode