There is so much you can do with your voice but you need the right tools to make it happen as you like, this is where Deepgram comes into play. You get Real-Time speech-to-text translation.
Overview of My Submission
Voice Collab Deepgram is a VS Code extension that Lets you harness the power of voice to collaborate and interact with your code and the people you work with. Often as a software developer, you might feel like you're alone (at least I feel that way when I work on hackathon projects or working on something intense) so this extension not only gets the voice input but also talks with you. For every action phrase that it triggered there is voice feedback so it makes the experience more humanly.
Click here to get the extension from VS Code marketplace or type voice collab deepgram in your VS Code extension explorer
Submission Category: Wacky Wildcards
🎬 YouTube - Live Demo
💻 GitHub Repo
Santhoshkumard11
/
Voice-Collab-Deepgram
Let's harness the power of voice to collaborate and interact with your code and the people you work with
Voice Collab Deepgram 🔊 👨💻👩💻 🦻
Let's harness the power of voice to collaborate and interact with your code and the people you work with
YouTube Demo Video 📺📺
Click here to watch the demo
🔥 What it can do? (everything with just voice)
- ▶ Trigger your Azure DevOps pipeline build
- 📞 Call a person on Microsoft Teams
- 🗣 Open Microsoft Teams Chat of a person
- 📩 Open Outlook of a person
- 🔁 Get total pipeline runs
- 😅 Crack a programmer joke
- 📝 Tell a funny programmer story
- 🤖 Chat with Sandy (Powered By OpenAI's GPT-3 model) - Optional
- 👾 Generate code (Powered by OpenAI's Codex model) - Optional
- 🔒 Lock Screen
- More Coming soon!
⚙ Setup the environment - Windows
- Requires -
Python 3.7 and above - Requires -
node ^12 - Once you install the extension, hit
Ctrl+rto open Run and type%USERPROFILE%\.vscode\extensions - Search for sandy-codes-py voice…
Architecture Diagram
🔥 What it can do? (everything with just voice)
- ▶ Trigger your Azure DevOps pipeline build
- 📞 Call a person on Microsoft Teams
- 🗣 Open Microsoft Teams Chat of a person
- 📩 Open Outlook of a person
- 🔁 Get total pipeline runs
- 😅 Crack a programmer joke
- 📝 Tell a funny programmer story
- 🔒 Lock Screen
- 🤖 Chat with Sandy (Powered By OpenAI's GPT-3 model) - Only if you have the Beta access
- 👾 Generate code (Powered by OpenAI's Codex model) - Only if you have the Beta access
- More Coming soon!
🦾 Few of the commands you can use
| Description | Trigger phrases |
|---|---|
| Triggering Azure DevOps pipeline | say - start build or trigger pipeline build |
| Create the requirements.txt file | say - create requirements.txt or create requirements file |
| Get all Azure DevOps pipeline runs count | say - get total pipeline runs |
| Call someone on Microsoft Teams | say - call megan (this name could any name from MSFT_ACCOUNT_NAME_LIST list in _constants.py file) |
| Email someone on Outlook | say - email megan |
| Open up someone's Microsoft Teams Chat | say - open megan's chat |
| Speak out 5 commands you can use | say - show help or help or what are the commands I can use |
| Speak out all the commands you can use | say - help more or list all the commands I can use |
| Push the code to remote | say - git push or push code (still in progress) |
| Commit code and lock the screen | say - taking a break or break time |
| Lock the user screen | say - lock screen |
| Crack a random programmer joke | say - crack a joke or joke about programmers or make me feel better |
| Narrate a random programmer story | say - tell a story or story time |
| Chat with Sandy (OpenAI API Key required) | say - hey sandy or sandy and then say the phrase you wanna ask Example: Am I the best programmer in the world? |
| Generate code (OpenAI API Key required) | say - hey codex or codex and then say what you want Example: Create a Python class with name Employee, Create a Python dictionary with country and it's capitals |
Conclusion
This is a developer-friendly VS Code extension that can be expanded with a bit of work. It's more focused on developers who need things to be done with voice. Just turn it on and enjoy the conversation while you work.
Detailed instructions can be found on the repo's README.md file.
My Specs - Tested
- Python 3.7
- Deepgram Python SDK
- HP Omen 15 (2018)
- 16 GB RAM DDR4
- Intel Core i7-8750H @2.20 GHz
- GTX 1060 - 6 GB GDDR5
Top comments (0)