DEV Community

Cover image for Copilot Voice - You can now TALK with GitHub CopilotX!
Leonardo Montini for This is Learning

Posted on • Edited on • Originally published at leonardomontini.dev

Copilot Voice - You can now TALK with GitHub CopilotX!

I heard about "Hey, GitHub" (now called Copilot Voice) for the first time last November, in a very well presented panel by @blackgirlbytes, (Rizèl Scarlett , Developer Advocate at GitHub) during the presentation of GitHub Universe 2022.

The first impression was like "How cool is that?!". I mean, Copilot is already impressing but controlling it with the voice? Wow!

I immediately went to the website and signed up to the waitlist (you can still do it from here).

What is Hey GitHub?

So, what are we talking about? Using Copilot with your voice? That's a nice summary but it's not all. Hey GitHub comes in the form of a VSCode extension and has many more capabilities accessible with your voice.

There are already a lot of supported features (the team claims there are already over 300) and these are some of them:

  • Write code through Copilot
    • Describe something and see it as a suggestion
    • Change the suggestion before confirming it
  • Navigate through your code
    • Go to a specific line
    • Go to a specific file
    • Select code
    • Add/Delete lines
    • Explain what some lines do
  • Interact with the editor
    • Undo/Redo
    • Save file
    • Use the Search function
    • Open the Quick Pick menu
    • Toggle sidebar and panels (Explorer, Source Control etc.)
    • Zoom in/out
  • Interact with the terminal
    • Open the terminal
    • Paste content from the clipboard

Current state

Considering it's not yet available to everyone (as already mentioned, there's a waitlist) the product is still far from being perfect.

Besides, it's not (yet) intended to be a tool to boost 25x your productvitiy but rather the focus is on developers that may have difficulties using keyboard and mouse.

At the current state, I would say being skilled with shortcuts is still quicker than what Hey GitHub can do, but this doesn't mean it's not an interesting project.

It is still considered as an experiment (early technical preview) so there's no guarantee that it will see the light, but if the technology keeps evolving it could become a game changer.

GitHub Next

Hey GitHub is part of GitHub Next, and if you don't know what it is let me quote their website:

We are a team of researchers and engineers at GitHub, exploring things beyond the adjacent possible. We prototype tools and technologies that will change our craft. We identify new approaches to building healthy, productive software engineering teams.

There are many more projects to discover and if you're curious, you should definitely have a look!

See it in action!

I got the access yesterday and I already took some time to give it a try myself and record some interesting footage.

In the video, you'll see me ~writing~ describing a simple javascript program and doing some interactions with Visual Studio Code with my voice, thanks to Hey GitHub.

Conclusion

What do you think? Is it something you'd like to try? Let me know in the comments!

I personally don't think I'll use it regularly for now. Copilot is already doing great, but I'll keep an eye on the project and I'll be more than happy to keep forwarding feedback and bug reports to the team as I'm already doing.


Thanks for reading this article, I hope you found it interesting!

I recently launched my Discord server to talk about Open Source and Web Development, feel free to join: https://discord.gg/bqwyEa6We6

Do you like my content? You might consider subscribing to my YouTube channel! It means a lot to me ❤️
You can find it here:
YouTube

Feel free to follow me to get notified when new articles are out ;)

Top comments (9)

Collapse
 
blackgirlbytes profile image
Rizèl Scarlett

awesome! I was thinking of doing a YouTube video and blog post too..of myself attempting to code a web app with Hey, GitHub. Love to see that you did it. Just remotivated me to also do it.

And haha ...I was laughing at when you said a few failed attempts later.

Collapse
 
balastrong profile image
Leonardo Montini

Please do it, I'm sure it would be fun! :D

I had to do many attemps because I had to learn how to use the tool first... like, I was trying to use code commands while not in code mode and vice-versa, trying commands like "remove line" while in code mode and without saying "hey github" first.

Seeing someone using it properly could indeed help a lot getting into it :)

Collapse
 
blackgirlbytes profile image
Rizèl Scarlett

LOL I guarantee I'm going to struggle a bit too 😂

Collapse
 
polterguy profile image
Thomas Hansen

Amazing! I'm working on something similar, where you can scrape any website, and create a custom OpenAI model based upon training snippets found by scraping any website out there :)

Collapse
 
balastrong profile image
Leonardo Montini

Wow, looks really interesting!

Collapse
 
polterguy profile image
Thomas Hansen

Thx, the idea is to scrape (any) website, generating fine-tuning data, training your own OpenAI model, resulting in some sort of "expert AI based system" answering questions about your particular topic. You can see a video where I'm demonstrating it below

Collapse
 
drsensor profile image
૮༼⚆︿⚆༽つ

I think the voice recognition command should be triggered by keyboard shortcut rather than voice phrase.

Collapse
 
balastrong profile image
Leonardo Montini

One of the goals is to avoid using the keyboard at all, but indeed having it activated with a single key press might make sense :)

Collapse
 
idabaicai profile image
dabai

AWESOME!