Translator Voicebot in VRChat 2

What's this?

• Voicebot that implemented speech-to-speech translation in VRChat
  • https://youtu.be/DVAsHKrHV0Q

System

• ASR, Translation: googletrans
  • https://pypi.org/project/googletrans/

• TTS: gtts

  • https://pypi.org/project/gTTS/

• Sound Pipeline

  • application -> speaker -> dialog.py -> mic -> application
  • Direct loop also exists.. (application -> speaker -> mic -> application)

• (TBD) Release the scripts in GitHub

  • Need to clean the codes and write documents..

Prerequisites

• Ubuntu 18.04.5 LTS
• Voice chat application (VRChat for example)

Setup


$ sudo apt install portaudio19-dev pavucontrol python-xlib scrot
$ git clone https://github.com/Lunran/sts.git
$ cd sts
$ python3 -m venv venv
$ . venv/bin/activate
$ pip install --upgrade pip
$ pip install -r requirements.txt


Usage

• Run VRChat
  • Open "Settings", "Audio Volume"
  • Mute "UI/Menu", "World" and "Avatars"
• Run the script
  • refer to "$ python dialog.py -h" for details