DEV Community

Dilek Karasoy for Picovoice

Posted on

Stuck with Java Speech API?

If you find adding voice inputs to a Java application difficult, you're not alone. JDK's Speech API relies on outdated products and third-party cloud providers.

But we have a good news, on day 37, we'll add custom voice commands, like Jarvis, turn off the lights, with Picovoice Java SDK.

The Picovoice SDK combines Porcupine Wake Word and Rhino Speech-to-Intent engines. Wake words like Jarvis, powered by Porcupine and follow-up commands like turn off the lights powered by Rhino.

Let's get started

  1. Get the latest version of the SDK from Maven Central Repository:
Enter fullscreen mode Exit fullscreen mode
  1. Design and train models on the Picovoice Platform While developers can train and adapt custom voice AI models on the Picovoice Console. However, you can use pre-trained ones, too! For this tutorial, we'll use the pre-trained [Jarvis]( wake word and the [Smart Lighting]( context, which understands commands that change the color/state of lights.
  2. Get an AccessKey Picovoice If you still haven't, create an account on the Picovoice Console for free and grab your AccessKey.
  3. Initialize the Picovoice Platform
import ai.picovoice.picovoice.*;

final String accessKey = "..."; // your Picovoice AccessKey
final String keywordPath = "res/path/to/jarvis.ppn";
final String contextPath = "res/path/to/smart_lighting.rhn";

PicovoiceWakeWordCallback wakeWordCallback = () -> { 
  System.out.println("Wake word detected!");
  // let user know wake word was detected
PicovoiceInferenceCallback inferenceCallback = inference -> { 
  if (inference.getIsUnderstood()) {
    final String intent = inference.getIntent();
    final Map<String, String> slots = inference.getSlots();
    // use intent and slots to trigger action

Picovoice picovoice = new Picovoice.Builder()
Enter fullscreen mode Exit fullscreen mode

Do not forget to replace AccessKey, KeywordPath, and ContextPath placeholders. Copy your AccessKey from Picovoice Console. The path for the downloaded Porcupine keyword and Rhino Context files, depends on where you save them when you download.

  1. Read and Process Microphone Audio
import javax.sound.sampled.*;

// get default audio capture device
AudioFormat format = new AudioFormat(16000f, 16, 1, true, false);
DataLine.Info dataLineInfo = new DataLine.Info(TargetDataLine.class, format);
TargetDataLine micDataLine;
try {
    micDataLine = (TargetDataLine) AudioSystem.getLine(dataLineInfo);;
} catch (LineUnavailableException e) {
    System.err.println("Failed to get a valid audio capture device.");    

// start audio capture
Enter fullscreen mode Exit fullscreen mode
  1. Create a loop that reads microphone data and passes it to Picovoice:
// buffers for processing audio
short[] picovoiceBuffer = new short[picovoice.getFrameLength()];
ByteBuffer captureBuffer = ByteBuffer.allocate(picovoice.getFrameLength() * 2);

int numBytesRead;
boolean recordingCancelled = false;
while (!recordingCancelled) {

    // read a buffer of audio
    numBytesRead =, 0, captureBuffer.capacity());

    // don't pass to Picovoice if we don't have a full buffer
    if (numBytesRead != picovoice.getFrameLength() * 2) {

    // copy into 16-bit buffer

    // process with picovoice
Enter fullscreen mode Exit fullscreen mode

This tutorial was originally published on Medium

Source Code
Picovoice Java SDK (

Top comments (0)