loading...

A speech therapy game, powered by Twilio Video

scott113341 profile image Scott Hardy ・2 min read

What I built

Category Submission: COVID-19 Communications

Memory is a game that Speech-Language Pathologists (SLPs) can use to facilitate therapy over video and voice chat. COVID-19 has eliminated most in-person speech therapy, which tends to take place in schools and clinics. Many SLPs choose to use games as a pretense for therapy for younger patients, but these games need to meet four requirements:

  1. Video and voice chat to facilitate the therapy
  2. A visual game interface
  3. SLP controls the flow of the game to encourage practice
  4. Strong security and privacy

Currently, there are not many options available for SLPs that satisfy all of these requirements... until now!

Demo Link

https://memory.slpgames.com

This project is a simple memory matching game. Before the therapy session, the SLP chooses an appropriate number of cards, and then selects one or more articulation decks:

image

Then, the SLP chooses particular words to use in the game, using their experience to select which words would be best for the person to practice:

image

Finally, two links are generated: one for the SLP, and one for the client. These can be added to a calendar invite or sent in an email ahead of the therapy session.

When the therapy session starts, both the SLP and client join the session via their respective links. The Twilio Video SDK is used to open video, audio, and data channels between the browsers, and the game/therapy can commence:

image

The SLP controls the flow of the game. A young student might select two cards, and then be asked to use both words in a sentence. The SLP controls when the student can take their next turn, ensuring that there is a good balance between gameplay and therapy. The above screenshot is what the SLP sees; the student has no controls available in the bottom right quadrant.

Link to Code

https://github.com/scott113341/slp-memory

How I built it

The project is built using:

Additional Resources/Info

Discussion

markdown guide