Simplify Phone Screening with Twilio and AI Automation

This is a submission for the Twilio Challenge

What I Built

I explored several ideas for this challenge and did some research. Then, I found a LinkedIn post about how recruiters handle phone interviews for screening and the problems they face, like coordinating schedules between recruiters and candidates. Often, these calls are unplanned for the candidates, causing nervousness and a poor first impression. This inspired me to create a product that automates the process using IVR to conduct phone interviews for screening. The product would evaluate the call recordings and provide a summary of the entire conversation to the recruiter.

Flow of the system:

• The recruiter will enter the candidate's details into the system through a form.
• The candidate will receive an SMS notification with a link included in the message.
• When the candidate clicks the link, the system will automatically dial their phone number.
• An IVR call will guide the candidate through the interview and ask the necessary questions.
• The candidate's responses will be recorded and transcribed by the system. AI will then use the transcription to provide context for the call recording.

Future Scopes/Improvements:

• Develop a comprehensive multi-tenant dashboard for recruiters to manage records efficiently.
• Integrate the system with job boards for seamless operation.
• Implement an AI model to evaluate candidates' responses and rank them based on job requirements.

Demo

Walkthrough video

Demo application link

• Application URL is https://ai-interview-call-8568-dev.twil.io/add-candidate.html
• IVR call might not work for you as it is a demo account and only verified phone numbers are allowed.

Github link
https://github.com/bibekkakati/ai-interview-call

Twilio and AI

Let's discuss how I used Twilio and AI in the project.

• Twilio Verify is used to validate the candidate's phone number and provide an internationally formatted result.
• Twilio Programmable Messaging is used to send an SMS to the candidate with the interview call link.
• Twilio Voice is used to make a call to the candidate, gather information, and record the candidate's responses.
• Twilio Voice Intelligence is used to transcribe the call recordings.
• Gemini AI is used to extract key points from the candidate's responses (transcriptions).
• Twilio Serverless functions are used to deploy the functions and assets (a form to capture candidate details).

Additional Prize Categories

My submission qualifies for the following additional prize categories:

• Twilio Times Two: Multiple Twilio features are used in the project.

• Impactful Innovators: This product will greatly help recruiters and companies manage their time and resources better.