DEV Community

Cover image for Scalable Load Balancing Having Cloud GPU Service Salad Tutorial With Whisper Transcriber Gradio APP
Furkan Gözükara
Furkan Gözükara

Posted on

Scalable Load Balancing Having Cloud GPU Service Salad Tutorial With Whisper Transcriber Gradio APP

In this tutorial I am introducing a new cloud GPU provider Salad. They have a very unique system that allows you to both make money by renting your GPU and use their GPU orchestrator system to deploy your own docker image or their pre-configured docker images to do AI tasks such as Stable Diffusion image generation, using LLMs or transcribing audio with Whisper. Since they utilize such orchestrator GPU management system, they are able to provide fully scalable, loading balancing have and with almost 100% uptime cloud GPU inference service.

https://youtu.be/AJV_9pqSgng

The GitHub Readme File ⤵️

https://github.com/FurkanGozukara/Stable-Diffusion/blob/main/Tutorials/Cheap-Cloud-GPU-Inference-Service-Salad-Tutorial.md

Join me on Salad and use code Y3MEDP for a 2x earning rate bonus! https://salad.com

The Self Developed Free Whisper Transcriber Gradio APP ⤵️

https://github.com/FurkanGozukara/Stable-Diffusion/blob/main/CustomPythonScripts/whisper_transcribe_salad.py

Salad Main Site : https://salad.com/

Salad Portal : https://portal.salad.com

Your Salad API Key : https://portal.salad.com/api-key

Salad Documentation : https://docs.salad.com/

Rent Your GPU To Salad To Eearn Revenue : https://salad.com/download

Salad Blog : https://blog.salad.com/

0:00 Introduction to the Salad tutorial

0:30 How Salad provides cheap GPU and scalability and load balancing

1:17 Rent your GPU to Salad to earn revenue

2:14 How to start using Salad cloud GPUs

3:05 How to deploy containers / docker images on Salad

3:15 How to use pre-configured docker images / containers / recipes on Salad

3:46 How to deploy Whisper container / recipe on Salad

4:03 What replica count does and what it means : do automated load balancing and scalability

5:04 How to check status of your deployed containers

5:35 How to deploy very best and most powerful Whisper version to get best and most accurate transcription

5:58 Where to find explanations of pre-configured docker images / recipes / containers

6:34 The free Gradio video and audio transcription software that I have prepared

7:41 How to use the Gradio transcriber app

10:13 The time Whisper Distil takes to transcribe 26 minutes audio speaking file

11:15 How to use Whisper Large V3 on Salad

Top comments (0)