gauravdagde

Building Preto.ai — LLM cost optimization for engineering teams. Writing about AI infrastructure, LLM proxies, and keeping your OpenAI bill under control.

Pune, India Joined on Apr 20, 2020 https://preto.ai

Education

University of Pune

Work

Founder / CTO at Preto.ai

gauravdagde

Apr 5

LLM Semantic Caching: The 95% Hit Rate Myth (and What Production Data Actually Shows)

#llm #ai #redis #backend

7 min read

Want to connect with gauravdagde?

Create an account to connect with gauravdagde. You can also sign in below to proceed if you already have an account.

Create Account

Already have an account? Sign in

gauravdagde

Apr 4

We built an LLM proxy that adds 47ms of latency. Here's every millisecond accounted for.

#ai #llm #architecture #backend

8 min read

gauravdagde

Apr 3

We evaluated Go, Rust, and Python for our LLM proxy. Go won - and not for the reason you'd expect.

#ai #webdev #go #rust

6 min read

gauravdagde

Aug 23 '22

How to integrate coroot-pg-agent with prometheus

#postgres #prometheusexporter #corootpgagent #postgresmonitoring

4 min read

DEV Community

gauravdagde

Badges

Five Year Club

Four Year Club

Writing Debut

Three Year Club

Two Year Club

One Year Club

Skills/Languages

Currently learning

Currently hacking on

Available for

LLM Semantic Caching: The 95% Hit Rate Myth (and What Production Data Actually Shows)

Want to connect with gauravdagde?

We built an LLM proxy that adds 47ms of latency. Here's every millisecond accounted for.

We evaluated Go, Rust, and Python for our LLM proxy. Go won - and not for the reason you'd expect.

How to integrate coroot-pg-agent with prometheus