DEV Community

Shalendra gaur profile picture

Shalendra gaur

404 bio not found

Joined Joined on 
One TPU v6e chip holds 927 agent sessions with host-held state and 5 with a kept chat (memory only)

One TPU v6e chip holds 927 agent sessions with host-held state and 5 with a kept chat (memory only)

Comments
3 min read

Want to connect with Shalendra gaur?

Create an account to connect with Shalendra gaur. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
What a host-side layer for LLM agents is, in plain words (and what it is not)

What a host-side layer for LLM agents is, in plain words (and what it is not)

Comments
3 min read
A chat that keeps its whole history: 949,591-token prompts, calls 3.5x slower, state wrong from turn 287

A chat that keeps its whole history: 949,591-token prompts, calls 3.5x slower, state wrong from turn 287

1
Comments
3 min read
How to make an LLM agent test replayable in 3 seconds, with no API key

How to make an LLM agent test replayable in 3 seconds, with no API key

1
Comments
2 min read
A 98%-accurate model leaves an agent's state right only 21% of the time without AXI

A 98%-accurate model leaves an agent's state right only 21% of the time without AXI

1
Comments
5 min read
Your LLM agent re-reads its history every step. We measured what that costs

Your LLM agent re-reads its history every step. We measured what that costs

3
Comments 5
3 min read
loading...