DEV Community

Vishal Habib profile picture

Vishal Habib

Lead AI Product Manager & Builder — Agentic AI @ Vanguard | Fintech · SaaS · Marketplaces | Ex-T-Mobile, eBay | Stanford GSB

Location Philadelphia, PA Joined Joined on  Personal website https://github.com/vishalhabib99 github website

Education

Stanford GSB

Work

Lead AI Product Manager & Builder — Agentic AI at Vanguard

Before I let an agent open PRs on strangers' repos, I made it earn it
vishalhabib99 profile

Before I let an agent open PRs on strangers' repos, I made it earn it

#ai #agents #mcp #opensource
Comments
6 min read

Want to connect with Vishal Habib?

Create an account to connect with Vishal Habib. You can also sign in below to proceed if you already have an account.

Create Account
Already have an account? Sign in
Shipping a Claude Code plugin with an eval suite: testing that the agent doesn't make things up
vishalhabib99 profile

Shipping a Claude Code plugin with an eval suite: testing that the agent doesn't make things up

#ai #mcp #testing #opensource
1
Comments 2
4 min read
I scanned 3,923 MCP servers. 1 in 4 tools leaves the model guessing.
vishalhabib99 profile

I scanned 3,923 MCP servers. 1 in 4 tools leaves the model guessing.

#mcp #ai #opensource #devtools
Comments 17
9 min read
My grader got every real answer right. Four red teams still broke it.
vishalhabib99 profile

My grader got every real answer right. Four red teams still broke it.

#ai #testing #quantum #evals
Comments 3
3 min read
"0 of 18 got through" isn't a launch. Here's the number that is.
vishalhabib99 profile

"0 of 18 got through" isn't a launch. Here's the number that is.

#ai #testing #productmanagement #statistics
1
Comments 5
3 min read
My prompt-injection fix caught 0 of 20 attacks. The part I almost didn't build caught all of them.

Judges can't spot manipulation if facts look right
vishalhabib99 profile

My prompt-injection fix caught 0 of 20 attacks. The part I almost didn't build caught all of them.

#ai #llm #security #testing
5
Comments 8
5 min read
I set the pass bar before testing my Claude Code skills. The first run failed.
vishalhabib99 profile

I set the pass bar before testing my Claude Code skills. The first run failed.

#ai #claude #productmanagement #testing
Comments
3 min read
I built three tools to audit MCP servers. Each one found a bug in itself first.
vishalhabib99 profile

I built three tools to audit MCP servers. Each one found a bug in itself first.

#mcp #opensource #ai #python
Comments 2
5 min read
loading...