DEV Community

# llm

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How the itrstats tax assistant works: one query, every layer
kartikeyraj profile

How the itrstats tax assistant works: one query, every layer

#python #llm #agents #rag
Comments
10 min read
The LLM Kept Saying “Fixed.” For Three Months, It Wasn’t.
ianlpaterson profile

The LLM Kept Saying “Fixed.” For Three Months, It Wasn’t.

#ai #llm #testing #programming
Comments
7 min read
How I Track Claude, Codex, and Gemini Quotas from One Script
ianlpaterson profile

How I Track Claude, Codex, and Gemini Quotas from One Script

#ai #llm #productivity #bash
Comments
6 min read
Three Months of Speed-Up Experiments on a 3090 Ti: Autoregressive DFlash MTP for Qwen3.6-27B
ianlpaterson profile

Three Months of Speed-Up Experiments on a 3090 Ti: Autoregressive DFlash MTP for Qwen3.6-27B

#ai #llm #gpu #performance
Comments
18 min read
Building llama.cpp from source on a Dell Precision T5820 with an RTX 3090 Ti (after seven power cycles)
ianlpaterson profile

Building llama.cpp from source on a Dell Precision T5820 with an RTX 3090 Ti (after seven power cycles)

#ai #llm #gpu #linux
Comments
16 min read
Inference Arbitrage: How I Route 200+ Daily LLM Calls Across Five Models
ianlpaterson profile

Inference Arbitrage: How I Route 200+ Daily LLM Calls Across Five Models

#ai #llm #devops #python
Comments
10 min read
LLM Benchmark Rankings 2026: 15 Models Tested on 38 Real Coding Tasks
ianlpaterson profile

LLM Benchmark Rankings 2026: 15 Models Tested on 38 Real Coding Tasks

#ai #llm #programming #benchmarking
Comments
28 min read
Why MTP doesn't speed up your llama.cpp inference (and how to actually fix it)
alanwest profile

Why MTP doesn't speed up your llama.cpp inference (and how to actually fix it)

#llm #performance #machinelearning #gpu
Comments
5 min read
High-Value If, Low-Value Foreach: Why Agents Trade in Judgment Structures, Not Models
suhui profile

High-Value If, Low-Value Foreach: Why Agents Trade in Judgment Structures, Not Models

#ai #agents #llm #mcp
Comments
23 min read
Designing a Multi-Agent AI System for Content Analysis and Recommendations
nagashreebhat profile

Designing a Multi-Agent AI System for Content Analysis and Recommendations

#systemdesign #llm #backend #ai
Comments
7 min read
I Cut My LLM API Bill by 73% — Here's the Exact Optimization Playbook
kollittle profile

I Cut My LLM API Bill by 73% — Here's the Exact Optimization Playbook

#ai #llm #devops #costoptimization
Comments
5 min read
What Production ML Systems Taught Me About AI Hallucinations
mansisomayajula03 profile

What Production ML Systems Taught Me About AI Hallucinations

#ai #machinelearning #llm #softwareengineering
Comments
4 min read
How LLMs Actually Work (And What That Means for Your Architecture Decisions)
coderslab profile

How LLMs Actually Work (And What That Means for Your Architecture Decisions)

#ai #machinelearning #llm #webdev
Comments
6 min read
Local Inference Boost: Qwen 3.6 Benchmarks, KV Cache Quantization, & Ollama UI
soytuber profile
soy

Local Inference Boost: Qwen 3.6 Benchmarks, KV Cache Quantization, & Ollama UI

#ai #llm #selfhosted
Comments
3 min read
Kimi K2.6 Beats Frontier Models in Coding Benchmarks
logiqode profile

Kimi K2.6 Beats Frontier Models in Coding Benchmarks

#llm #opensource #ai #programming
Comments
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.