DEV Community

Dzaki Amri Zaidaan profile picture

Dzaki Amri Zaidaan

Software Engineer

Joined Joined on  github website
High‑Throughput Local LLM Inference: PagedAttention, vLLM, and Quantization (AWQ & GGUF)
dzakiamriz profile

High‑Throughput Local LLM Inference: PagedAttention, vLLM, and Quantization (AWQ & GGUF)

#aiml #architecture
Comments
3 min read

Want to connect with Dzaki Amri Zaidaan?

Create an account to connect with Dzaki Amri Zaidaan. You can also sign in below to proceed if you already have an account.

Create Account
Already have an account? Sign in
High‑Throughput Local LLM Inference: PagedAttention, vLLM, and Quantization (AWQ & GGUF)
dzakiamriz profile

High‑Throughput Local LLM Inference: PagedAttention, vLLM, and Quantization (AWQ & GGUF)

#aiinfrastructure
Comments
4 min read
High‑Throughput Local LLM Inference: PagedAttention, vLLM, and Quantization (AWQ & GGUF)
dzakiamriz profile

High‑Throughput Local LLM Inference: PagedAttention, vLLM, and Quantization (AWQ & GGUF)

#aiml
1
Comments
3 min read
Model Context Protocol (MCP): Building Interoperable AI Agent Tool Ecosystems
dzakiamriz profile

Model Context Protocol (MCP): Building Interoperable AI Agent Tool Ecosystems

#aiml #architecture
Comments
4 min read
Scaling Real-Time APIs to 100k+ Concurrent Connections: WebSockets, SSE, and Redis Pub/Sub
dzakiamriz profile

Scaling Real-Time APIs to 100k+ Concurrent Connections: WebSockets, SSE, and Redis Pub/Sub

#backendarchitecture #websockets #sse #redis
Comments
5 min read
Production RAG in 2026: Hybrid Search with pgvector, Reciprocal Rank Fusion, and Context Caching
dzakiamriz profile

Production RAG in 2026: Hybrid Search with pgvector, Reciprocal Rank Fusion, and Context Caching

#aiengineering #rag #pgvector #postgres
Comments
4 min read
loading...