Gguf - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Oct 14

GGUF vs safetensors — the runtime decides, not the format

#discuss #ai #gguf #llm

5 min read

Oct 13

GGUF native support, Next.js memory cuts, agent misalignment risks

#ai #devtools #programming #gguf

5 min read

Oct 2

GGUF VRAM Calculator: Check Before You Download

#ai #gguf #localai #devtools

4 min read

Oct 10

vLLM GGUF FAQ: Ten Search Questions, Answered

#vllm #gguf #llm #machinelearning

3 min read

Aravinda 加阳

Sep 10

How to Import LM Studio Models into Ollama (No Re-Download!) 🚀

#ollama #lmstudio #gguf #modelfile

3 min read

Sep 30

Testing the 9x Smaller Local LLM Claim on a GPU-less VPS

#localllm #quantization #selfhosting #gguf

6 min read

Sep 23

Can vLLM Run GGUF? Yes — on GPU Only

#ai #llm #gguf #vllm

4 min read

Sep 18

How to Run GGUF Models Locally: Ollama, llama.cpp & vLLM

#ai #gguf #ollama #llamacpp

5 min read

Sep 13

GGUF Quantization: Which Level Should You Use?

#ai #gguf #quantization #localllm

5 min read

Aug 9

GGUF vs GPTQ vs AWQ: Which Quantization Format Should You Actually Use?

#gguf #huggingface #ai #devops

4 min read

Pneumetron

Jul 19

Unsloth Releases Inkling-GGUF: A Multimodal MoE Model for Developers

#aiml #multimodalmodels #mixtureofexperts #gguf

3 min read

Pneumetron

Jul 18

GnLOLot Releases MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF for Enhanced Local AI Development

#gguf #llamacpp #quantized #minicpm5

3 min read

Pneumetron

Jul 15

Bonsai-27B: A 1-Bit LLM for On-Device Inference with Llama.cpp and MLX

#llm #quantization #1bit #gguf

3 min read

Joske Vermeulen

Aug 6

KAT-Coder V2.5 Local Setup Guide: GGUF, vLLM, SGLang

#katcoder #localai #coding #gguf

7 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.