Localllm

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Nathan C.

Aug 29

I A/B tested my own system prompt: 24 generations, one clear win, one rule that did nothing | Flash Onyx 2.2

#ai #ollama #localllm #opensource

8 min read

Nathan C.

Aug 28

Flash Onyx 2.2: teaching a local model law and game feel

#ai #ollama #localllm #opensource

4 min read

the kilted dev

Aug 18

What really fits in 8GB VRAM

#localllm #vram #gpu #buildinpublic

7 min read

Guatu

Aug 14

Moving Scheduled LLM Curation from Cloud APIs to Local Models

#aiagents #localllm #ollama #kubernetes

9 min read

the kilted dev

Aug 11

Nine ways to talk to a local model

#localllm #ollama #llamacpp #buildinpublic

9 min read

Rickesh T N

Aug 24

A 4B model on a 6GB laptop beat Claude Opus on our 440K-token corpus. The fix was giving the model less to do.

#privateai #llm #inference #localllm

4 min read

PEPPERCORN

Aug 6

[Day 20] Local AI vs cloud AI: one cat photo, 10 video models

#localllm #ai #dgxspark #videogeneration

3 min read

Lajos Bencz

Jul 15

Running an LLM agent entirely in your browser

#ai #localllm #webdev #machinelearning

5 min read

uehara

Aug 15

Cloud bills kept climbing from 24/7 AI development — I moved the decisions and the implementation to my own local LLMs and cut the cost

#ai #llm #localllm #costoptimization

10 min read

uehara

Aug 10

Moving Half of Our AI Development to Local LLMs — by Splitting Work by Role, Not by Picking the Biggest Model

#ai #llm #machinelearning #localllm

3 min read

Reno Lu

Jul 20

local-llm: A Field Report on Running SOTA Models on Your Own Hardware

#localllm #gpu #selfhosting #inference

3 min read

Umair Bilal

Jun 30

prima.cpp local llm benchmark: 15% Faster Than llama.cpp

#ai #llm #localllm #benchmarking

8 min read

Turgay

Aug 1

Teaching a Local AI Agent to Search the Web (Without Lying to You)

#applesilicon #localllm #llmagents #swift

24 min read

Takafumi Endo | ROUTE06

Jul 29

Why My Local Coding Agent Could Act but Couldn't Finish

#llm #localllm #qwen #agents

11 min read

Umair Bilal

Jun 24

Local AI Agent Browser Extension: Hermes in 120ms

#aiagents #browserextension #localllm #hermesagent

9 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.