DEV Community

#lora

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
llama-server's prompt cache reuses KV computed under a different LoRA scale

llama-server's prompt cache reuses KV computed under a different LoRA scale

Comments
6 min read
vLLM ignores LoRA rank_pattern and alpha_pattern and serves the adapter at the wrong scale

vLLM ignores LoRA rank_pattern and alpha_pattern and serves the adapter at the wrong scale

Comments
5 min read
Fine-Tuning LLMs with LoRA & QLoRA: Complete Production Guide

Fine-Tuning LLMs with LoRA & QLoRA: Complete Production Guide

Comments
8 min read
Fine-Tuning LLMs on Consumer Hardware: LoRA Guide 2024

Fine-Tuning LLMs on Consumer Hardware: LoRA Guide 2024

Comments
4 min read
restmesh: a simple Meshtastic REST API

restmesh: a simple Meshtastic REST API

Comments
2 min read
LoRA vs QLoRA vs full fine-tuning: cost, quality and when each makes sense

LoRA vs QLoRA vs full fine-tuning: cost, quality and when each makes sense

Comments
3 min read
LighthouseReckoning: A Lightweight LoRa Mesh Network for Arduino, ESP32 and RP2040

LighthouseReckoning: A Lightweight LoRa Mesh Network for Arduino, ESP32 and RP2040

1
Comments 1
6 min read
LLM Finetunings, how and why

LLM Finetunings, how and why

Comments 1
9 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.