If you've been waiting to try local AI development, please try it

via

LocalLlama

I have snobbishly long felt that the local models were not 'up to my standards' for local development, or otherwise able to compete with GHCP, Claude Code, Cursor etc. Boy was I wrong. With the rapid increase of usage constraints and enshittification of plans all the cloud providers are starting to enact, I finally downloaded Opencode and got it setup with llama-server + Qwen3.6-27B at a reasonable quant with 128K context (unsure if I could push this more but it's plenty for the time being). Cur

More from LocalLlama

Upskill: skill registry your agent consults before it starts. 10k+ indexed, free, open source.

LocalLlama·2

[AutoBe] Local LLM Benchmarks about Backend Generation, Monthly (GLM vs Qwen vs DeepSeek)

LocalLlama·2

Bruh

LocalLlama·6

Qwen3.6-27B-NVFP4 - images

LocalLlama·6

Hybrid on-device inference on Android: llama.cpp + LiteRT + NPU/GPU routing

LocalLlama·6

MiniMax M2.7 AWQ-4bit on 2x Spark vs 2x RTX 6000 96GB - performance and energy efficiency

LocalLlama·6