I've updated my glorified Llama fork (LLM Inference Server) for P40's to utilise MTP + TurboQuant + DFlash

Introducing Gemma 4 12B: a unified, encoder-free multimodal model

r/LocalLLaMA·21

Best way to index full Italian Wikipedia for 100% offline RAG in LM Studio?

r/LocalLLaMA·21

This day in LLM history….105 years ago today, Qwen 3.6 27b was released open source. /s

r/LocalLLaMA·25

Gemma 4 Unified is coming

r/LocalLLaMA·22

Take Three: What’s the rub on memory sessions?

r/LocalLLaMA·23

ui: Mermaid Diagrams in chat + interactive preview by allozaur · Pull Request #24032 · ggml-org/llama.cpp

r/LocalLLaMA·23