Llama coverage.

Show HN: Free Ollama AI Trading Desktop App

Free desktop charting plus optional BYOK AI assistant on your charts, watchlists, and journal — private, local-first.…

Show HN: A Transformer Is All You Need

The unanswered question in mechanistic interpretability of pretrained transformers is plain: for any prompt and any decoder-only transformer, which weights at which layers along wh…

Refusal Lives Downstream of Persona in Chat Models

arXiv:2606.26161v1 Announce Type: new Abstract: Linear directions in activation space have been identified for both refusal and persona traits in instruction-tuned chat models, but…

TensorSharp: Open-Source Local LLM Inference Engine

A C# inference engine for running large language models (LLMs) locally using GGUF model files. TensorSharp provides a console application, a web-based chatbot interface, and Ollama…

ui: Mermaid Diagrams in chat + interactive preview by allozaur · Pull Request #24032 · ggml-org/llama.cpp

Tensor split mode: CUDA error on latest llama.cpp with Qwen-3.6-27b

NVIDIA drops DGX Station for Windows (1-Trillion Parameter desktop). Who else is ready to run LLaMA-Behemoth locally?

llama.cpp b9455 Finally Caught vLLM: 70t/s on 2x3090 Qwen 27B UQ8

Test post…

Mellum & Granite Embedding models are ready on llama.cpp

Another shout out to llama.cpp build b9455 2x3090

Show HN: Thaw – Git branch for a running LLM (fork agents, skip prefill)

fork() for AI agents — snapshot a live LLM session (weights + KV cache + scheduler + prefix-hash) and hydrate N divergent children that skip prefill. The substrate for RL rollouts,…

Local-first: a Model on Your Own Machine, Zero Cloud

This is the concrete, runnable walkthrough for Post 1 of the Portway series. The goal: stand up a...…

anybody got llama-swap working answering concurrent requests for a single model?

Andhra Pradesh government permits ASI survey in Nallamala forests

Andhra Pradesh authorizes ASI to survey Nallamala forests for cultural heritage, aiming to enhance eco-tourism and historical preservation.…

Show HN: I wrote a program that hashes files into poems

Hash files into LLM-generated poems locally. Contribute to alebeck/rhymesum development by creating an account on GitHub.…

I Told a Robot to "Clean the Kitchen", and It Actually Did

I typed "Clean the kitchen" into a chat box. A robot turned toward the right room, drove over, swept...…

Llama.cpp now has an official website: llama.app

llama.cpp now has an official website: https://t.co/9akc1jm8jV Our goal is to make local AI accessible to everyone, and improving the user experience is a big part of that. On the…

AI Workstation Build Check: £1100 Budget Tesla V100 32GB + Xeon 8268 + 64GB RAM in a Dell Precision T7820 (Ollama)

Llama.cpp B9406 MTP mmproj fix

LLM-Manager: Orchestrating Ollama and Llama.cpp with Pure Bash

LLM-Manager is a lightweight, modular Bash suite with a dual JSON/Interactive interface designed to...…

How do I make MTP work in llama-server?

Built a local AI voice control for my smart home — Ollama + faster-whisper + n8n, 2.4× faster than cloud

DefiLlama adds off-chain revenue data for Kalshi, blurring the line between DeFi and TradFi analytics

DefiLlama adds CFTC-regulated Kalshi to its off-chain revenue dashboard, revealing $197M annualized revenue and $5.8B in 30-day trading volume.…

Authors Sue Meta's AI Scientists Directly in Llama Copyright Case

A proposed class action targets not just Meta and Mark Zuckerberg but the research scientists who allegedly carried out the company's mass piracy of tens of millions of books.…

Tlamatini – Local-first AI dev assistant with 68 agents and hybrid RAG

Agentic Development AI Tempered. Contribute to XAIHT/Tlamatini development by creating an account on GitHub.…

Show HN: Local AI server with persistent memory, RAG and plugins

Local AI server with persistent memory, RAG, and multi-backend inference (MLX / llama.cpp / Ollama). Runs entirely on your machine — zero data sent to external services. - jgoy-lab…

When Your ChatLlamaCpp Stream Causes an Infinite Loop

When Your ChatLlamaCpp Stream Causes an Infinite Loop You've been there. Your AI agent...…

Is Claude API Worth $3/1M Tokens Over Self-Hosted Llama?

Originally published on NextFuture In May 2026, Claude Sonnet 4.6 costs $3.00 per million input...…

I made a Windows app for managing llama.cpp in WSL/Ubuntu

I quit ChatGPT for a free, private, and local AI called Ollama - here's why

Save your money, your privacy, and the planet. This installable AI offers several benefits you won't find with more traditional models like ChatGPT.…

How we optimized a local Llama 3 agent: From 15s latency and 68% accuracy to 4s and 100% (Full E2E Code & Guide)

Prompter – Compare and benchmark Ollama models side-by-side in your terminal

Terminal-based multi-model comparison, benchmarking, and evaluation tool for Ollama. Zero dependencies, one file. - whonixnetworks/prompter…

Top 10 DeFi protocols account for 87% of holders revenue, led by Hyperliquid

The top 10 DeFi protocols captured 87% of all holders revenue last month, with Hyperliquid alone generating $53.5M. Here's what the concentration means.…

Ollama v0.30.0-rc23: "directly support llama.cpp" & "compatibility with GGUF"

This version of Ollama will change the architecture to directly support llama.cpp instead of building on top of GGML, and allows for compatibility with GGUF file format. MLX is use…

Show HN: Unsiloed AI – #1 on OlmOCR-Bench,Beats Reducto, LlamaParse and GPT-5.5

CUDA: add fast walsh-hadamard transform by am17an · Pull Request #23615 · ggml-org/llama.cpp

Can you jailbreak Llama 3.1 8B? (Red-Teaming Challenge)

Llama.cpp : Split Mode Tensor Fix Incoming?

Building a Local-Only RAG System with Ollama and TypeScript

Building a Local-Only RAG System with Ollama and TypeScript Most RAG tutorials send your...…

llama.cpp oom issue

First Gemma 4 ExecuTorch Deployment on Raspberry Pi 5 — and Why It's 7.7 Slower Than llama.cpp

On April 2, ARM published a blog post announcing Gemma 4 optimised for ARM devices via XNNPACK +...…

I made a local-first MCP tutorial repo with node-llama-cpp and a custom agent loop

server: fix checkpoints creation by jacekpoplawski · Pull Request #22929 · ggml-org/llama.cpp

llama.cpp has a clever trick for speeding up KV cache decode

how to install llamacpp the better way to wrapping it in python ui (CPU use only) ?

Running Gemma 4 on a Modest Machine: Unsloth vs LM Studio vs llama.cpp vs Ollama

This is a submission for the Gemma 4 Challenge: Write About Gemma 4 When local AI conversations...…

Gemma 4 vs GPT-4o vs Llama 3: What Actually Works Locally?

This is a submission for the Gemma 4 Challenge: Write About Gemma 4 The Problem: Developers...…

magic incantation to get llama-bench to work with MTP ?

GPU VRAM only for small models with llama.cpp: is it possible?

I built a local GUI for the TradingAgents framework — works with Ollama

llampart 1.0.0 - I released a standalone local web UI for llama-server with translations, extended settings and a polished conversation sidebar

llama.cpp server have built-in native tools (exec_shell, edit_file, etc.)

I ditched LM Studio for llama.cpp, and my local LLM doesn't feel like a downgrade anymore

My new main runner…

LLaMa.cpp basic question

[Showoff Saturday] I built a Local LLM VRAM Calculator to instantly check if your GPU can run Llama 4, Qwen3, and DeepSeek-V4 locally

Seeking resources to read about llama.cpp server and how offloading works

Easy Agentic Tool Calling with Gemma 4

In this tutorial, we will give Gemma 4 two new tools and watch the model decide, on its own, when to look around and when to compute.…

Anyone built a local email summariser with Ollama? Trying to avoid sending work emails to OpenAI

I built a local Claude Code alternative with Ollama — here's how the agentic loop works

I Built a Local Autonomous Coding Agent with Ollama — Soul, Autonomy, and a 40-Round...…

Eve Agent V2 Unleashed – open-source local coding agent, powered by Ollama, FREE

Eve Agent V2 Unleashed — local-first autonomous AI coding agent powered by Ollama - JeffGreen311/eve-agent-v2-unleashed…