60 stories tagged with #cache, in publish-time order across the WeSearch catalog. Tag pages update as new stories ingest.
⌘ RSS feed for this tag → or search "Cache"
KV-PRM: Efficient Process Reward Modeling via KV-Cache Transfer for Multi-Agent Test-Time Scaling
arXiv:2607.09153v1 Announce Type: new Abstract: Process Reward Models (PRMs) have been proven to be highly effective in guiding test-time scaling (TTS) methods, which significantly…
Same agent tasks, 76% fewer LLM calls – we moved semantic cache inside the graph
Deterministic AI agent orchestration — comment via Discussions & Issues; code changes by maintainers only. - insightitsGit/ChorusGraph…
Archaeologists unearth ancient treasure cache at biblical city connected to Genesis
Archaeologists have uncovered ancient treasure at Heliopolis, the biblical city mentioned in the story of Joseph, including possible gold earrings and scarabs.…
Still: Amortized KV Cache Compaction in a Single Forward Pass
The KV cache is the memory bottleneck of long-horizon language model deployment. Practically, a deployable compactor must be lightweight enough to call during inference, expressive…
Iran booby traps entrances, collapses tunnels leading to cache of enriched uranium - report
This comes a day after a senior administration official told reporters that the US and Iran are close to a deal requiring Iran to relinquish its uranium, which has been enriched to…
CI caching is not one cache
Where native caches win, where Incredibuild's proprietary compiler cache wins, and how disposable Islo runners change the CI cache problem.…
Show HN: Self tuning chat exposing it's semantic and agentic cache
Open-source RAG chatbot over Valkey, Redis OSS, Dragonfly, and BetterDB docs. Live demo of @betterdb/agent-cache and @betterdb/semantic-cache with real-time hit/miss metrics.…
Users bounce after 2 minutes, but CDN caches the whole 5GB movie. How to stop wasting bandwidth?
AutoCachedPreview
Scarab Diagnostic Suite Field Test #005: A Terraform Core Cache Boundary
This is the fifth field test in my Scarab Diagnostic Suite series, and it is the most significant one...…
Great Stack to Doesn't Work #3 — Redis: "99% Cache Hit Ratio, System Down"
A survival guide for when everything goes wrong in production. Your Redis dashboard looks...…
Wondered why my storage was horrible. Meanwhile, my cache.
Event like spiking neuron lib that fits into the CPU cache [P]
Agent Memory Is a Cache Coherence Problem
Xcena, whose MX1 chip performs data orchestration and KV cache management directly within memory modules, raised a $135M Series B at a $570M valuation (Kate Park/TechCrunch)
New Silicon Motion SM2524XT chip brings 14 GB/s to mainstream SSDs — 6nm DRAMless controller boasts heavy AI PC optimization and slashes KV cache latency
Fast, furious, inexpensive.…
KV-Pool: 4.5x Agent Inference Throughput with Persistent KV Cache
Why Agent Workloads Are Expensive LLM inference costs always scale with context length. In...…
LAPD discovers huge fireworks cache, raising fears of another LAPD fireworks disaster
Los Angeles residents were evacuated Wednesday after police discovered a massive cache of illegal fireworks inside a South LA home. Such a development would be alarming in any urba…
Cache Aware Scheduling Shows Nice Wins For AMD Zen 5 On PostgreSQL, Valkey, Network Performance
The long-in-development work on Cache Aware Scheduling looks like it will come to a head soon with it looking like Cache Aware Scheduling will land for Linux 7.2.…
The One Cache That Broke Our Treasure Hunt Engine
The Problem We Were Actually Solving Our core game loop was: player scans QR → API writes...…
The Day Treasure Hunt Broke My Caches—And How We Fixed It
The Problem We Were Actually Solving The treasure hunt engine used a single Redis sorted...…
The Cache That Bled — How We Turned Veltrix Event Config From Silent Killer to Silent Savior
The Problem We Were Actually Solving We assumed Postgres could keep up with event...…
Edge-Cached Localhost Tunnels: How to Give Stakeholders a Production-Fast Preview Directly from Your IDE
IT InstaTunnel Team Published by our engineering team Edge-Cached Localhost Tunnels: How to Give...…
GitHub Actions Cache Poisoning is eating open source
Show HN: MurrDB: A RocksDB-based NVMe/S3 cache for AI inference workloads
Shard - getting to 10× KV cache compression
Meta's CacheLib Sees New Release After Two Year Hiatus For Helping With High DRAM Prices
Back in 2021 Facebook open-sourced CacheLib as a new caching engine…
(Yet Another) KV cache calculator - kvanta.vcerny.cz
PEEK: Give Your Agent an Orientation Cache (MIT CSAIL, Khattab group)
We introduce PEEK, a system that caches reusable orientation knowledge about a recurring external context as a small, prompt-resident context map.…
OSCAR RotationZoo - Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization
A selfie crashed Twitter in 20 minutes. Not traffic — a single cache key. Here's what actually happened.
ObjectCache: Layerwise Object-Storage Retrieval for KV Cache Reuse
Prefix KV caching has become a key mechanism in LLM serving: it reduces time to first token (TTFT) by avoiding redundant computation across requests that share a prefix (i.e., the …
Tensor Cache: Eviction-conditioned Associative Memory for Transformers
Autoregressive Transformer KV caches grow linearly with context length; sliding-window caching bounds memory but discards evicted tokens entirely, so relevant evidence outside the …
DeepSeek-V4 KV Cache Explained: Why 1M Context Uses Less VRAM
A comparison of DeepSeek-V4's CSA/HCA hybrid compressed attention with traditional MHA, GQA, and MLA, explaining why DeepSeek-V4 can greatly reduce KV Cache memory for 1M-token con…
llama.cpp has a clever trick for speeding up KV cache decode
Cache – Meal plans from your local store's weekly sales
Plan weekly dinners around live grocery sales at Kroger, Fred Meyer, Ralphs, and 35+ states. Cache matches meals to this week's deals — saving families $40–60/month.…
TID: Linux kernelmodule–flushes CPU cache after wiping sensitive data CLFLUSHOPT
Hardware-level security protocol for mitigating cache-based side-channel attacks. - ahmaaaaadbntaaaaa-byte/TID-The-Instant-Destroyer…
no-cycle finds 0 cycles in next.js (and other lies caches tell you)
Our import-next/no-cycle reported 0 cycles in next.js's 14K-file repo. oxlint reported 17. The same rule, run on a 33-file subset of the same repo, found 5+. The bug: cache polluti…
Cache miss in Claude Code costs 12.5× more than a hit. Here are 5 things you do mid session that quietly trigger it
Inference provider tiers by Cache-hit rates, using openrouter data
Cache hit rates of Inference are more meaningful than the headline costs
Ask HN: Does anyone what a "RiotCache.dat" file was doing in my EFI partition?
[$] Custom page-cache policies with BPF
The kernel's page cache is charged with maintaining pages (or, more correctly, folios) containi [...]…
Go build cache increases to hundreds of GB when running AI agents
Show HN: KVBoost – chunk-level KV cache reuse for HuggingFace, 5–48x faster TTFT
GitHub Actions Cache Poisoning is eating open source
A performance regression in code I didn’t touch: debugging an L1 i-cache associativity issue
Custom DHCP Option 235 for Microsoft Connected Cache – Not Being Picked Up by Clients
The Google I/O 2026 announcement that quietly broke my cost spreadsheet: Gemini's cache-discount tier
Google I/O 2026 had the headline stuff. Gemma 4 in four sizes. The new agent-friendly Gemini...…
The home user folder is taking up 300GB, but its contents add up to 150GB at most. How is this even possible? All ~/Logs, ~/Cache, etc. are clean
The Very Exciting Cache Aware Scheduling Looks Like It Will Land For Linux 7.2
As a very exciting development ahead of the Linux 7.2 kernel merge window opening in about one month's time, it looks like the long-awaited Cache Aware Scheduling support will fina…
Selfhosted second brain app: markdown-based, built-in MCP server, SQLite cache layer and semantic search. Any interest from this community?
Fixed our cache but full builds are still slow as hell
AWS CloudFront Cache Policies: Complete Guide
A CloudFront cache policy controls two things: the cache key (which combination of URL, headers,...…
KV Cache Explained Like You're an LLM Engineer
How transformer inference actually works under the hood — and why KV cache is the single most...…
PEEK: Context Map as an Orientation Cache for Long-Context LLM Agents
Large language model (LLM) agents increasingly operate over long and recurring external contexts, like document corpora and code repositories. Across invocations, existing approach…
Stop Hardcoding AI Prompts: A Developer’s Guide to PromptCache
Manage, version, and deploy your team’s AI prompts like code — with a TypeScript SDK, REST API, and...…
Agentically optimizing LLM prompt cache TTLs for fun and profit
A case study on production objective hill climbing Firetiger runs a few hundred large language model (LLM) agents in production, and prompt caching is a critical tool to manage th…
OpenAI's ChatGPT Has A Web Cache - Search Engine Roundtable
Comprehensive up-to-date news coverage, aggregated from sources all over the world by Google News.…