Intel B70: LLama.ccp SYCL vs LLama.cpp OpenVino vs LLM-Scaler

In case anyone is interested, I decided to test out LLama.cpp's new OpenVino backend to see how it compares on Intel GPUs. At first glance, it stomps all over the previous best-case, SYCL, but lags behind LLM-Scaler (Intel's VLLM fork), likely just due to the hardware optimizations against GPTQ/Int4. Interestingly tg512 was fastest on SYCL, but in real world, the prompt processing always seems the be the indicator on this card. As usual with Intel, model selection is... poor. It took a while to

More from Reddit

Luce DFlash: Qwen3.6-27B at up to 2x throughput on a single RTX 3090

Reddit

GBNF grammar tweak for faster Qwen3.6 35B-A3B and Qwen3.6 27B

Reddit

Tissue regeneration moves closer to reality with lab-grown bone, muscle, and cartilage

Reddit

AI bill would crack down on deepfake distribution and protect whistleblowers

Reddit

India’s power demand hits record as heat wave batters nation

Reddit

Agents for end-to-end document redaction and review tasks (OCR and PII identification - Qwen 3.6 vs closed-source comparison)

Reddit