Thoughts on using an AMD Alveo V80 FPGA PCI card as a poor man’s Taalas HC1 (LLM-burned-onto-a-chip).

TL:DR - Remembered FPGA PCI boards being a big thing from my crypto days. Wondered if AMD Alveo V80 FPGA card could be used to approximate the performance of a Taalas HC1 (LLM-on-a-chip). Ran the idea past Gemini Pro for a feasibility / sanity check. It suggested what seemed to be a speculative decoding type of setup on the FPGA and said I might could get to 3,200 tk/s with a Q4 of Qwen3.5 4b or maybe 1;400 tk/s with 9b. Not Taalas HC1 speeds, but still pretty fast (potentially). Posting here to

More from Reddit

Luce DFlash: Qwen3.6-27B at up to 2x throughput on a single RTX 3090

Reddit

GBNF grammar tweak for faster Qwen3.6 35B-A3B and Qwen3.6 27B

Reddit

Tissue regeneration moves closer to reality with lab-grown bone, muscle, and cartilage

Reddit

AI bill would crack down on deepfake distribution and protect whistleblowers

Reddit

India’s power demand hits record as heat wave batters nation

Reddit

Agents for end-to-end document redaction and review tasks (OCR and PII identification - Qwen 3.6 vs closed-source comparison)

Reddit