Introducing HRM-Text
HRM-Text is a new hierarchical reasoning language model that significantly reduces the data and compute requirements compared to conventional models. It has been trained on 40 billion tokens and is capable of achieving competitive performance on various reasoning benchmarks. The model's architecture allows for efficient reasoning and task completion, making it suitable for compact deployment.
- ▪HRM-Text is a 1.15-billion-parameter model trained on approximately 40 billion tokens.
- ▪It can be pretrained in roughly one day for about a thousand dollars.
- ▪The model achieved competitive results on benchmarks such as MATH, DROP, and ARC-Challenge.
Opening excerpt (first ~120 words) tap to expand
ResearchIntroducing HRM-TextSapientMay 18, 2026 Back To AllHRM-Text is an ultra-lean 1B reasoning language model that achieves strong reasoning performance at a fraction of the compute and data required by conventional approaches. It is available today as a fully open release. Today we are releasing HRM-Text, a 1.15-billion-parameter hierarchical reasoning language model trained on approximately 40 billion tokens of structured data. That is up to 1,000× fewer tokens than the 4–36 trillion used in typical open pretraining runs — and the entire model can be pretrained in roughly one day for about a thousand dollars.
…
Excerpt limited to ~120 words for fair-use compliance. The full article is at sapient.inc.
Discussion
0 commentsMore from sapient.inc
