Talkie: a 13B LLM trained only on pre-1931 text used Claude Sonnet to help test the model and judge its output

via

ClaudeAI

Researchers Alec Radford (GPT, CLIP, Whisper), Nick Levine, and David Duvenaud just released talkie : a 13 billion parameter language model trained exclusively on text published before 1931. No internet. No Wikipedia. No World War II. Its worldview is frozen at December 31, 1930. Why does this matter? Every major LLM today (GPT, Claude, Gemini, Llama) ultimately shares a common ancestor: the modern web. That makes it nearly impossible to tell what these models genuinely reason versus what they s

More from ClaudeAI

Claude can now build your entire weekly meal plan with real grocery prices from your actual store FOR FREE. Here's how

ClaudeAI·8

The device you are on seems to change behavior

ClaudeAI·9

Suggestions For Making Claude Less Lazy?

ClaudeAI·6

Opus 4.7 is just 4.6 with a stick up its butt. Give me my tokens back!

ClaudeAI·14

Claude Status Update : Claude.ai unavailable and elevated errors on the API on 2026-04-28T18:33:55.000Z

ClaudeAI·16

Claude Status Update : Claude.ai unavailable and elevated errors on the API on 2026-04-28T17:51:36.000Z

ClaudeAI·15