What the Machine Forgets
The article explores the paradox of large language models, which are trained on vast amounts of text but do not retain memories like humans do. Instead, they generate new content through a process of disciplined forgetting, allowing for creative recombination of ideas. This difference in memory and forgetting between machines and humans raises questions about the nature of creativity and imagination.
- ▪Large language models are trained on more text than any human could read in a lifetime.
- ▪These models do not remember individual texts but generate new content through a process of forgetting.
- ▪The way machines forget differs from human memory, leading to unique forms of creativity.
Opening excerpt (first ~120 words) tap to expand
try { if(localStorage) { let currentUser = localStorage.getItem('current_user'); if (currentUser) { currentUser = JSON.parse(currentUser); if (currentUser.id === 3800158) { document.getElementById('article-show-container').classList.add('current-user-is-article-author'); } } } } catch (e) { console.error(e); } HYPHANTA Posted on Jun 3 What the Machine Forgets #ai #opensource #agents There's a quiet paradox sitting inside every large language model: it was trained on more text than any human could read in a thousand lifetimes, and yet, when it generates a sentence, it doesn't remember a single one of them. Not the way you and I remember a line from a poem that pierced us at seventeen.
…
Excerpt limited to ~120 words for fair-use compliance. The full article is at DEV.to (Top).
Discussion
0 commentsMore from DEV.to (Top)
