Generalization coverage.

A mathematical theory of balancing relational generalization and memorization

Humans, animals, and modern machine learning models exhibit impressive abilities to learn complex behaviors and generalize these behaviors to unseen situations. This ability requir…

Smaller Abstract State Spaces Enable Cross-Scale Generalization in Reinforcement Learning

While humans readily generalize abstract concepts to more complex or larger tasks, building Reinforcement Learning (RL) systems with this ability remains elusive. Here, we present …

Mechanisms of Misgeneralization in Physical Sequence Modeling

Generative sequence models are often trained to plan motion in physical domains, from robotics to mechanical simulations. When constructing a dataset to train such a model, enginee…

EMO-BOOST: Emotion-Augmented Audio-Visual Features for Improved Generalization in Deepfake Detection

With every advancement in generative AI models, forensics is under increasing pressure. The constant emergence of new generation techniques makes it impossible to collect data for …

Generalization Dynamics of LM Pre-Training

Generalization or Memorization? Brittleness Testing for Chess-Trained Language Models

Recent work has fine-tuned language models on chess data and reported high benchmark scores as evidence that the resulting models can understand the rules of chess, play full chess…

Structure Abstraction and Generalization in a Hippocampal-Entorhinal Inspired World Model

Humans abstract experiences into structured representations to facilitate pattern inference and knowledge transfer. While the hippocampal-entorhinal (HPC-MEC) circuit is known to r…

Towards Generalization of Block Attention via Automatic Segmentation and Block Distillation

Block attention, which processes the input as separate blocks that cannot attend to one another, offers significant potential to improve KV cache reuse in long-context scenarios su…

Leaders, stop with the Gen Z generalizations

Generational stereotypes aren't just lazy thinking — they're distorting hiring decisions, product strategy and marketing campaigns. Break the habit.…