9 stories tagged with #information-theory, in publish-time order across the WeSearch catalog. Tag pages update as new stories ingest.
⌘ RSS feed for this tag → or search "Information Theory"
Why the Brain Cannot Be a Computer
This paper presents a novel information-theoretic proof demonstrating that the human brain as currently understood cannot function as a classical digital computer. Through systemat…
Can we explain the "infinite time dilation" of DMT/NDEs using information theory and hyper-gamma brainwaves?
Shannon Got AI This Far. Kolmogorov Shows Where It Stops
Shannon Got AI This Far. Kolmogorov Shows Where It Stops. This post previewed a conversation I recorded with Martin Casado for the a16z podcast. The ideas here came up in that disc…
Jensen–Shannon Divergence
Neural Estimation of Pairwise Mutual Information in Masked Discrete Sequence Models
Understanding dependencies between variables is critical for interpretability and efficient generation in masked diffusion models (MDMs), yet these models primarily expose marginal…
Lost and Found in Translation: Variational Diagnostics for Neural Codebook Channels
Classical communication systems fail not only through random noise but also when transmitter and receiver use incompatible operational codebooks. Variational autoencoders (VAEs) tr…
Learning Selective Merge Policies for Deadline-Constrained Coded Caching via Deep Reinforcement Learning
With the coded caching, the server can use the information the users have cached to serve multiple users at a time by sending a single coded multi-casting message, i.e., the merged…
PrismQuant: Rate-Distortion-Optimal Vector Quantization for Gaussian-Mixture Sources
For a Gaussian source under mean-squared error (MSE), classical transform coding is rate--distortion (RD) optimal: the Karhunen--Loeve transform (KLT) diagonalizes the covariance, …
What Claude Shannon Knew in 1950 That We're Pretending Is New
AI didn’t arrive yesterday; it just changed its outfit…