An Invariant Measure for Differential Entropy: From Kullback–Leibler Divergence to Scale-Invariant Information Theory

Shannon’s differential entropy for continuous variables suffers from a fundamental limitation: it is not invariant under scale transformations. This makes entropy values dependent on the choice of measurement units rather than reflecting intrinsic properties of distributions. While Jaynes proposed t...

Полное описание

Библиографические подробности

Главные авторы:	Félix Truong, Alexandre Giuliani
Формат:	Artigo
Язык:	Inglês
Опубликовано:	MDPI AG 2026-03-01
Серии:	Entropy
Предметы:	differential entropy invariant measure Kullback–Leibler divergence limiting density of discrete points k-nearest neighbor mutual information
Online-ссылка:	https://www.mdpi.com/1099-4300/28/3/301
Метки:	Добавить метку Нет меток, Требуется 1-ая метка записи!