About the paper
We propose a computationally efficient vine copula-based mutual information (MI) estimator. Unlike existing non-parametric density estimators that suffer from the curse of dimensionality, a non-parametric vine copula has a convergence rate that is independent of the dimensionality of data. We leverage this property to tackle the challenging task of MI estimation and propose an interpretable MI estimator. Extensive experiments on datasets with known ground-truth MI values across dimensions, data types, and (input, output) dependence structures demonstrate a superior trade-off between MI estimation error and computational time compared to SotA neural MI estimators.
This paper was written as a collaboration between Sigurd Holmsen, Sylvia Richardson and Ali Ramezani-Kebrya at Integreat (SFF), and Berit Omli Øksnes and Ingrid Hobæk Haff (Mathematics department, UiO).