betaFeedback

WorksMathematics

The Csisz{á}r order for ranking the importance of input random variables

Abstract

Csisz{á}r indices S_f(X,Y)S\_f(X,Y), defined as the ff-divergence between the joint distribution of a general random couple (X,Y)(X,Y) and the product of its marginal distributions, are widely used to quantify dependence between the input variable XX and the output variable YY. We show that the ranking of two input variables XX and X′X' in terms of their importance w.r.t.\ the output variable, given by the comparison of the Csisz{á}r indices S_f(X,Y)S\_f(X,Y) and S_f(X′,Y)S\_f(X',Y) depends on the choice of ff. We introduce the Csisz{á}r order of input variables as the uniform ordering of Csisz{á}r indices over all proper convex functions ff. We give a sufficient condition to prove Csiszár order of two input multivariate random variables. We fully characterize it in two cases: when (X,X′,Y)(X,X',Y) is a Gaussian vector (in the one-dimensional case this amount to compare the square of their correlation); and when XX, X′X' and YY are Bernoulli random variables. Finally, motivated by sensitivity analysis, we show that, when (X,X′,Y)(X,X',Y) is a three-dimensional Gaussian random vector, thresholding XX, X′X', and YY either preserves the Csisz{á}r order or makes the input variables incomparable; in particular thresholding never reverses the ranking.

Paper details

vlnc:W_jb8yn7wd
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
arXiv nonexclusive license
Usage

views · 5

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Mathematics

Not recorded for this paper

View statement
Looking for related papers…