Navigation

Operators and Keywords

Function List:

C++ API

Function File: relativeentropy (p, q)

Computes the relative entropy between the 2 given pdf's. d(p || q) is the Kullback-Leiber distance between 2 probability, distributions, is relative entropy. Not a real measure as its not symmetric. wherever infinity is present, we reduce it to zeros

See also: entropy conditionalentropy