出典:Wikipedia
出典:『Wikipedia』 (2011/03/08 14:45 UTC 版)
In information theory, the cross entropy between two probability distributions measures the average number of bits needed to identify an event from a set of possibilities, if a coding scheme is used based on a given probability distribution q, rather than the "true" distribution p.