An Information-Theoretic Definition of Similarity

Similarity is an important and widely used con-cept. Previous definitions of similarity are tied to a particular application or a form of knowl-edge representation. We present an information-theoretic definition of similarity that is applica-ble as long as there is a probabilistic model. We demonstrate how our definition can be used to measure the similarity in a number of different domains. 1