It was originally introduced by Solomon Kullback and Richard Leibler in 1951 as the directed divergence between two distributions.
The inequality in the above form was proved independently by Kullback, Csiszár, and Kemperman.
He learned at Bletchley Park that the British were producing intelligence of high quality by exploiting the Enigma machine.
Solomon Islands | Solomon R. Guggenheim Museum | Solomon | Solomon Burke | King Solomon | Solomon R. Guggenheim Foundation | Solomon Feferman | Solomon Islands campaign | In Search of King Solomon's Mines | Gizo, Solomon Islands | Solomon River | Key of Solomon | Judgment of Solomon | Vila, Solomon Islands | Solomon's Temple | Solomon R. Guggenheim | Solomon Juneau | Solomon Joachim Halberstam | Solomon ibn Gabirol | Robert C. Solomon | Prabhu Solomon | Stacey Solomon | Solomon Schechter High School of New York | Solomon Schechter | Solomon River (Alaska) | Solomon Northup | Solomon Nason | Solomon L. Hoge | Solomon L. | Solomon Joel |