This manuscript is a supplement to the machine learning course at JSMP Medical Physics Summer School held in 2019. The idea of Kulbuck-Leibler divergence, a key concept in machine learning, is introduced with mutual information.
Keywords: KL divergence; machine learning; mathematics; mutual information.