We used base 2 for the logarithm in Equation 1 to produce MI results in units of bits. In Equation 1, the marginal discrete distributions pi,t(x) and pi,t(y) are found by summing over the other variable:(2)pi,t(x)=∑ypi,t(x,y), pi,t(y)=∑xpi,t(x,y).