An update of this popular introduction to probability theory and information theory with new material on Markov chains.