Introduction to Stochastic Processes Using R
Deshmukh, Shailaja / Madhira, Sivaprasad
This textbook presents some basic stochastic processes, mainly Markov processes. It begins with a brief introduction to the framework of stochastic processes followed by the thorough discussion on Markov chains, which is the simplest and the most important class of stochastic processes. The book then elaborates the theory of Markov chains in detail including classification of states, the first passage distribution, the concept of periodicity a...