In this course, the concept of stochastic process is introduced. Markov processes in discrete and continuous time with discrete and continuous state space are defined and several examples using ...