Madhira, Sivaprasad; Deshmukh, Shailaja - 2023
Basics of Stochastic Processes -- Markov Chains -- Long-run Behaviour of Markov Chains -- Random Walks -- Bienayme …This textbook presents some basic stochastic processes, mainly Markov processes. It begins with a brief introduction to … the framework of stochastic processes followed by the thorough discussion on Markov chains, which is the simplest and the …