Markov processes.

Continuous-time Markov decision processes: theory and applications Guo, Xianping 2009 Deterministic and stochastic optimal control Fleming, Wendell Helms 1975 Elements of the theory of Markov processes and their applications Bharucha-Reid, A. T. 1960 Estimating the parameters of the Markov probability model from aggregate time series data Lee, T. C. 1977 Excessive measures Getoor, R. K. 1990 Feature selection based on markov blankets for the text classification problem Sameen Maruf 2014 Finite Markov chains Kemeny, John G. 1976 Handbook of markov chain monte carlo Brooks, Steve...et.al 2011 Hidden Markov and other models for discrete-valued time series MacDonald, Iain L. 1997 Markov chains and decision processes for engineers and managers Sheskin, Theodore J. 2011 Markov chains, theory and applications Isaacson, Dean L. 1976 Markov chains Freedman, David 1971 Markov processes for stochastic modeling Kijima, Masaaki 1997 Queueing networks and Markov chains: modeling and performance evaluation with computer science applications Gunter Bolch 2006 Recent developments in Markov decision processes edited by R. Hartley, L.C. Thomas, D.J. White 1980 Statistical analysis of behavioural data Haccou, Patsy 1992 The theory of branching processes Harris, Theodore Edward 1989