X-Nico

4 unusual facts about Markov process


Halil Mete Soner

Soner co-authored a book, with Wendell Fleming, on viscosity solutions and stochastic control; Controlled Markov Processes and Viscosity Solutions (Springer-Verlag) in 1993, which was listed among the most-cited articles on computer science by Thomson Science in 2004.

Hidden semi-Markov model

A hidden semi-Markov model (HSMM) is a statistical model with the same structure as a hidden Markov model except that the unobservable process is semi-Markov rather than Markov.

Markov process

The credited writer of the song, lead singer and current UCLA professor Greg Graffin, has a Ph.D. in zoology and degrees in anthropology and geology.

The band Bad Religion has a song titled "The Markovian Process" on their album Stranger Than Fiction.


Prefetch input queue

# M/M/1 Model (Single Queue Single Server/ Markov process): In this model, elements of queue are served on first-come, first-served basis.

Here the service time distribution is no longer a Markov process.

Time-inhomogeneous hidden Bernoulli model

Contrary to HMM, the state transition process in TI-HBM is not a Markov-dependent process, rather it is a generalized Bernoulli (an independent) process.


see also

Mixing time

Markov chain mixing time, the time to achieve a level of homogeneity in the probability distribution of a state in a Markov process.