Français
4. Markov chain applications
The applications of Markov chains are extremely varied, and it is of course out of the question to mention them all (see, for example, and ). We will therefore restrict ourselves to a few examples to highlight widely-used algorithmic procedures.
4.1 Hastings-Metropolis algorithm
Let E be a countable space. We wish to find a procedure for simulating a random variable with a law λ that can always be assumed to be strictly positive, this law being known to within one multiplicative constant, for example a Gibbs measure of the form
The Ultimate Scientific and Technical Reference
This article is included in
Mathematics
This offer includes:
Knowledge Base
Updated and enriched with articles validated by our scientific committees
Services
A set of exclusive tools to complement the resources
Practical Path
Operational and didactic, to guarantee the acquisition of transversal skills
Doc & Quiz
Interactive articles with quizzes, for constructive reading
Markov chain applications
Bibliography
References
The Ultimate Scientific and Technical Reference
