{"product_id":"topics-in-the-constructive-theory-of-countable-markov-chains-paperback-9780521064477","title":"Topics in the Constructive Theory of Countable Markov Chains (Paperback \/ softback) 9780521064477","description":"\u003cfont face=\"Georgia\"\u003e\r\n\u003cp\u003e\u003cfont size=\"6\"\u003eTopics in the Constructive Theory of Countable Markov Chains\u003c\/font\u003e\u003cbr\u003e\r\n\r\n\r\n\u003c\/p\u003e\n\u003cp\u003e\u003cem\u003eProvides methods of analysing Markov chains based on Lyapunov functions.\u003c\/em\u003e\u003c\/p\u003e\r\n\r\n\r\n\u003cp\u003e\u003cfont size=\"4\"\u003eG. Fayolle (Author), V. A. Malyshev (Author), M. V. Menshikov (Author)\u003c\/font\u003e\u003c\/p\u003e\r\n\r\n\u003cp\u003e\u003cfont size=\"3\"\u003e9780521064477, Cambridge University Press\u003c\/font\u003e\u003c\/p\u003e\r\n\r\n\u003cp\u003e\u003cfont size=\"3\"\u003ePaperback \/ softback, published 5 June 2008\u003c\/font\u003e\u003c\/p\u003e\r\n\r\n\u003cp\u003e\u003cfont size=\"3\"\u003e180 pages, 17 b\/w illus.\u003cbr\u003e22.9 x 15.2 x 1.1 cm, 0.27 kg\u003c\/font\u003e\u003c\/p\u003e\r\n\r\n\r\n\r\n\u003cp align=\"justify\"\u003e\u003cem\u003e\u003cfont size=\"3\"\u003eReview of the hardback: 'The monograph is an excellent piece of work that gives an original and alternative view on countable Markov chains.' Mededelingen van het Wiskundig Genootschap\u003c\/font\u003e\u003c\/em\u003e\u003c\/p\u003e\r\n\r\n\u003cp align=\"justify\"\u003e\u003cstrong\u003e\u003cfont size=\"3\"\u003eMarkov chains are an important idea, related to random walks, which crops up widely in applied stochastic analysis. They are used, for example, in performance modelling and evaluation of computer networks, queuing networks, and telecommunication systems. The main point of the present book is to provide methods, based on the construction of Lyapunov functions, of determining when a Markov chain is ergodic, null recurrent, or transient. These methods can also be extended to the study of questions of stability. Of particular concern are reflected random walks and reflected Brownian motion. The authors provide not only a self-contained introduction to the theory but also details of how the required Lyapunov functions are constructed in various situations.\u003c\/font\u003e\u003c\/strong\u003e\u003c\/p\u003e\r\n\r\n\u003cp\u003e\u003cfont size=\"3\"\u003eIntroduction and history\u003cbr\u003e 1. Preliminaries\u003cbr\u003e 2. General criteria\u003cbr\u003e 3. Explicit construction of Lyapunov functions\u003cbr\u003e 4. Ideology of induced chains\u003cbr\u003e 5. Random walks in two dimensional complexes\u003cbr\u003e 6. Stability\u003cbr\u003e 7. Exponential convergence and analyticity for ergodic Markov chains\u003cbr\u003e Bibliography.\u003c\/font\u003e\u003c\/p\u003e\r\n\r\n\u003cp\u003e\u003cfont size=\"3\"\u003eSubject Areas: Probability \u0026amp; statistics [\u003ca title=\"See our other books on Probability \u0026amp; statistics\" href=\"https:\/\/freshlyprintedbooks.co.uk\/search?q=%22Probability%20\u0026amp;%20statistics%20%5BPBT%5D%22\"\u003ePBT\u003c\/a\u003e]\u003c\/font\u003e\u003c\/p\u003e\r\n\r\n\r\n\u003c\/font\u003e","brand":"Cambridge University Press","offers":[{"title":"Default Title","offer_id":46006295986456,"sku":"9780521064477","price":40.99,"currency_code":"GBP","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0730\/2037\/5320\/products\/9780521064477i.jpg?v=1694969033","url":"https:\/\/freshlyprintedbooks.co.uk\/products\/topics-in-the-constructive-theory-of-countable-markov-chains-paperback-9780521064477","provider":"Freshly Printed Books","version":"1.0","type":"link"}