This interdisciplinary book defines reachability in the stochastic framework, covering such concepts as stochastic reachability based on Markov process theory; martingale methods; stochastic reachability as an optimal stopping problem and dynamic programming.

Stochastic reachability analysis (SRA) is a method of analyzing the behavior of control systems which mix discrete and continuous dynamics. For probabilistic discrete systems it has been shown to be a practical verification method but for stochastic hybrid systems it can be rather more. As a verification technique SRA can assess the safety and performance of, for example, autonomous systems, robot and aircraft path planning and multi-agent coordination but it can also be used for the adaptive control of such systems. Stochastic Reachability Analysis of Hybrid Systems is a self-contained and accessible introduction to this novel topic in the analysis and development of stochastic hybrid systems. Beginning with the relevant aspects of Markov models and introducing stochastic hybrid systems, the book then moves on to coverage of reachability analysis for stochastic hybrid systems. Following this build up, the core of the text first formally defines the concept of reachability in the stochastic framework and then treats issues representing the different faces of SRA: • stochastic reachability based on Markov process theory; • martingale methods; • stochastic reachability as an optimal stopping problem; and • dynamic programming. The book is rounded off by an appendix providing mathematical underpinning on subjects such as ordinary differential equations, probabilistic measure theory and stochastic modeling, which will help the non-expert-mathematician to appreciate the text. Stochastic Reachability Analysis of Hybrid Systems characterizes a highly interdisciplinary area of research and is consequently of significant interest to academic researchers and graduate students from a variety of backgrounds in control engineering, applied mathematics and computer science. The Communications and Control Engineering series reports major technological advances which have potential for great impact in the fields of communication and control. It reflects research inindustrial and academic institutions around the world so that the readership can exploit new possibilities as they become available.

Provides the reader with state-of-the-art treatment of a powerful new technique for the analysis and control of hybrid systems Coverage of open gives researchers a solid grounding for future work Uses case studies to demonstrate how practising engineers can construct more flexible, reliable and robust systems based on the theory presented Includes supplementary material: sn.pub/extras

Autorentext

Between June 2002 and January 2005, Doctor Bujorianu was a research associate in the Control Group, at the Department of Engineering at the University of Cambridge. After this appointment she remained in the Department as a research visitor for six months. During her appointment at Cambridge, she was involved in two European projects on hybrid systems: the IST-2001-38314 project COLUMBUS: "Design of Embedded Controllers for Safety Critical Systems" (partners: INRIA, University of Berkeley, PARADES (Rome), etc. http www.columbus.gr); and the IST-2001-32460 project HYBRIDGE: "Distributed Control and Stochastic Analysis of Hybrid Systems Supporting Safety Critical Real-Time Systems Design" (partners: National Aerospace Laboratory-NLR Amsterdam, BAE UK, Eurocontrol, AEA Technology, CENA, etc. http: www.nlr.nl/public/hosted-sites/hybridge) From November 2005 to June 2008 Doctor Bujorianu was a Research Associate with the Formal Methods and Tools Group at the Faculty of Mathematics and Computer Science, University of Twente, the Netherlands. Her research was funded by the NOW project AiSHA "Abstraction in Stochastic and Hybrid Process Algebra". During her appointment with University of Twente, she was also involved in the German-Dutch project VOSS. Since June 2008 Manuela Bujorianu has been a Research Associate with the Centre for Interdisciplinary Computational and Dynamical Analysis (CICADA) at the University of Manchester in the UK.

Inhalt
The Need for Interdisciplinarity in Modern Systems Engineering.- Markov Models.- Randomness Issues when Modeling Hybrid Systems.- Stochastic Hybrid Systems.- Reachability Analysis for Deterministic Hybrid Systems.- Stochastic Reachability Problems.- Different Methodologies for Stochastic Reachability.- Stochastic Reachability Based on Markov Process Theory.- Martingale Methods.- Stochastic Reachability as an Optimal Stopping Problem.- Dynamic Programming Approach to Stochastic Reachability.- Applications to Autonomous Systems.- Applications of Stochastic Reachability in Air-traffic Management.