Average customer rating:
|
Learning Bayesian Networks
Richard E. Neapolitan Manufacturer: Prentice Hall ProductGroup: Book Binding: Hardcover Similar Items:
ASIN: 0130125342 |
Customer Reviews:
An excellent overview.......2004-05-17
The author defines a Bayesian network as a graphical structure for representing the probabilistic relationship among a large number of variables and for performing probabilistic inference with these variables. Before the advent of Bayesian networks, probabilistic inference depended on the use of Bayes' theorem, which entailed that the problems examined be relatively simple, due to the exponential space and time complexity that can arise in the application of this theorem.
After a short review of probability theory in chapter 1, a discussion of the "philosophical" foundations of probability, and a discussion of the difficulties inherent in representing large instances and in performing inference over a large number of variables, the author introduces Bayesian networks as directed acyclic graphs satisfying the Markov condition. A brief discussion of NasoNet, which is a large-scale Bayesian network used in the diagnosis and prognosis of nasopharyngeal cancer, is given. The author then shows in detail how to create Bayesian networks using causal edges, introducing in the process the notion of manipulating variables and the notion of a causation between two variables. An interesting example of manipulation is given in the context of pharmaceuticals, and an example of bad manipulation is given.
Chapter 2 addresses the nature of dependencies in DAGs via the concept of `faithfulness' and entailed conditional independencies. Very important in this chapter is the notion of `d-separation', which identifies all and only those conditional independencies entailed by the Markov condition for G. An explicit algorithm is given for finding d-separations. D-separation is used to define a notion of Markov equivalence between DAGs containing the same set of nodes. Also discussed is the minimality condition, wherein a DAG will not satisfy the Markov condition with respect to a probability distribution if an edge is removed from it. The author shows every probability distribution satisfies the minimality condition with some DAG. The notion of a `Markov blanket' is introduced, which measures the extent to which the instantiation of a set of nodes close to a particular node can shield the node from the effect of all other nodes. A Markov boundary of a random variable is then defined as a Markov blanket such that none of its proper subsets is a Markov blanket of the random variable. The utility of these concepts lies in the fact that the set of all parents of each variable X, children of X, and parents of children of X are the unique Markov boundary of X, if the DAG satisfies the faithfulness condition.
Inference in Bayesian networks is the topic of chapter 3, with Pearl's message-passing algorithm starting off the discussion for the case of discrete random variables. This algorithm, which applies for Bayesian networks whose DAGs are trees, is based on a theorem, whose statement takes well over a page, and whose proof covers five pages. The author gives detailed examples though, and these are very helpful in understanding the algorithm. The Pearl algorithm is then generalized to singly and multiply connected networks. After a discussion of the computational complexity of the algorithm, the author then overviews the `noisy OR-gate model', which is a model whose complexity is manageable, since each variable in the model has only two values. The author then moves on to doing inference using an approach, called `symbolic probabilistic inference' that approximates finding the optimal way to compute marginal distributions of interest from the joint probability distribution. This algorithm involves a number of multiplications in order to compute the marginal probability. To minimize the computational effort, it would be advantageous to minimize the number of these multiplications, and so the author discusses the `optimal factoring problem', which, once solved for a given factoring instance, will give a factorization that requires a minimal number of multiplications. What follows after this is a very interesting discussion of the relationship of human reasoning to Bayesian networks. This is done via the introduction of the `causal network model', and the author then, quite unexpectedly, overviews the research on the testing of human subjects so as to test the accuracy of the model. These testing studies included those that involve inference based on `discounting', which measures to what degree an individual becomes less confident in the cause when told that a different cause of the effect was present. Another discussed is one that involves larger networks in the context of traffic congestion. This is followed by a discussion of a study of causal reasoning in the context of the debugging of programs.
Inference algorithms are studied for the case of continuous variables in chapter four. After a review of the normal probability distribution, the author discusses an inference algorithm for the case of Gaussian Bayesian networks. An algorithm for doing inference with continuous variables for singly connected Bayesian networks is given, that allows the determination of expected value and variance of each node conditioned on specified values of nodes in some subset. This is followed by several detailed and helpful examples of inference in continuous variables. As expected, issues with computational complexity arise, and so the author discusses approximate inference, via the method of stochastic simulation, which involves a classical sampling method called `logic sampling.' This is then followed by a discussion of likelihood weighting, which cures some of the problems involved with logic sampling. Abductive inference, so important in contemporary applications, is then discussed in detail.
Enjoying this book enormously.......2004-01-04
Average customer rating:
|
Machine Learning
Tom M. Mitchell Manufacturer: McGraw-Hill Science/Engineering/Math ProductGroup: Book Binding: Hardcover Similar Items:
ASIN: 0070428077 |
Book Description
This exciting addition to the McGraw-Hill Series in Computer Science focuses on the concepts and techniques that contribute to the rapidly changing field of machine learning--including probability and statistics, artificial intelligence, and neural networks--unifying them all in a logical and coherent manner. Machine Learning serves as a useful reference tool for software developers and researchers, as well as an outstanding text for college students.Customer Reviews:
Outstanding.......2007-09-12
Great Start to Machine Learning.......2007-08-27
Best book I've seen on topic.......2007-01-31
too expensive I would say.......2006-10-13
Excellent book, concise and readable.......2006-06-22
Average customer rating:
|
Bayesian Artificial Intelligence (Chapman & Hall/Crc Computer Science and Data Analysis)
Kevin B. Korb , and Ann E. Nicholson Manufacturer: Chapman & Hall/CRC ProductGroup: Book Binding: Hardcover Similar Items:
ASIN: 1584883871 |
Book Description
With Bayesian network technology very much on the up-swing in industry and government, there is an increasing need for an introductory book that jointly emphasizes the understanding of its underlying priniciples and their application in practice. Bayesian Artificial Intelligence presents elements of Bayesian network technology, automated causal discovery, and learning probabilities from data along with extensive motivational examples of using these technologies to develop probabilistic expert systems. This practical, very accessible introduction balances the causal discovery of networks with the Bayesian inference procedures that use a network once it is found. The authors emphasize understanding and intuition, so they keep the mathematical details to a minimum, but also provide the algorithms and technical background needed for applications. They illustrate at length a number of applications and discuss application software in detail. A broad range of topics, a practical perspective, and a thoughtful discussion of philosophical underpinnings make Bayesian Artificial Intelligence an ideal introduction for students and for professionals who want to broaden their expertise. It provides the knowledge you need to put Bayesian network tools into practice, while also forming the basis for a more detailed investigation of the technology and original research.
Customer Reviews:
Very good introduction in causal Modeling.......2006-03-09
Excellent Introductory Text.......2004-12-17
Bayesian Networks for Undergrads and Practicioners.......2004-01-12
Average customer rating:
|
Bayesian Networks and Decision Graphs (Information Science and Statistics)
Finn V. Jensen , and Thomas D. Nielsen Manufacturer: Springer ProductGroup: Book Binding: Hardcover Similar Items:
Accessories:
ASIN: 0387682813 |
Book Description
Probabilistic graphical models and decision graphs are powerful modeling tools for reasoning and decision making under uncertainty. As modeling languages they allow a natural specification of problem domains with inherent uncertainty, and from a computational perspective they support efficient algorithms for automatic construction and query answering. This includes belief updating, finding the most probable explanation for the observed evidence, detecting conflicts in the evidence entered into the network, determining optimal strategies, analyzing for relevance, and performing sensitivity analysis.
The book introduces probabilistic graphical models and decision graphs, including Bayesian networks and influence diagrams. The reader is introduced to the two types of frameworks through examples and exercises, which also instruct the reader on how to build these models.
The book is a new edition of Bayesian Networks and Decision Graphs by Finn V. Jensen. The new edition is structured into two parts. The first part focuses on probabilistic graphical models. Compared with the previous book, the new edition also includes a thorough description of recent extensions to the Bayesian network modeling language, advances in exact and approximate belief updating algorithms, and methods for learning both the structure and the parameters of a Bayesian network. The second part deals with decision graphs, and in addition to the frameworks described in the previous edition, it also introduces Markov decision processes and partially ordered decision problems. The authors also
The book is intended as a textbook, but it can also be used for self-study and as a reference book.
Customer Reviews:
Good Book.......2006-03-01
A very good introduction to Bayesian networks.......2003-06-15
The aspect of Bayesian networks that I find most attractive is the fact that there is a "rational" way of designing a network, based on hypothesis, informational, and mediating variables, and their "causal" relationships. Unlike neural networks in which one is almost forced to guess the appropriate structure of the network, every node in a Bayesian network correpsonds with a state or quantity that can be measured either directly or indirectly through other variables. Thus, changes in a system model should only induce local changes in a Bayesian network, where as system changes might require the design and training of an entirely new neural network.
Another aspect of Bayesian networks that I find very compelling is the way in which they seem quite amendable to learning and the presentation of new evidence. This is true since knowledge updating is done locally (through variables), while the effects of those changes are witnessed globally through appropriate belief-updating algorithms.
On the downside, it should be noted that the operation of belief-updating is in general NP-hard, thus there exists a valid concern about the computational efficiency of Bayesian networks. Contrast this with the fact that once a nueral network has been trained, it is quite easy to compute. One would hope that these concerns will subside with more research, for the above mentioned benefits of Bayesian networks leads me to believe that these networks will have quite an influence on the future directions of machine learning.
Although this book will not go down in history as the definitive reference for Bayesian networks, it serves as a good conduit for explaining this quite interesting area of learning at a time when such few complete and modern references exist.
A lot about very little.......2003-05-06
Accessible introduction to Bayesian Networks.......2003-01-21
Prerequisites of the book as stated in the preface include Graph Theory and Calculus, both at introductory level. I personally did not have exposure to Graph theory, but I was able to understand most of the material without any help. Necessary probability theory is developed, but basic probability knowledge is also a prerequisite to digest the material to a reader without prior exposure of Probability as it shapes the core of the material in the book.
The strength of this text is in Part I where the author provides several examples to illustrate use of Bayesian Networks, Influence Diagrams and other models. I find it useful Influence Diagram as an extension of Bayesian Networks.
Most answers to Exercises at the end of each chapter are provided at the author's homepage, except answers of the last chapter. Answers that require graphical modeling software are also provided in Hugin format. (Hugin Lite can be downloaded from Hugin site.)
The downsides are that writing of the text is somewhat awkward, obscuring readers from understanding, that model building chapter could have been discussed more thoroughly, that material in Learning is barely present, and that definitions are sometimes not introduced upon the first encounter but they appear later in chapters. More different and complex examples could have been discussed to illustrate the material. Note: the author provides a page for Learning at his homepage.
Although this is an introduction to Bayesian Networks and Influence Diagrams, a reader should be equipped with some level of abstract thinking in order to digest the material.
This book is suitable for self-study. It has motivations for the uninitiated. References are provided at the end of the book and I was able to find some of them online. A notable is "A tutorial on Learning with Bayesian Networks" by Heckerman, to fill in the part of Learning in this book.
Other books at this level from users' perspective are:
Edwards, Introduction to Graphical Modeling (Utilizes software MIM.)
Clemen, et al., Making Hard Decisions (Uses Palisade Decision Tools suite. The book discusses Influence Diagrams but not Bayesian Networks.)
Further studies after completion of this book include:
Cowell, et al., Probabilistic Networks and Expert Systems
Lauritzen, Graphical Models
Pearl, Probabilistic Reasoning in Intelligent Systems
Pearl, Causality
Not worth the money.......2002-12-31
Average customer rating:
|
Data Mining and Knowledge Discovery Handbook
Manufacturer: Springer ProductGroup: Book Binding: Hardcover Similar Items:
ASIN: 0387244352 |
Book Description
Data Mining and Knowledge Discovery Handbook organizes all major concepts, theories, methodologies, trends, challenges and applications of data mining (DM) and knowledge discovery in databases (KDD) into a coherent and unified repository.
This book first surveys, then provides comprehensive yet concise algorithmic descriptions of methods, including classic methods plus the extensions and novel methods developed recently. This volume concludes with in-depth descriptions of data mining applications in various interdisciplinary industries including finance, marketing, medicine, biology, engineering, telecommunications, software, and security.
Data Mining and Knowledge Discovery Handbook is designed for research scientists and graduate-level students in computer science and engineering. This book is also suitable for professionals in fields such as computing applications, information systems management, and strategic research management.
Customer Reviews:
A great handbook for data mining.......2006-04-12
Average customer rating: |
Advanced Methods for Knowledge Discovery from Complex Data (Advanced Information and Knowledge Processing)
Manufacturer: Springer ProductGroup: Book Binding: Hardcover ASIN: 1852339896 |
Book Description
This book brings together research articles by active practitioners and leading researchers reporting recent advances in the field of knowledge discovery. An overview of the field, looking at the issues and challenges involved is followed by coverage of recent trends in data mining. This provides the context for the subsequent chapters on methods and applications. Part I is devoted to the foundations of mining different types of complex data like trees, graphs, links and sequences. A knowledge discovery approach based on problem decomposition is also described. Part II presents important applications of advanced mining techniques to data in unconventional and complex domains, such as life sciences, world-wide web, image databases, cyber security and sensor networks. With a good balance of introductory material on the knowledge discovery process, advanced issues and state-of-the-art tools and techniques, this book will be useful to students at Masters and PhD level in Computer Science, as well as practitioners in the field.
Average customer rating: |
Advances in Bayesian Networks (Studies in Fuzziness and Soft Computing)
Manufacturer: Springer ProductGroup: Book Binding: Hardcover ASIN: 3540208763 |
Book Description
In recent years probabilistic graphical models, especially Bayesian networks and decision graphs, have experienced significant theoretical development within areas such as artificial intelligence and statistics. This carefully edited monograph is a compendium of the most recent advances in the area of probabilistic graphical models such as decision graphs, learning from data and inference. It presents a survey of the state of the art of specific topics of recent interest of Bayesian Networks, including approximate propagation, abductive inferences, decision graphs, and applications of influence. In addition, Advances in Bayesian Networks presents a careful selection of applications of probabilistic graphical models to various fields such as speech recognition, meteorology or information retrieval.
Average customer rating: |
Adaptive Learning of Polynomial Networks: Genetic Programming, Backpropagation and Bayesian Methods (Genetic and Evolutionary Computation)
Nikolay Nikolaev , and Hitoshi Iba Manufacturer: Springer ProductGroup: Book Binding: Hardcover ASIN: 0387312390 |
Book Description
This book delivers theoretical and practical knowledge for developing algorithms that infer linear and non-linear multivariate models, providing a methodology for inductive learning of polynomial neural network models (PNN) from data. The text emphasizes an organized model identification process by which to discover models that generalize and predict well. The empirical investigations detailed here demonstrate that PNN models evolved by genetic programming and improved by backpropagation are successful when solving real-world tasks.
Adaptive Learning of Polynomial Networks is a vital reference for researchers and practitioners in the fields of evolutionary computation, artificial neural networks and Bayesian inference, and for advanced-level students of genetic programming. Readers will strengthen their skills in creating efficient model representations and learning operators that efficiently sample the search space, and in navigating the search process through the design of objective fitness functions.
Average customer rating:
|
Bayesian Learning for Neural Networks (Lecture Notes in Statistics)
Radford M. Neal Manufacturer: Springer ProductGroup: Book Binding: Paperback Similar Items:
ASIN: 0387947248 |
Book Description
Artificial "neural networks" are widely used as flexible models for classification and regression applications, but questions remain about how the power of these models can be safely exploited when training data is limited. This book demonstrates how Bayesian methods allow complex neural network models to be used without fear of the "overfitting" that can occur with traditional training methods. Insight into the nature of these complex Bayesian models is provided by a theoretical investigation of the priors over functions that underlie them. A practical implementation of Bayesian neural network learning using Markov chain Monte Carlo methods is also described, and software for it is freely available over the Internet. Presupposing only basic knowledge of probability and statistics, this book should be of interest to researchers in statistics, engineering, and artificial intelligence.Customer Reviews:
Excellent book on neural networks and Bayesian methods.......1997-08-24
Average customer rating: |
Advanced Intelligent Computing Theories and Applications - With Aspects of Theoretical and Methodological Issues: Third International Conference on Intelligent ... Science) (Lecture Notes in Computer Science)
Manufacturer: Springer ProductGroup: Book Binding: Paperback ASIN: 3540741704 |
Product Description
This book - in conjunction with the two volumes CICS 0002 and LNAI 4682 - constitutes the refereed proceedings of the Third International Conference on Intelligent Computing, ICIC 2007, held in Qingdao, China in August 2007.
The 139 revised full papers were carefully reviewed and selected from 2875 submissions. The papers are organized in topical sections on biological and quantum computing, intelligent financial engineering, intelligent agent and web applications, intelligent sensor networks, intelligent control and automation, intelligent data fusion and security, natural language processing and expert systems, intelligent image/document retrievals, intelligent computing in bioinformatics, intelligent computing in signal processing, intelligent computing in pattern recognition, and intelligent computing in communication.
Books:
Recommended Books