Limit search to available items
Book Cover
E-book
Author Vovk, Vladimir, 1960-

Title Algorithmic learning in a random world / Vladimir Vovk, Alexander Gammerman, Glenn Shafer
Edition 2nd ed
Published Cham : Springer, 2022

Copies

Description 1 online resource (490 p.)
Contents Intro -- Contents -- Preface to the Second Edition -- Preface to the First Edition -- Notation and Abbreviations -- Sets, Bags, and Sequences -- Stochastics -- Machine Learning -- Programming -- Confidence Prediction -- Other Notations -- Abbreviations -- 1 Introduction -- 1.1 Machine Learning -- 1.1.1 Learning Under Randomness -- 1.1.2 Learning Under Unconstrained Randomness -- 1.2 A Shortcoming of Statistical Learning Theory -- 1.2.1 The Hold-Out Estimate of Confidence -- 1.2.2 The Contribution of This Book -- 1.3 The Online Framework -- 1.3.1 Online Learning
1.3.2 Online/Offline Compromises -- 1.3.3 One-Off and Offline Learning -- 1.3.4 Induction, Transduction, and the Online Framework -- 1.4 Conformal Prediction -- 1.4.1 Nested Prediction Sets -- 1.4.2 Validity -- 1.4.3 Efficiency -- 1.4.4 Conditionality -- 1.4.5 Flexibility of Conformal Predictors -- 1.5 Probabilistic Prediction Under Unconstrained Randomness -- 1.5.1 Universally Consistent Probabilistic Predictor -- 1.5.2 Probabilistic Prediction Using a Finite Dataset -- 1.5.3 Venn Prediction -- 1.5.4 Conformal Predictive Distributions -- 1.6 Beyond Randomness -- 1.6.1 Testing Randomness
1.6.2 Online Compression Models -- 1.7 Context -- Part I Set Prediction -- 2 Conformal Prediction: General Case and Regression -- 2.1 Confidence Predictors -- 2.1.1 Assumptions -- 2.1.2 Simple Predictors and Confidence Predictors -- 2.1.3 Validity -- 2.1.4 Randomized Confidence Predictors -- 2.1.5 Confidence Predictors Over a Finite Horizon -- 2.1.6 One-Off and Offline Confidence Predictors -- 2.2 Conformal Predictors -- 2.2.1 Bags -- 2.2.2 Nonconformity and Conformity -- 2.2.3 p-Values -- 2.2.4 Definition of Conformal Predictors -- 2.2.5 Validity -- 2.2.6 Smoothed Conformal Predictors
2.2.7 Finite-Horizon Conformal Prediction -- 2.2.8 One-Off and Offline Conformal Predictors -- 2.2.9 General Schemes for Defining Nonconformity -- Conformity to a Bag -- Conformity to a Property -- 2.2.10 Deleted Conformity Measures -- 2.3 Conformalized Ridge Regression -- 2.3.1 Least Squares and Ridge Regression -- 2.3.2 Basic CRR -- 2.3.3 Two Modifications -- 2.3.4 Dual Form Ridge Regression -- 2.4 Conformalized Nearest Neighbours Regression -- 2.5 Efficiency of Conformalized Ridge Regression -- 2.5.1 Hard and Soft Models -- 2.5.2 Bayesian Ridge Regression -- 2.5.3 Efficiency of CRR
2.6 Are There Other Ways to Achieve Validity? -- 2.7 Conformal Transducers -- 2.7.1 Definitions and Properties of Validity -- 2.7.2 Normalized Confidence Predictors and Confidence Transducers -- 2.8 Proofs -- 2.8.1 Proof of Theorem 2.2 -- 2.8.2 Proof of Theorem 2.7 -- Regularizing the Rays in Upper CRR -- Proof Proper -- 2.8.3 Proof of Theorem 2.10 -- 2.9 Context -- 2.9.1 Exchangeability vs Randomness -- 2.9.2 Conformal Prediction -- 2.9.3 Two Equivalent Definitions of Nonconformity Measures -- 2.9.4 The Two Meanings of Conformity in Conformal Prediction
Summary This book is about conformal prediction, an approach to prediction that originated in machine learning in the late 1990s. The main feature of conformal prediction is the principled treatment of the reliability of predictions. The prediction algorithms described conformal predictors are provably valid in the sense that they evaluate the reliability of their own predictions in a way that is neither over-pessimistic nor over-optimistic (the latter being especially dangerous). The approach is still flexible enough to incorporate most of the existing powerful methods of machine learning. The book covers both key conformal predictors and the mathematical analysis of their properties. Algorithmic Learning in a Random World contains, in addition to proofs of validity, results about the efficiency of conformal predictors. The only assumption required for validity is that of "randomness" (the prediction algorithm is presented with independent and identically distributed examples); in later chapters, even the assumption of randomness is significantly relaxed. Interesting results about efficiency are established both under randomness and under stronger assumptions. Since publication of the First Edition in 2005 conformal prediction has found numerous applications in medicine and industry, and is becoming a popular machine-learning technique. This Second Edition contains three new chapters. One is about conformal predictive distributions, which are more informative than the set predictions produced by standard conformal predictors. Another is about the efficiency of ways of testing the assumption of randomness based on conformal prediction. The third new chapter harnesses conformal testing procedures for protecting machine-learning algorithms against changes in the distribution of the data. In addition, the existing chapters have been revised, updated, and expanded
Notes 2.9.5 Examples of Nonconformity Measures
Online resource; title from PDF title page (SpringerLink, viewed January 6, 2023)
Subject Prediction theory.
Algorithms.
Stochastic processes.
algorithms.
Algorithms
Prediction theory
Stochastic processes
Teoria de la predicci��
Algorismes.
Processos estoc��stics.
Genre/Form Llibres electr��nics.
Form Electronic book
Author Gammerman, A. (Alexander)
Shafer, Glenn, 1946-
ISBN 9783031066498
3031066499