Logic for Learning: Learning Comprehensible Theories from Structured Data

Front Cover
Springer Science & Business Media, 2003 M08 6 - 257 pages
This book is concerned with the rich and fruitful interplay between the fields of computational logic and machine learning. The intended audience is senior undergraduates, graduate students, and researchers in either of those fields. For those in computational logic, no previous knowledge of machine learning is assumed and, for those in machine learning, no previous knowledge of computational logic is assumed. The logic used throughout the book is a higher-order one. Higher-order logic is already heavily used in some parts of computer science, for example, theoretical computer science, functional programming, and hardware verifica tion, mainly because of its great expressive power. Similar motivations apply here as well: higher-order functions can have other functions as arguments and this capability can be exploited to provide abstractions for knowledge representation, methods for constructing predicates, and a foundation for logic-based computation. The book should be of interest to researchers in machine learning, espe cially those who study learning methods for structured data. Machine learn ing applications are becoming increasingly concerned with applications for which the individuals that are the subject of learning have complex struc ture. Typical applications include text learning for the World Wide Web and bioinformatics. Traditional methods for such applications usually involve the extraction of features to reduce the problem to one of attribute-value learning.

From inside the book

Contents

Introduction
3
12 Setting the Scene
7
13 Introduction to Learning
12
14 Introduction to Logic
18
Bibliographical Notes
29
Logic
33
22 Type Substitutions
37
23 Terms
40
Bibliographical Notes
129
Exercises
130
Predicates
133
42 Standard Predicates
141
43 Regular Predicates
148
44 Predicate Rewrite Systems
153
45 The Implication Preorder
160
46 Efficient Construction of Predicates
165

24 Subterms
47
25 Term Substitutions
57
26 AConversion
66
27 Model Theory
74
28 Proof Theory
78
Bibliographical Notes
81
Exercises
82
Individuals
85
32 Normal Terms
91
33 An Equivalence Relation on Normal Terms
95
34 A Total Order on Normal Terms
97
35 Basic Terms
99
36 Metrics on Basic Terms
107
37 Kernels on Basic Terms
117
Bibliographical Notes
177
Exercises
178
Computation
185
52 Definitions of Some Basic Functions
190
53 Programming with Abstractions
195
Bibliographical Notes
205
Learning
209
62 Illustrations
216
Exercises
243
A Appendix
245
References
247
Notation
253
Index
255
Copyright

Other editions - View all

Common terms and phrases

About the author (2003)

John Lloyd produced Not the Nine O'Clock New, the Blackadders, and Spitting Image.

Bibliographic information