Instance-based learning: nearest neighbour with generalisation

Martin, Brent

Instance-based learning: nearest neighbour with generalisation

dc.contributor.author	Martin, Brent
dc.date.accessioned	2008-10-21T00:12:24Z
dc.date.available	2008-10-21T00:12:24Z
dc.date.issued	1995-05
dc.description.abstract	Instance-based learning is a machine learning method that classifies new examples by comparing them to those already seen and in memory. There are two types of instance-based learning; nearest neighbour and case-based reasoning. Of these two methods, nearest neighbour fell into disfavour during the 1980s, but regained popularity recently due to its simplicity and ease of implementation. Nearest neighbour learning is not without problems. It is difficult to define a distance function that works well for both discrete and continuous attributes. Noise and irrelevant attributes also pose problems. Finally, the specificity bias adopted by instance-based learning, while often an advantage, can over-represent small rules at the expense of more general concepts, leading to a marked decrease in classification performance for some domains. Generalised exemplars offer a solution. Examples that share the same class are grouped together, and so represent large rules more fully. This reduces the role of the distance function to determining the class when no rule covers the new example, which reduces the number of classification errors that result from inaccuracies of the distance function, and increases the influence of large rules while still representing small ones. This thesis investigates non-nested generalised exemplars as a way of improving the performance of nearest neighbour. The method is tested using benchmark domains and the results compared with documented results for ungeneralised exemplars, nested generalised exemplars, rule induction methods and a composite rule induction and nearest neighbour learner. The benefits of generalisation are isolated and the performance improvement measured. The results show that non-nested generalisation of exemplars improves the classification performance of nearest neighbour systems and reduces classification time.	en_US
dc.format.mimetype	application/pdf
dc.identifier.citation	Martin, B.(1995) Instance-based learning: nearest neighbour with generalisation. (Working paper 95/18). Hamilton, New Zealand: University of Waikato, Department of Computer Science.	en_US
dc.identifier.issn	1170-487X
dc.identifier.uri	https://hdl.handle.net/10289/1095
dc.language.iso	en
dc.publisher	University of Waikato, Department of Computer Science	en_US
dc.relation.ispartofseries	Computer Science Working Papers
dc.subject	computer science	en_US
dc.title	Instance-based learning: nearest neighbour with generalisation	en_US
dc.type	Working Paper	en_US
uow.relation.series	95/18