Reduction stumps for multi-class classification

verfasst von

Felix Mohr, Marcel Wever, Eyke Hüllermeier

Abstract

Multi-class classification problems are often solved via reduction, i.e., by breaking the original problem into a set of presumably simpler subproblems (and aggregating the solutions of these problems later on). Typical examples of this approach include decomposition schemes such as one-vs-rest, all-pairs, and nested dichotomies. While all these techniques produce reductions to purely binary subproblems, which is reasonable when only binary classifiers ought to be used, we argue that reductions to other multi-class problems can be interesting, too. In this paper, we examine a new type of (meta-)classifier called reduction stump. A reduction stump creates a binary split among the given classes, thereby creating two subproblems, each of which is solved by a multi-class classifier in turn. On top, the two groups of classes are separated by a binary (or multi-class) classifier. In addition to simple reduction stumps, we consider ensembles of such models. Empirically, we show that this kind of reduction, in spite of its simplicity, can often lead to significant performance gains.

Externe Organisation(en)

Universität Paderborn
Heinz Nixdorf Institut (HNI)

Typ

Aufsatz in Konferenzband

Seiten

225-237

Anzahl der Seiten

13

Publikationsdatum

2018

Publikationsstatus

Veröffentlicht

Peer-reviewed

Ja

ASJC Scopus Sachgebiete

Theoretische Informatik, Allgemeine Computerwissenschaft

Elektronische Version(en)

https://doi.org/10.1007/978-3-030-01768-2_19 (Zugang: Geschlossen)