Institutional Repository [SANDBOX]
Technical University of Crete
EN  |  EL

Search

Browse

My Space

Building decision trees with constraints

Garofalakis Minos, Hyun Dongjoon , Rastogi Rajeev, Shim Kyuseok

Simple record


URIhttp://purl.tuc.gr/dl/dias/04355E5F-CBEB-4FC0-A75C-59EF43C5C18F-
Identifierhttp://link.springer.com/article/10.1023%2FA%3A1022445500761-
Identifier10.1023/A:1022445500761-
Languageen-
Extent28 pagesen
TitleBuilding decision trees with constraintsen
CreatorGarofalakis Minosen
CreatorΓαροφαλακης Μινωςel
CreatorHyun Dongjoon en
CreatorRastogi Rajeeven
CreatorShim Kyuseoken
PublisherKluweren
Content SummaryClassification is an important problem in data mining. Given a database of records, each with a class label, a classifier generates a concise and meaningful description for each class that can be used to classify subsequent records. A number of popular classifiers construct decision trees to generate class models. Frequently, however, the constructed trees are complex with hundreds of nodes and thus difficult to comprehend, a fact that calls into question an often-cited benefit that decision trees are easy to interpret. In this paper, we address the problem of constructing “simple” decision trees with few nodes that are easy for humans to interpret. By permitting users to specify constraints on tree size or accuracy, and then building the “best” tree that satisfies the constraints, we ensure that the final tree is both easy to understand and has good accuracy. We develop novel branch-and-bound algorithms for pushing the constraints into the building phase of classifiers, and pruning early tree nodes that cannot possibly satisfy the constraints. Our experimental results with real-life and synthetic data sets demonstrate that significant performance speedups and reductions in the number of nodes expanded can be achieved as a result of incorporating knowledge of the constraints into the building step as opposed to applying the constraints after the entire tree is built.en
Type of ItemPeer-Reviewed Journal Publicationen
Type of ItemΔημοσίευση σε Περιοδικό με Κριτέςel
Licensehttp://creativecommons.org/licenses/by/4.0/en
Date of Item2015-10-29-
Date of Publication2003-
SubjectAlgorithmic knowledge discoveryen
SubjectFactual data analysisen
SubjectKDD (Information retrieval)en
SubjectKnowledge discovery in dataen
SubjectKnowledge discovery in databasesen
SubjectMining, Dataen
Subjectdata miningen
Subjectalgorithmic knowledge discoveryen
Subjectfactual data analysisen
Subjectkdd information retrievalen
Subjectknowledge discovery in dataen
Subjectknowledge discovery in databasesen
Subjectmining dataen
SubjectClassification en
SubjectDecision treeen
SubjectBranch-and-bound algorithmen
SubjectConstrainten
Bibliographic CitationM. Garofalakis, D. Hyun, R. Rastogi and K. Shim, "Building decision trees with constraints", Data Min. Knowl. Disc., vol 7, no. 2, pp. 187-214, Apr. 2003. doi:10.1023/A:1022445500761en

Services

Statistics