Next Article in Journal
Digital Educational Support Groups Administered through WhatsApp Messenger Improve Health-Related Knowledge and Health Behaviors of New Adolescent Mothers in the Dominican Republic: A Multi-Method Study
Previous Article in Journal
Deep Learning Model for Industrial Leakage Detection Using Acoustic Emission Signal
Open AccessFeature PaperArticle

Investigation of Combining Logitboost(M5P) under Active Learning Classification Tasks

Department of Mathematics, University of Patras, 26500 Patras, Greece
*
Author to whom correspondence should be addressed.
Received: 16 October 2020 / Accepted: 29 October 2020 / Published: 3 November 2020
(This article belongs to the Section Machine Learning)
Active learning is the category of partially supervised algorithms that is differentiated by its strategy to combine both the predictive ability of a base learner and the human knowledge so as to exploit adequately the existence of unlabeled data. Its ambition is to compose powerful learning algorithms which otherwise would be based only on insufficient labelled samples. Since the latter kind of information could raise important monetization costs and time obstacles, the human contribution should be seriously restricted compared with the former. For this reason, we investigate the use of the Logitboost wrapper classifier, a popular variant of ensemble algorithms which adopts the technique of boosting along with a regression base learner based on Model trees into 3 different active learning query strategies. We study its efficiency against 10 separate learners under a well-described active learning framework over 91 datasets which have been split to binary and multi-class problems. We also included one typical Logitboost variant with a separate internal regressor for discriminating the benefits of adopting a more accurate regression tree than one-node trees, while we examined the efficacy of one hyperparameter of the proposed algorithm. Since the application of the boosting technique may provide overall less biased predictions, we assume that the proposed algorithm, named as Logitboost(M5P), could provide both accurate and robust decisions under active learning scenarios that would be beneficial on real-life weakly supervised classification tasks. Its smoother weighting stage over the misclassified cases during training as well as the accurate behavior of M5P are the main factors that lead towards this performance. Proper statistical comparisons over the metric of classification accuracy verify our assumptions, while adoption of M5P instead of weak decision trees was proven to be more competitive for the majority of the examined problems. We present our results through appropriate summarization approaches and explanatory visualizations, commenting our results per case. View Full-Text
Keywords: active learning; Logitboost wrapper classifier; M5P regressor; boosting technique; human annotations; label and unlabeled data; weakly supervised learning active learning; Logitboost wrapper classifier; M5P regressor; boosting technique; human annotations; label and unlabeled data; weakly supervised learning
Show Figures

Figure 1

MDPI and ACS Style

Kazllarof, V.; Karlos, S.; Kotsiantis, S. Investigation of Combining Logitboost(M5P) under Active Learning Classification Tasks. Informatics 2020, 7, 50. https://0-doi-org.brum.beds.ac.uk/10.3390/informatics7040050

AMA Style

Kazllarof V, Karlos S, Kotsiantis S. Investigation of Combining Logitboost(M5P) under Active Learning Classification Tasks. Informatics. 2020; 7(4):50. https://0-doi-org.brum.beds.ac.uk/10.3390/informatics7040050

Chicago/Turabian Style

Kazllarof, Vangjel; Karlos, Stamatis; Kotsiantis, Sotiris. 2020. "Investigation of Combining Logitboost(M5P) under Active Learning Classification Tasks" Informatics 7, no. 4: 50. https://0-doi-org.brum.beds.ac.uk/10.3390/informatics7040050

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Search more from Scilit
 
Search
Back to TopTop