Relevant Features Independence of Heuristic Selection and Important Features of Decision Tree in the Medical Data Classification

Open

Yusi Tyroni Mursityo, Irfany Rupiwardani, Widhy H. N. Putra, Dewi Sri Susanti, Titis Handayani, Samingun Handoyo

2024 Journal of Advances in Information Technology Vol. 15 Issue 5 Article Cited by 3 SDG 3SDG 17 Quartile

Abstract

The input of predictive models has an important role in directing the classification model to have a satisfactory performance in predicting an unknown label of the instance class. The predictor features should be not only relevant to the target feature but also should be independent of each other. The research objective is to obtain the predictor features that are relevant and independent through feature selection using the Chi-square test, one-way Analysis of Variance (ANOVA), and Pearson’s correlation test, and to show important features of the decision tree are different from the features of relevant and independent. The evaluation of irrelevant features yields 44 of 67 relevant features which as many as 18 discrete types with two labels are dropped. The dataset with 44 relevant features is used to train the first decision tree. The relevant features mean that the target feature depends on them. The best predictor features should not only be relevant but also independent of each other. The evaluation of independent among features yields 11 of 44 independent features where the features of numeric and discrete with 2 labels are represented by 1 and three features respectively. The dataset with 11 relevant and independent features is used to train the second decision tree. The important features of both models are very different and the second model has better performance than the first one for the metrics of accuracy, recall, and F1-Score. © 2024 by the authors.

Affiliations

Information System Department, Brawijaya University, Malang, Indonesia; Environmental Health Department, Widyagama Husada School of Health Science, Malang, Indonesia; Statistics Study Program, Lambung Mangkurat University, Banjarbaru, Indonesia; Information System Study Program, Semarang University, Semarang, Indonesia; Statistics Department, Brawijaya University, Malang, Indonesia; EECS–IGP Department, National Yang Ming Chiao Tung University, Hsinchu, Taiwan

Research at a Glance

Premium content — register to unlock

Research at a Glance

Register to unlock

Topics & SDG Alignment

Premium content — register to unlock

Topics & SDG Alignment

Register to unlock

Collaboration

Premium content — register to unlock

Collaboration

Register to unlock

Author Profile (Selected)

Premium content — register to unlock

Author Profile (Selected)

Register to unlock

References Overview

Premium content — register to unlock

References Overview

Register to unlock

Journal & Source

Premium content — register to unlock

Journal & Source

Register to unlock

Metadata & Integrity

Premium content — register to unlock

Metadata & Integrity

Register to unlock