The Cuts Selection Method Based on Histogram Segmentation and Impact on Discretization Algorithms

Entropy (Basel). 2022 May 11;24(5):675. doi: 10.3390/e24050675.

Abstract

The preprocessing of data is an important task in rough set theory as well as in Entropy. The discretization of data as part of the preprocessing of data is a very influential process. Is there a connection between the segmentation of the data histogram and data discretization? The authors propose a novel data segmentation technique based on a histogram with regard to the quality of a data discretization. The significance of a cut's position has been researched on several groups of histograms. A data set reduct was observed with respect to the histogram type. Connections between the data histograms and cuts, reduct and the classification rules have been researched. The result is that the reduct attributes have a more irregular histogram than attributes out of the reduct. The following discretization algorithms were used: the entropy algorithm and the Maximal Discernibility algorithm developed in rough set theory. This article presents the Cuts Selection Method based on histogram segmentation, reduct of data and MD algorithm of discretization. An application on the selected database shows that the benefits of a selection of cuts relies on histogram segmentation. The results of the classification were compared with the results of the Naïve Bayes algorithm.

Keywords: MD algorithm; cuts; data discretization; entropy; groups of histograms.

Grants and funding

Ministry of Education, Science and Technological Development, Republic of Serbia financially supported this research, under the grant TR32044, “The Development of Software Tools for Business Process Analysis and Improvement”, 2011–2022.