Entropy-Based Greedy Algorithm for Decision Trees Using Hypotheses

Entropy (Basel). 2021 Jun 25;23(7):808. doi: 10.3390/e23070808.

Abstract

In this paper, we consider decision trees that use both conventional queries based on one attribute each and queries based on hypotheses of values of all attributes. Such decision trees are similar to those studied in exact learning, where membership and equivalence queries are allowed. We present greedy algorithm based on entropy for the construction of the above decision trees and discuss the results of computer experiments on various data sets and randomly generated Boolean functions.

Keywords: decision tree; entropy; greedy algorithm; hypothesis.