ID3 (Iterative Dichotomiser 3)

Shannon Entropy

Mathematical measure of uncertainty or disorder in a dataset, calculated as the negative sum of probabilities multiplied by their binary logarithm, serving as the basis for calculating information gain in ID3.

← Tillbaka