What is the difference between Entropy and Information Gain?
Answer Posted / Shaji Najeev Siddiki
Entropy is a measure of the purity (randomness) of data, while Information Gain measures the reduction in entropy when splitting a node. In other words, Information Gain quantifies how much knowledge (or reduction in uncertainty) is gained by splitting a given dataset on a feature.
| Is This Answer Correct ? | 0 Yes | 0 No |
Post New Answer View All Answers