Machine-translated by Google. Questions are authored in English.
Top

Discussion

Which criterion does information gain use when choosing a test?

  • A.The number of examples the test is able to separate into groups
  • B.The probability that the test returns its most informative outcome
  • C.The cost of performing the test relative to its expected accuracy
  • D.The expected reduction in entropy

Answer: D

Information gain is the entropy before the test minus the expected entropy after it, averaged over the test's possible outcomes. It is the information-theoretic cousin of the value of information, which weights by utility rather than by entropy. Example counts, outcome probabilities and costs enter other criteria. Noting that both quantities are non-negative for the same structural reason connects the two halves of this topic neatly.

No comment is present. Be the first to comment.
Loading…

Post your comment

Please log in or register to post a comment.