Discussion
Which quantity does entropy measure in a distribution?
Answer: C
Entropy is the expected surprise, maximal for the uniform distribution and zero when one outcome is certain. It counts outcomes only indirectly, through their probabilities. Distance from uniform is relative entropy, and the largest probability is the mode. Entropy underpins information gain in decision trees and the reduction criterion used to choose which variable to observe, so it links this topic to learning and to decision making alike.
No comment is present. Be the first to comment.
Loading…
Post your comment
Please log in or register to post a comment.
Examination Categories
- SSC Exams
- Banking Exams
- Teaching Exams
- Civil Services Exams
- Railways Exams
- Engineering Recruitment Exams
- Defence Exams
- State Government Exams
- Police Exams
- Insurance Exams
- Nursing Exams
- Other Government Exams
- NRA CET
- PG Entrance Exams
- Campus Placement
- MBA Entrance Exams
- CUET and UG Entrance
- Judiciary Exams
- Regulatory Body Exams
- Software Development