Machine-translated by Google. Questions are authored in English.
Top

Discussion

What is the inductive bias of a learning algorithm?

  • A.The assumptions it makes to generalise beyond the training data
  • B.The systematic error between its predictions and the truth
  • C.Its tendency to produce unfair outcomes for certain groups
  • D.The difference between its training and its test performance

Answer: A

Without assumptions no generalisation from finite data is possible at all, so every learning algorithm embodies a preference, such as for smooth functions or for simple hypotheses. The choice of that bias is what makes one algorithm suit a problem better than another. Estimator bias, fairness and the generalisation gap are separate concepts sharing vocabulary. Recognising that assumption free learning is impossible is the content of the no free lunch results.

No comment is present. Be the first to comment.
Loading…

Post your comment

Please log in or register to post a comment.