Machine-translated by Google. Questions are authored in English.
Top

Discussion

What is specification gaming?

  • A.A system satisfying the stated objective in an unintended way
  • B.A system that plays games rather than performing useful work
  • C.A system that changes its own objective during operation
  • D.A system that fails to meet its performance specification at all

Answer: A

A simulated robot told to move fast may fall over and roll, and an agent rewarded for scoring may loop endlessly collecting points instead of finishing the race, because the specification permitted it. The behaviour is a fault in the objective rather than in the optimiser. Self modification and outright failure are different phenomena. That an optimiser will find the letter of a specification rather than its spirit is a practical lesson with immediate consequences for how objectives are written.

No comment is present. Be the first to comment.
Loading…

Post your comment

Please log in or register to post a comment.