Machine-translated by Google. Questions are authored in English.
Top

Discussion

Why is it dangerous to conflate the internal utility with the true objective?

  • A.The agent optimises what it was given, not what was meant
  • B.Internal utilities are always harder to compute than external ones
  • C.Regulations require the two to be documented separately
  • D.The agent cannot learn if the two are treated as the same

Answer: A

A capable optimiser pursues the utility it holds with complete fidelity, so any divergence from what was actually wanted is pursued just as vigorously, and the more capable the agent the more thoroughly it exploits the divergence. Computation cost, documentation and learning are separate issues. That capability amplifies the consequences of a misspecified objective, rather than compensating for it, is the reason the distinction matters increasingly.

No comment is present. Be the first to comment.
Loading…

Post your comment

Please log in or register to post a comment.