Discussion
What is the alignment problem?
Answer: D
A capable optimiser will pursue exactly the objective it was given, which may differ subtly and consequentially from what was meant, and specifying objectives correctly proves surprisingly hard. Reward hacking and specification gaming are the observed symptoms. Mechanical alignment, distribution shift and multi-agent agreement are different problems, the second being important in its own right. A system that does what it was told rather than what was wanted is a hazard that grows with capability.
No comment is present. Be the first to comment.
Loading…
Post your comment
Please log in or register to post a comment.
Examination Categories
- SSC Exams
- Banking Exams
- Teaching Exams
- Civil Services Exams
- Railways Exams
- Engineering Recruitment Exams
- Defence Exams
- State Government Exams
- Police Exams
- Insurance Exams
- Nursing Exams
- Other Government Exams
- NRA CET
- PG Entrance Exams
- Campus Placement
- MBA Entrance Exams
- CUET and UG Entrance
- Judiciary Exams
- Regulatory Body Exams
- Software Development