Machine-translated by Google. Questions are authored in English.
Top

Discussion

What is the role of the problem generator in a learning agent?

  • A.Generating the goals the agent will attempt to achieve next
  • B.Producing the training data from which the agent learns its model
  • C.Suggesting exploratory actions that may yield useful experience
  • D.Creating the test problems used to evaluate the agent's performance

Answer: C

Left to itself the performance element would always take the action it currently believes best, and would never discover anything better, so the problem generator deliberately proposes suboptimal but informative actions. It is the architectural expression of the exploration and exploitation trade. Evaluation, goal setting and data collection are separate functions. Building exploration into the design, rather than hoping it happens, is what allows a learning system to improve beyond its starting point.

No comment is present. Be the first to comment.
Loading…

Post your comment

Please log in or register to post a comment.