Machine-translated by Google. Questions are authored in English.
Top

Discussion

What is the criticism of benchmark driven planning research?

  • A.Benchmarks are too difficult for any planner to solve at all
  • B.The benchmarks change too frequently to permit comparison
  • C.Benchmark results cannot be reproduced by other researchers
  • D.Planners become tuned to the benchmarks rather than to real problems

Answer: D

Domains chosen for their tractability and their tradition may share structural features that real applications lack, so a planner excellent on them may disappoint in practice. The competitions have responded by broadening the domain set. Difficulty, volatility and reproducibility are lesser concerns. A measure that becomes a target ceases to be a good measure, and the field's response has been to keep changing the target.

No comment is present. Be the first to comment.
Loading…

Post your comment

Please log in or register to post a comment.