Machine-translated by Google. Questions are authored in English.
Top

Discussion

What does the Markov property assert?

  • A.The process terminates after a finite number of steps
  • B.The next state depends only on the current state and action
  • C.Every state is reachable from every other state given enough time
  • D.The rewards are independent of the actions taken

Answer: B

The property means the history beyond the current state carries no additional information, which is what allows a policy to depend on the state alone. Where it fails, the state description must be enriched until it holds. Reachability, reward independence and termination are different conditions. An assumption that licenses a compact representation, and can be restored by enlarging the state, is worth checking explicitly whenever such a model is adopted.

No comment is present. Be the first to comment.
Loading…

Post your comment

Please log in or register to post a comment.