haroldsultan/MCTS

The UCB algorithm is a little different from the paper

Closed this issue · 2 comments

According to the paper A Survey of Monte Carlo Tree Search Methods, the UCB function should look like this.

And here is the pseudo-code about the implementation.

Uploading Screen Shot 2017-10-25 at 4.58.17 PM.png…

The coefficient 2 should be outsize of the log. And this line of code is a little different from the paper https://github.com/haroldsultan/MCTS/blob/master/mcts.py#L115 .

thanks. i corrected the code

Great and thanks for your sharing 🎉