About the Reward Loss

[yujieNC]

Thank you for releasing your code.
It seems that the reward loss in your code (line 179) is different from Equation (11) of the paper.

In your code (line 179), L_rew = P_m * R * log(P_m*P_kp(x)*P_kp(y)).

But the reward loss shown in Equation (11) of the paper is L_rew = P_m * R * log(P_kp(x)*P_kp(y)).

Maybe I am wrong.
Looking forward to hearing from you.