td error
Closed this issue · 1 comments
wadaniel commented
Hi there, I guess you missed the discount factor while computing the TD error:
https://github.com/XanderJC/scalable-birl/blob/main/sbirl/models.py#L189
wadaniel commented
I found that you are not using a discount factor, respectively gamma equals 1.0