How did you implement the STE in equation 10?

Question

How did you implement the STE in equation 10?

wangpichao opened this issue 7 years ago · 3 comments

I read your codes carefully and it is great. And I want to know how did you implement the STE in equation 10?

Answer 1 · 2018-03-08T05:58:35.000Z

STE is required during the backpropagation only, so it is automatically handled by tensorflow. I implemented the indicator function. You can read how I implemented the indicator function in the text above cell 7 in ABC Notebook (You'll need to download the notebook, as LaTeX is not properly supported by Github)

Answer 2 · 2018-03-08T06:41:32.000Z

Thanks your reply@layog. I am not familiar with tensorflow, and if tensorflow could handle the STE, it would be great. I am wondering whether tensorflow could deal with the weights update?

Answer 3 · 2018-03-08T14:52:18.000Z

Yes, that is what optimizers are for. You can look at the basics of tensorflow on their website.