HobbitLong/shape2prog

RenderNet LSTM

Closed this issue · 0 comments

For the Rendernet, I assumed each part of the program would go through the LSTM sequentially, but it looks each batch only goes through the LSTM once:

out, hidden = self.lstm(x, init)

Plus, the hidden state is reset with each forward pass.
Maybe I'm missing something, but why use an LSTM in a nonrecurrent manner? I guess the gates could still work but I feel like it would be less effective that way.

Edit: Nevermind, for some reason my only experience with nn.LSTM has been passing the sequence in one part at a time in a for loop. But the documentation indicates you can pass the sequence in all at once.