Find the fixed length of the sentence for document and summary in the function preprocessing

Question

Find the fixed length of the sentence for document and summary in the function preprocessing

Closed this issue 5 years ago · 1 comments

Answer 1 · 2019-12-30T11:02:54.000Z

This function  will be used to preprocess the data to a form that can be fed into the neural network
Subparts:
1.For feeding into the encoder model, the sentences need to have a specific fixed length, the fixed length is set to the length maximum sentences have.The shorter sentences are then padded to be of the fixed length(in a later issue)