julianser/hed-dlg-truncated

What does "max_length" mean?

Closed this issue · 2 comments

What does the "max_length" parameter mean? Is it the maximum number of tokens in a single utterance? The maximum number of characters in a single utterance? The maximum number of tokens in all the contexts utterances?

Sorry for newbie question, just trying to figure it out.

It's the length of the longest dialogue in a batch.

@julianser length in characters or words?