NTU-SQUAD/transformers-coqa

Why should `start_logits` be multiplied by `rational_logits`?

Closed this issue · 1 comments

Hi, thank you for your very good work.

There is a place in modeling_bert.py that I don't quite understand, line 68.

That is start_logits, end_logits = start_logits * rational_logits, end_logits * rational_logits

Why should start_logits be multiplied by rational_logits? and what are the rational_logits here? Is it necessary?

Looking forward to your reply, thank you!🤗

For the rational part, your can refer to this paper(part 3.2)