Can I use R-Drop in Semantic Search?

[ralgond]

Can R-Drop encode query and documents into embeddings for semantic search?

Thanks

[apeterswu]

Hi @ralgond ,

R-Drop is only a simple training trick for DNNs. If your search problem is defined as a multiclass classification with softmax, it can be used smoothly. Encoding is not a matter of R-Drop.