Issues with BNN Configurations for GLUE Tasks

Question

Issues with BNN Configurations for GLUE Tasks

Opened this issue 2 months ago · 0 comments

Mohamed-Hazem-Abdo commented 2 months ago

Hello Mr. Qin,

For the GLUE tasks (COLA and MRPC) using BNN configurations, I’m encountering an issue where the validation metrics always show the same values, and the MCC is consistently 0, despite changes in the loss. Additionally, the test tool isn't working for these models.

Is the binlp library fully implemented? The documentation is currently down. Any guidance on refining or addressing these issues would be appreciated.

Thank you.