How to reproduce GEAR on Mistral models

Question

How to reproduce GEAR on Mistral models

CUHKSZzxy opened this issue 3 months ago · 2 comments

Thanks for your excellent work!

May I ask for the scripts and examples to reproduce GEAR results on MMLU, using Mistral models? It is difficult for me to find related scripts and the usage of different configuration / parameters.

Answer 1 · 2024-07-03T20:18:03.000Z

We have updated sh files to run llama models on Aqua,GSM8k and BBH datasets

Answer 2 · 2024-07-12T14:17:48.000Z

Thanks for your reply, but my concern is how to reproduce results on Mistral models, thanks!