hsiehjackson/RULER

Show Gemini Pro results

s-macke opened this issue · 2 comments

s-macke commented

Hi,

your paper doesn’t show Gemini Pro results with 1M tokens.
Please test against this model.

hsiehjackson commented

We are working on testing gemini 1.5 pro. Please stay patient since the API has a restricted rate limit.

  • 👍2
hsiehjackson commented

@s-macke we just release our codes and put gemini 1.5 pro results in our main table. Thanks for your patience.