agiresearch/OpenP5

hyperparameters and model configs for computing the metrics in the OpenP5 paper

liyang2019 opened this issue · 0 comments

Hello,

Wondering if there is a place that we can find the exact hyperparameters (id vocab size, num clusters, learning rate, etc.) and model config (num_layers, hidden size, etc.) to reproduce the metrics in the OpenP5 paper (https://arxiv.org/pdf/2203.13366.pdf)?

Thanks!