FMInference/FlexLLMGen

what is the helm version?

oujieww opened this issue · 1 comments

ImportError: cannot import name 'TokensMetric' from 'helm.benchmark.runner'

i use crfm-helm==0.4.0

according to stanford-crfm/helm#1480
we should rename TokensMetric to DryRunMetric