snuspl/nimble

There should be documentation of how to use nimble on Huggingface transformers

Closed this issue ยท 0 comments

lsb commented

๐Ÿš€ Feature

In much the same way that there is documentation of wrapping Nimble around a torchvision model, there should be documentation (and benchmarks?) around wrapping Nimble around ๐Ÿค— language models.
Unclear: whether this is a docs-only change.

Motivation

Nimble looks interesting and I am interesting in speeding up my NLP runs and I only see docs for torchvision

Pitch

  1. Adapt Nimble to ingest some ๐Ÿค— transformers or other models. (This may be a no-op)
  2. Write it up on the readme

Alternatives

Additional context