hidet-org/hidet

[Question] how to use with facebook dinov2

carl10086 opened this issue · 2 comments

reproduce

model = torch.hub.load('facebookresearch/dinov2', 'dinov2_vits14')
model = model.to('cuda')
torch._dynamo.config.verbose = True
hidet.torch.dynamo_config.use_tensor_core(True)
hidet.torch.dynamo_config.search_space(2)
model_opt = torch.compile(model, backend='hidet')

some error

torch._dynamo.exc.BackendCompilerFailed: hidet_backend raised NotImplementedError: The following modules/functions are not supported by hidet yet:
  torch.nn.Identity
Enviroment

env
OS: Ubuntu 22.04
GPU: A100

question

Hi @carl10086,

I have added the missing operator mapping for the dinov2 model in #206.

You can build hidet from source and have a check (or wait for one day when the PR gets into the nightly build version).

Resolved by #206