swoook/transformers

Export ELECTRA to ONNX Runtime (ORT)

swoook opened this issue · 0 comments

swoook commented

🚀 Feature request

Motivation

  • I'd like to export ELECTRA to ONNX Runtime
  • Of course, transformers officially supports exporting to ONNX Runtime [here]:

Ready-made configurations include the following models:

  • ALBERT
  • BART
  • BERT
  • CamemBERT
  • DistilBERT
  • GPT Neo
  • LayoutLM
  • Longformer
  • mBART
  • OpenAI GPT-2
  • RoBERTa
  • T5
  • XLM-RoBERTa
  • But it seems that it doesn't support for ELECTRA:
  1. Exporting transformers models — transformers 4.12.5 documentation

The models showcased here are close to fully feature complete, but do lack some features that are currently in development. Namely, the ability to handle the past key values for decoder models is currently in the works.

  • I'd like to implement a feature or manual to address this issue

Your contribution