View Code? Open in Web Editor
NEW
This project forked from huggingface /transformers
๐ค Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.
Home Page: https://huggingface.co/transformers
License: Apache License 2.0
Python 99.81%
Dockerfile 0.03%
Shell 0.14%
Makefile 0.02%
Jsonnet 0.01%
transformers's People
Watchers
transformers's Issues
๐ Feature request
I'd like to export BART to ONNX Runtime
Of course, transformers officially supports exporting BART to ONNX Runtime [here] :
Ready-made configurations include the following models:
ALBERT
BART
BERT
CamemBERT
DistilBERT
GPT Neo
LayoutLM
Longformer
mBART
OpenAI GPT-2
RoBERTa
T5
XLM-RoBERTa
But it seems that it doesn't cover all of tasks:
Exporting transformers models โ transformers 4.12.5 documentation
The models showcased here are close to fully feature complete, but do lack some features that are currently in development. Namely, the ability to handle the past key values for decoder models is currently in the works.
#13893 in huggingface/transformers (github)
The generate
method in ONNX isn't available yet. It is on the roadmap, but it is a big item that will require quite a bit of time to solve.
You can follow the progress here: #13578
I'd like to implement a feature or manual to address this issue
Motivation
Your contribution
๐ Feature request
Motivation
I'd like to export ELECTRA to ONNX Runtime
Of course, transformers officially supports exporting to ONNX Runtime [here] :
Ready-made configurations include the following models:
ALBERT
BART
BERT
CamemBERT
DistilBERT
GPT Neo
LayoutLM
Longformer
mBART
OpenAI GPT-2
RoBERTa
T5
XLM-RoBERTa
But it seems that it doesn't support for ELECTRA:
Exporting transformers models โ transformers 4.12.5 documentation
The models showcased here are close to fully feature complete, but do lack some features that are currently in development. Namely, the ability to handle the past key values for decoder models is currently in the works.
I'd like to implement a feature or manual to address this issue
Your contribution