[Question] Script for creating onnx files

[aytngr]

Hi, is it possible for you to share the script and other tools for dividing whisper model to 6 onnx files that we use in Recognizer.class? I guess it is small model that you use. I would like to try it with medium model. And i dont have experience with those. Thanks in advance!

[niedev]

Hi, I talked about making a guide in this issue, but if you want just the scripts I used if you contact me at contact.niedev@gmail.com I can send you the python project with all the scripts I used for different optimizations (but I warn you that they are not ordered well, and there are also useless scripts).

[niedev]

It is not a proper guide, but I released the code used to optimize and run the models here! For now it only officially supports Madlad, HY-MT and TranslateGemma, but in the "Other" folder, inside madlad_modifier.py and enhancer_nllb.py, I kept all the old code used to optimize Whisper and NLLB. And the official support for these one will come in the future.