We finally were able to port a model to ONNX:

• Compact model (~100k params);
• Both PyTorch and ONNX models are not quantized;
• Same quality model as the latest best PyTorch release;
• Only 16kHz available now (ONNX has some issues with if-statements and / or tracing vs scripting) with cryptic errors;
• In our tests, on short audios (chunks) ONNX is 2-3x faster than PyTorch (this is mitigated with larger batches or long audios);
• Audio examples and non-core models moved out of the repo to save space;