nebullvm 0.4.0 Release Notes

"One API to rule them all". This major release of Nebullvm provides a brand new API unique to all Deep Learning frameworks.

New Features

• New unique API for all the Deep Learning frameworks.
• Support for SparseML pruning.
• Beta-feature Support for Intel-Neural-Compressor's Pruning.
• Add support for BladeDISC compiler.
• Modify the latency calculation for each model by using the median instead of the mean across different model runs.
• Implement an early stop mechanism for latency computation.

Bug fixed

• Fix bug with HuggingFace models causing a failure during optimizations.

Contributors

• Diego Fiori (@morgoth95)
• Valerio Sofi (@valeriosofi)
• Reiase (@reiase)