nebullvm 0.8.1 Release Notes

This is a minor release fixing multiple bugs.

New features

• Changed the Auto-Installer API
• Added support to onnxruntime TensorrtExecutionProvider

Bug fixed

• Fixed bug in torchscript casting integers to fp16.
• Optimized the memory usage for inference learners
• Now the tensorrt workspace size is dynamically computed according to the free memory available on the gpu device
• Fixed a bug in openvino when using static quantization

speedster 0.2.1 Release Notes

This is a minor release fixing multiple bugs.

New Features

• Added support for device selection when working multi-gpu environment
• Added support to input data with inconsistent batch size
• Implemented benchmark functions also for TensorFlow and ONNX

Bug Fixed

• Optimized the gpu memory usage during speedster optimization

Contributors

• @valeriosofi
• @cccntu
• @VinishUchiha