v0.7.3
版本发布时间: 2023-01-13 07:51:38
nebuly-ai/optimate最新发布版本:chatllama0.0.4(2023-03-27 21:47:20)
nebullvm 0.7.3 Release Notes
This is a minor release modifying the metric_drop_ths behaviour.
New Features
-
metric_drop_thsby default set to0.001 - Half precision is activated for each value of
metric_drop_ths>0 - Int8 quantization is activated just for values of
metric_drop_ths>0.01
Speedster 0.1.2 Release Notes
This is a minor release editing the default value for metric_drop_ths and modifying the summarisation table at the end of the optimization.
New Features
- The summary at the end of the optimization now shows in a clear way the improvements.
- Warning with tips on how to improve the optimization result is now shown also for speedups lower than 2x.