0.8.4
版本发布时间: 2024-05-10 17:30:05
Mozilla-Ocho/llamafile最新发布版本:0.8.13(2024-08-19 01:22:48)
This release fixes underflows and overflows.
-
A memory bug in the grammar parser has been fixed, that caused commands like
./llamafile -m foo.gguf -p bar --grammar 'root::="'
(which failed to specify a closing quote) to crash. Anyone using the server as a public facing endpoint (despite our previous recommendations) is strongly encouraged to upgrade. See 22aba95 and 3fe045feef36ce5ee47a61e4bb375bf90b3b4f9a. Credit for discovering (and most importantly, reporting) this issue goes to Eclypsium Security Researcher Richard Johnson. We incorrectly reported earlier that this fix was incorporated into the v0.8.2 release. You need to use the v0.8.4 release. This bug fix was upstreamed in https://github.com/ggerganov/llama.cpp/pull/7194 -
Our new vectorized expf() implementation now handles underflow by producing subnormals rather than flushing to zero. b5c6df6e9e428ea56fe0969da33d8c164e1311f0
See these instructions for how to put the latest llamafile software into your old weights, without having to redownload. https://github.com/Mozilla-Ocho/llamafile/issues/24#issuecomment-1836362558
1、 llamafile-0.8.4 27.92MB
2、 llamafile-0.8.4.zip 38.07MB
3、 zipalign-0.8.4 752.81KB