v0.0.17
版本发布时间: 2023-03-28 20:59:15
facebookresearch/xformers最新发布版本:v0.0.28.post1(2024-09-13 23:52:20)
This release brings some improvements to the memory_efficient_attention
Pip wheels now target pytorch 2.0.0 - conda builds are available for PT 2.0.0, 1.13.1 and 1.12.1
Fixed
- fMHA: Fixed BW pass on Sm86/Sm89 GPUs when
K > 64(RTX 3090, RTX 4090, A6000, ..) [facebookresearch/xformers#631]
Added
- fMHA/CUTLASS: Added tensor attn bias support [facebookresearch/xformers#587] - contribution from @jfc4050
- fMHA/CUTLASS: Added tensor attn bias grad support [facebookresearch/xformers#587] - contribution from @jfc4050
- fMHA/CUTLASS: Added dropout support [facebookresearch/xformers#587] - contribution from @jfc4050
- fMHA: Added support for varying sequence lengths [facebookresearch/xformers#500]