v4.38.1
版本发布时间: 2024-02-22 08:24:34
huggingface/transformers最新发布版本:v4.40.1(2024-04-24 06:01:20)
Fix eager attention in Gemma!
- [Gemma] Fix eager attention #29187 by @sanchit-gandhi
TLDR:
- attn_output = attn_output.reshape(bsz, q_len, self.hidden_size)
+ attn_output = attn_output.view(bsz, q_len, -1)