MyGit

0.4.8

kyegomez/LongNet

版本发布时间: 2023-08-11 03:04:14

kyegomez/LongNet最新发布版本:0.4.8(2023-08-11 03:04:14)

Changelog for DilatedAttention with ParallelWrapper:

1. Added ParallelWrapper Class

2. Modified Usage of DilatedAttention Model

3. Device Assignment

4. Example Usage

Summary:

The key addition was the ParallelWrapper class to facilitate easy and configurable usage of data parallelism with the provided DilatedAttention model. This ensures scalability across multiple GPUs without any significant change in the existing workflow. The user can now enable or disable data parallelism using a single flag.

相关地址:原始地址 下载(tar) 下载(zip)

查看:2023-08-11发行的版本