MyGit

v0.1.4

hpcaitech/ColossalAI

版本发布时间: 2022-04-28 15:56:41

hpcaitech/ColossalAI最新发布版本:v0.4.4(2024-09-19 10:53:35)

Main Features

Here are the main improvements of this release:

  1. ColoTensor: A data structure that unifies the Tensor representation of different parallel methods.
  2. Gemini: More efficient Genimi implementation reduces the overhead of model data statistic collection.
  3. CLI: a command-line tool that helps users launch distributed training tasks more easily.
  4. Pipeline Parallelism (PP): a more user-friendly API for PP.

What's Changed

ColoTensor

Gemini + ZeRO

CLI

Pipeline Parallelism

Misc

Full Changelog: https://github.com/hpcaitech/ColossalAI/compare/v0.1.3...v0.1.4

相关地址:原始地址 下载(tar) 下载(zip)

查看:2022-04-28发行的版本