In this release, our main focus was on creating a new backend using wgpu. We greatly appreciate the meaningful contributions made by the community across the project. As usual, we have expanded the number of supported operations.

Changes

Tensor

• Added Max/Minimum operation @nathanielsimard
• Added average pooling 1D operation @nathanielsimard
• Added Gather/Scatter operations @nathanielsimard
• Added Mask Where operation @nathanielsimard
• Refactor index related operations @nathanielsimard
  • index, index_assign => slice, slice_assign
  • index_select, index_select_assign => select, select_assign
• New syntax sugar for transpose @wbrickner
• Added SiLU activation function @poxxy

Dataset

• Added a dataset using Sqlite for storage. Now used to store huggingface datasets. @antimora
• New speech command audio dataset. @antimora
• Create python virtual environment for huggingface dependencies. @dengelt

Burn-Import

• Big refactor to make it easier to support new operations. @nathanielsimard
• Support bool element type. @maekawatoshiki
• Added Add operator. @luni-4
• Added MaxPool2d operator. @luni-4
• Parse convolution 2D config. @luni-4
• Added sigmoid operation. @luni-4

Backend

• New burn-wgpu backend 🔥! @nathanielsimard @louisfd
  • Tile 2D matrix multiplication
  • All operations are supported
• Improve performance of repeat with the tch backend. @nathanielsimard

Neural Networks

• Added LSTM module. @agelas
• Added GRU module. @agelas
• Better weights initialization with added support for Xavier Glorot. @louisfd
• Added MSE loss. @bioinformatist
• Cleanup padding for convolution and pooling modules. @luni-4
• Added sinusoidal positional embedding module. @antimora

Fix

• Deserialization of constant arrays. @nathanielsimard
• Concat backward with only one dim. @nathanielsimard
• Conv1d stride hardcoded to 1. @antimora
• Fix arange with the tch backend. @nathanielsimard

Documentation

• Improve documentation across the whole project ♥! @antimora

Thanks

Thanks to all contributors and to the sponsor @smallstepman.