Skip to content

Commit

Permalink
[DOC] Update changelog, prepare v0.0.2
Browse files Browse the repository at this point in the history
  • Loading branch information
f-dangel committed Dec 8, 2023
1 parent 0aa9336 commit 25d99ac
Showing 1 changed file with 35 additions and 1 deletion.
36 changes: 35 additions & 1 deletion changelog
Original file line number Diff line number Diff line change
Expand Up @@ -15,9 +15,43 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0

### Fixed

## [0.0.2] - 2023-12-11

This release adds support for neural networks with in-place activations and also comes with performance improvements for convolutions, as well as improvements regarding numerical stability in half precision.

### Added

New features:

- Support `Conv2d` layers with `dilation != 1`
([PR](https://github.com/f-dangel/singd/pull/51)
- Support neural networks with inplace activation functions
([PR](https://github.com/f-dangel/singd/pull/63))

Performance improvements:

- Speed up input processing for `Conv2d` with `groups != 1`
([PR](https://github.com/f-dangel/singd/pull/59))
- Speed up computation of averaged patches for KFAC-reduce (`kfac_approx='reduce'`) in `Conv2d` using the tensor network approach of Dangel, 2023
([PR](https://github.com/f-dangel/singd/pull/61))

### Changed

- Move un-scaling of `H_C` into the update step to improve numerical stability when using half precision + gradient scaling
([PR](https://github.com/f-dangel/singd/pull/67))

### Deprecated

No deprecations

### Fixed

No bug fixes

## [0.0.1] - 2023-10-31

Initial release

[unreleased]: https://github.com/f-dangel/singd/compare/v0.0.1...HEAD
[unreleased]: https://github.com/f-dangel/singd/compare/v0.0.2...HEAD
[0.0.2]: https://github.com/f-dangel/singd/releases/tag/v0.0.2
[0.0.1]: https://github.com/f-dangel/singd/releases/tag/v0.0.1

0 comments on commit 25d99ac

Please sign in to comment.