Skip to content

Releases: AkiRusProd/numpy-nn-model

v2.0.1, add Transformer Decoder example

25 Jul 19:15
Compare
Choose a tag to compare

Add Transformer Decoder example, code cleanup

v2.0.0, update Autograd

21 Jul 14:17
19d2d54
Compare
Choose a tag to compare
  • Now Autograd is tape-based, (previously it was fully recursive)
  • Bug fixes and optimization
    • Simplify nn.Embedding
    • Simplify autograd reverse_broadcast method
    • Fix where grad_fn method
  • Add Seq2Seq Transformer example
  • Other
    • Add nn.LogSoftmax
    • Edit nn.Linear bias initialization
    • Оther fixes and improvements

New autograd version enables transformer training, overcoming previous limitations due to slow backpropagation speed.

v1.0.0

13 Jul 19:02
Compare
Choose a tag to compare
v1.0.0 Pre-release
Pre-release

Pre-release