v0.8.0 #3648

Unanswered

chiamp asked this question in General

chiamp
Jan 23, 2024
Collaborator

What's Changed

bump version number by @levskaya in bump version number #3446
Add merge / finalize step when using OCDBT driver. Files will be first written to per-process subdirectories, which are later copied by reference to the main directory before the checkpoint is finalized. by @copybara-service in Add merge / finalize step when using OCDBT driver. Files will be first written to per-process subdirectories, which are later copied by reference to the main directory before the checkpoint is finalized. #3426
fixed quickstart by @chiamp in fixed quickstart #3451
[NVIDIA] Update the algorithm to compute fp8 scales by @kaixih in [NVIDIA] Update the algorithm to compute fp8 scales #3441
added pre-commit hook that sort imports and formats by @chiamp in added pre-commit hook that sort imports and formats #3455
restructured doc folders by @chiamp in restructured doc folders #3434
Forked a subset of JAX configuration APIs by @superbobry in Forked a subset of JAX configuration APIs #3448
Fix Module.clone in deepclone mode for internal usage. by @levskaya in Fix Module.clone in deepclone mode for internal usage. #3459
Add user-friendly module copy method. by @levskaya in Add user-friendly module copy method. #3461
Add simple argument-only lifted nn.grad function. by @levskaya in Add simple argument-only lifted nn.grad function. #3463
exempt a jax.config deprecation warning by @levskaya in exempt a jax.config deprecation warning #3465
Clean up pyproject.toml. by @levskaya in Clean up pyproject.toml. #3468
Allow for fast accumulation selection for FP8 GEMM by @wenscarl in Allow for fast accumulation selection for FP8 GEMM #3416
re-added quickstart guide by @chiamp in re-added quickstart guide #3471
fixed tabulate docstring by @chiamp in fixed tabulate docstring #3452
Add NNX by @cgarciae in Add NNX #3218
Bump pillow from 9.5.0 to 10.0.1 in /examples/vae by @dependabot in Bump pillow from 9.5.0 to 10.0.1 in /examples/vae #3390
updated attention_test by @chiamp in updated attention_test #3454
[nnx] Improve docs by @cgarciae in [nnx] Improve docs #3478
added example docstrings by @chiamp in added example docstrings #3453
fix nn.value_and_grad by implementing directly in core by @levskaya in fix nn.value_and_grad by implementing directly in core #3479
Add dataset loading guide (Issue HOWTOS tracking issue #2116) by @VictorPrins in Add dataset loading guide (Issue #2116) #3450
[nnx] Add support for python container types by @cgarciae in [nnx] Add support for python container types #3486
remove SelfAttention test and warning filter by @chiamp in remove SelfAttention test and warning filter #3470
disabled ruff formatter by @chiamp in disabled ruff formatter #3482
adding doctest to .rst files by @chiamp in adding doctest to .rst files #3481
changed pip installs to use quotes by @chiamp in changed pip installs to use quotes #3477
added enum support for tabulate by @chiamp in added enum support for tabulate #3485
fix bug in optimizer-api.md by @zhaoyang-0204 in fix bug in optimizer-api.md #3462
removed selfattention from doctest by @chiamp in removed selfattention from doctest #3489
[nnx] Add missing import on why.ipynb by @cgarciae in [nnx] Add missing import on why.ipynb #3503
[nnx] switch to nested State representation by @cgarciae in [nnx] switch to nested State representation #3502
Improved Rigor of PReLU Test by @Micky774 in Improved Rigor of PReLU Test #3498
added geglu activation and tests by @HMUNACHI in added geglu activation and tests #3512
[nnx] Add LinearGeneral and MultiHeadAttention by @cgarciae in [nnx] Add LinearGeneral and MultiHeadAttention #3487
Add NNX/Linen consistency test for Embed layer by @Micky774 in Add NNX/Linen consistency test for Embed layer #3513
Add NNX/Linen API consistency test for Conv layer by @Micky774 in Add NNX/Linen API consistency test for Conv layer #3511
Prevent crash in dataclasses with no-init params by @NeilGirdhar in Prevent crash in dataclasses with no-init params #3514
[nnx] Variable referece sharing by @cgarciae in [nnx] Variable referece sharing #3516
Added NNX/Linen API consistency test for Linear/Dense layer by @Micky774 in Added NNX/Linen API consistency test for Linear/Dense layer #3509
Add missing mask argument to LayerNorm, RMSNorm, and GroupNorm. by @carlosgmartin in Add missing mask argument to LayerNorm, RMSNorm, and GroupNorm. #3510
[nnx] Fix graph_utils bug by @cgarciae in [nnx] Fix graph_utils bug #3518
remove deprecated normalize function by @chiamp in remove deprecated normalize function #3531
Reduced number of parameterizations for Conv NNX/Linen consistency test by @Micky774 in Reduced number of parameterizations for Conv NNX/Linen consistency test #3526
Ensure that _hashable_filter does not convert strings to a tuple of letters by @copybara-service in Ensure that _hashable_filter does not convert strings to a tuple of letters #3533
added sow attention weights by @chiamp in added sow attention weights #3529
Fix scan out_axes by @cgarciae in Fix scan out_axes #3540
updated embed docstring by @chiamp in updated embed docstring #3539
add test_scan_negative_axes by @cgarciae in add test_scan_negative_axes #3542
add module methods to api docs by @chiamp in add module methods to api docs #3544
fixed double backquote code font by @chiamp in fixed double backquote code font #3545
add nnx conv support for int kernel size by @chiamp in add nnx conv support for int kernel size #3537
added sow attention weights to NNX by @chiamp in added sow attention weights to NNX #3548
changed return_weights to sow_weights for attention layer by @chiamp in changed return_weights to sow_weights for attention layer #3550
format linen_linear_test.py by @chiamp in format linen_linear_test.py #3553
re-factored features arg by @chiamp in re-factored features arg #3554
updated NNX readme by @chiamp in updated NNX readme #3556
Disable ruff sort imports by @cgarciae in Disable ruff sort imports #3560
Add StateVariablesMapping by @cgarciae in Add StateVariablesMapping #3523
add kwargs support for nn.jit by @copybara-service in add kwargs support for nn.jit #3559
[nnx] Fix readme install instruction by @cgarciae in [nnx] Fix readme install instruction #3565
implement Rng.getattr by @cgarciae in implement Rng.__getattr__ #3547
[nnx] add qkv_features back to MHA by @cgarciae in [nnx] add qkv_features back to MHA #3566
updated readme by @chiamp in updated readme #3563
fixed typo by @chiamp in fixed typo #3561
Raise an error for a bad key type by @NeilGirdhar in Raise an error for a bad key type #3527
re-factored nnx initializers by @chiamp in re-factored nnx initializers #3555
[nnx] Add complex test with scan + batchnorm + dropout by @cgarciae in [nnx] Add complex test with scan + batchnorm + dropout #3567
[nnx] Add interacting with JAX section to README by @cgarciae in [nnx] Add interacting with JAX section to README #3573
expose ones and zeros initializers by @chiamp in expose ones and zeros initializers #3574
Fix promotion bug in MultiHeadDotProductAttention: by @giovannic in Fix promotion bug in MultiHeadDotProductAttention: #3571
fixed error doc formatting by @chiamp in fixed error doc formatting #3587
[nnx] Improve spmd by @cgarciae in [nnx] Improve spmd #3580
[nnx] improve graph_utils._set_key_tuple by @cgarciae in [nnx] improve graph_utils._set_key_tuple #3592
[nnx] Fix variable unflatten by @cgarciae in [nnx] Fix variable unflatten #3578
[nnx] add open in colab button to why nnx by @cgarciae in [nnx] add open in colab button to why nnx #3596
[nnx] Export missing symbols by @cgarciae in [nnx] Export missing symbols #3583
[nnx] flaglib add get overloads by @cgarciae in [nnx] flaglib add get overloads #3582
Fix type in NNX readme by @shoyer in Fix type in NNX readme #3591
[nnx] add submodule iterator by @cgarciae in [nnx] add submodule iterator #3581
[nnx] delete flaglib duplicated copyright comment by @cgarciae in [nnx] delete flaglib duplicated copyright comment #3600
fixed NNX decode and dynamic slicing by @chiamp in fixed NNX decode and dynamic slicing #3576
[nnx] cleanup CallableProxy by @cgarciae in [nnx] cleanup CallableProxy #3608
[nnx] improve runtime flags by @cgarciae in [nnx] improve runtime flags #3607
fixed broken links on quick start guide by @chiamp in fixed broken links on quick start guide #3610
added multiheadattention alias by @chiamp in added multiheadattention alias #3572
Rollback of Copybara import of the project: by @copybara-service in Rollback of Copybara import of the project: #3612
add missing docs for module functions by @cgarciae in add missing docs for module functions #3619
fix lm1b data sharding by @cgarciae in fix lm1b data sharding #3620
improve embed by @jianyizh in improve embed #3590
disable ruff linter by @chiamp in disable ruff linter #3625
Add compact_name_scope decorator by @cgarciae in Add compact_name_scope decorator #3621
Copybara import of the project: by @copybara-service in Copybara import of the project: #3638
added BatchApply by @chiamp in added BatchApply #3634
add compact_name_scope v2 by @copybara-service in add compact_name_scope v2 #3640
add compact_name_scope v2 by @copybara-service in add compact_name_scope v2 #3642
release 0.8.0 by @chiamp in release 0.8.0 #3644

New Contributors

@superbobry made their first contribution in Forked a subset of JAX configuration APIs #3448
@VictorPrins made their first contribution in Add dataset loading guide (Issue #2116) #3450
@zhaoyang-0204 made their first contribution in fix bug in optimizer-api.md #3462
@Micky774 made their first contribution in Improved Rigor of PReLU Test #3498
@HMUNACHI made their first contribution in added geglu activation and tests #3512
@carlosgmartin made their first contribution in Add missing mask argument to LayerNorm, RMSNorm, and GroupNorm. #3510
@giovannic made their first contribution in Fix promotion bug in MultiHeadDotProductAttention: #3571
@jianyizh made their first contribution in improve embed #3590

Full Changelog: v0.7.5...v0.8.0

This discussion was created from the release v0.8.0.

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment