-
Notifications
You must be signed in to change notification settings - Fork 49
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
chore(deps): update dependency accelerate to v0.33.0 #273
Open
renovate
wants to merge
1
commit into
main
Choose a base branch
from
renovate/accelerate-0.x
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
453e00e
to
469bf27
Compare
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #273 +/- ##
=======================================
Coverage 37.00% 37.00%
=======================================
Files 23 23
Lines 1481 1481
Branches 202 202
=======================================
Hits 548 548
Misses 925 925
Partials 8 8 ☔ View full report in Codecov by Sentry. |
469bf27
to
ad79ee0
Compare
ad79ee0
to
b662480
Compare
6738e00
to
c03be08
Compare
c03be08
to
529abe5
Compare
529abe5
to
f27a701
Compare
f27a701
to
46fc1d9
Compare
46fc1d9
to
0ae38f8
Compare
0ae38f8
to
d978882
Compare
d978882
to
3d307ca
Compare
3d307ca
to
8cc06e0
Compare
8cc06e0
to
e01f6db
Compare
e01f6db
to
aab84a4
Compare
aab84a4
to
dd3f09d
Compare
dd3f09d
to
cb0c4b6
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR contains the following updates:
==0.24.1
->==0.33.0
Release Notes
huggingface/accelerate (accelerate)
v0.33.0
Compare Source
v0.32.1
Compare Source
v0.32.0
: : Profilers, new hooks, speedups, and more!Compare Source
Core
huggingface_hub
rather than our own implementation (https://github.com/huggingface/accelerate/pull/2795)dispatch_model
(https://github.com/huggingface/accelerate/pull/2855)Accelerator.step
number is now restored when usingsave_state
andload_state
(https://github.com/huggingface/accelerate/pull/2765)import accelerate
and any other major core import by 68%, now should be only slightly longer than doingimport torch
(https://github.com/huggingface/accelerate/pull/2845)get_backend
and added aclear_device_cache
utility (https://github.com/huggingface/accelerate/pull/2857)Distributed Data Parallelism
allreduce
. (https://github.com/huggingface/accelerate/pull/2841)log_line_prefix_template
optional thenotebook_launcher
(https://github.com/huggingface/accelerate/pull/2888)FSDP
accelerate merge-weights
, one will be automatically created (https://github.com/huggingface/accelerate/pull/2854).safetensors
(https://github.com/huggingface/accelerate/pull/2853)XPU
torch>=2.4
(https://github.com/huggingface/accelerate/pull/2825)@require_triton
test decorator and enabletest_dynamo
work on xpu (https://github.com/huggingface/accelerate/pull/2878)load_state_dict
not working onxpu
and refine xpusafetensors
version check (https://github.com/huggingface/accelerate/pull/2879)XLA
Examples
accelerate launch
(https://github.com/huggingface/accelerate/pull/2902)Full Changelog
dispatch_model
by @panjd123 in https://github.com/huggingface/accelerate/pull/2855test_tracking.ClearMLTest
by @faaany in https://github.com/huggingface/accelerate/pull/2863torch_device
instead of0
for device check by @faaany in https://github.com/huggingface/accelerate/pull/2861test_zero3_integration
by @faaany in https://github.com/huggingface/accelerate/pull/2864log_line_prefix_template
Optional in Elastic Launcher for Backward Compatibility by @yhna940 in https://github.com/huggingface/accelerate/pull/2888require_triton
and enabletest_dynamo
work on xpu by @faaany in https://github.com/huggingface/accelerate/pull/2878load_state_dict
for xpu and refine xpu safetensor version check by @faaany in https://github.com/huggingface/accelerate/pull/2879New Contributors
Full Changelog: huggingface/accelerate@v0.31.0...v0.32.0
v0.31.0
: : Better support for sharded state dict with FSDP and BugfixesCompare Source
Core
timeout
default to PyTorch defaults based on backend by @muellerzr in https://github.com/huggingface/accelerate/pull/2758notebook_launcher
by @yhna940 in https://github.com/huggingface/accelerate/pull/2788FSDP
Megatron
What's Changed
logging
to log the actual user call site (instead of the call site inside the logger wrapper) of log functions by @luowyang in https://github.com/huggingface/accelerate/pull/2730notebook_launcher
by @yhna940 in https://github.com/huggingface/accelerate/pull/2788get_balanced_memory
by @faaany in https://github.com/huggingface/accelerate/pull/2826stage3_prefetch_bucket_size
value to an integer by @adk9 in https://github.com/huggingface/accelerate/pull/2814New Contributors
Full Changelog: huggingface/accelerate@v0.30.1...v0.31.0
v0.30.1
: : BugfixesCompare Source
Patchfix
Full Changelog: huggingface/accelerate@v0.30.0...v0.30.1
v0.30.0
: : Advanced optimizer support, MoE DeepSpeed support, add upcasting for FSDP, and moreCompare Source
Core
tqdm
wrapper to make it fully passthrough, no need to havetqdm(main_process_only, *args)
, it is now justtqdm(*args)
and you can pass inis_main_process
as a kwarg.cann
version info to command accelerate env for NPU by @statelesshz in https://github.com/huggingface/accelerate/pull/2689Documentation
DeepSpeed
deepspeed
-specific Docker image by @muellerzr in https://github.com/huggingface/accelerate/pull/2707. To use, pull thegpu-deepspeed
tagdocker pull huggingface/accelerate:cuda-deepspeed-nightly
Megatron
Big Modeling
Bug Fixes
is_train_batch_min
type in DeepSpeedPlugin by @yhna940 in https://github.com/huggingface/accelerate/pull/2646free_memory
to deal with garbage collection by @muellerzr in https://github.com/huggingface/accelerate/pull/2716Full Changelog
execution_device
by @faaany in https://github.com/huggingface/accelerate/pull/2612is_train_batch_min
type in DeepSpeedPlugin by @yhna940 in https://github.com/huggingface/accelerate/pull/2646Repository
anymore by @Wauplin in https://github.com/huggingface/accelerate/pull/2658tqdm
:*args
should come ahead ofmain_process_only
by @rb-synth in https://github.com/huggingface/accelerate/pull/2654free_memory
to deal with garbage collection by @muellerzr in https://github.com/huggingface/accelerate/pull/2716New Contributors
Full Changelog: huggingface/accelerate@v0.29.3...v0.30.0
v0.29.3
: : PatchfixCompare Source
load_checkpoint_and_dispatch
needs astrict
argumentFull Changelog: huggingface/accelerate@v0.29.2...v0.29.3
v0.29.2
: : PatchfixCompare Source
v0.29.1
: : PatchfixCompare Source
Fixed an import which would cause running accelerate CLI to fail if pytest wasn't installed
v0.29.0
: : NUMA affinity control, MLU Support, and DeepSpeed ImprovementsCompare Source
Core
accelerate config
, set theACCELERATE_CPU_AFFINITY=1
env variable, or manually using the following:Big thanks to @stas00 for the recommendation, request, and feedback during development
set_seed
by @muellerzr in https://github.com/huggingface/accelerate/pull/2569BatchSamplerShard
by @universuen in https://github.com/huggingface/accelerate/pull/2584notebook_launcher
can use multiple GPUs in Google Colab if using a custom instance that supports multiple GPUs by @StefanTodoran in https://github.com/huggingface/accelerate/pull/2561Big Model Inference
load_checkpoint_in_model
behavior when unexpected keys are in the checkpoint by @fxmarty in https://github.com/huggingface/accelerate/pull/2588DeepSpeed
main_process_ip
andmaster_addr
when not using standard as deepspeed launcher by @asdfry in https://github.com/huggingface/accelerate/pull/2495deepspeed
, set it with theDS_ENV_FILE
environmental variable by @muellerzr in https://github.com/huggingface/accelerate/pull/2566What's Changed
main_process_ip
andmaster_addr
when not using standard as deepspeed launcher by @asdfry in https://github.com/huggingface/accelerate/pull/2495load_checkpoint_in_model
behavior when unexpected keys are in the checkpoint by @fxmarty in https://github.com/huggingface/accelerate/pull/2588New Contributors
Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR was generated by Mend Renovate. View the repository job log.