Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[sharding_in_types] Support shard_map with sharding in types. Right now only full manual mode is supported. #24894

Merged
merged 1 commit into from
Nov 14, 2024
Merged

[sharding_in_types] Support shard_map with sharding in types. Right now only full manual mode is supported. #24894

merged 1 commit into from
Nov 14, 2024
+134 −42

Commits on Nov 14, 2024

  1. [sharding_in_types] Support shard_map with sharding in types. Right n… 

    …ow only full manual mode is supported.

This change also adds AxisTypes to Mesh which are `User`, `Auto` and `Collective`.

In the following changes, I'll remove the `config.sharding_in_types` flag and we'll enter into various modes via AxisTypes mentioned on the mesh.

PiperOrigin-RevId: 696559375
    @yashk2810 @Google-ML-Automation
    yashk2810 authored and Google-ML-Automation committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    05716b5 View commit details
    Browse the repository at this point in the history