Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[tuner]: use iree_gpu.MMAIntrinsic and iree_gpu.MMAAttr #605

Merged
merged 5 commits into from
Nov 26, 2024

Conversation

bangtianliu
Copy link
Contributor

@bangtianliu bangtianliu commented Nov 25, 2024

Remove the data class MfmaIntrinsic from the codebase, and use IREE attributes ( iree_gpu.MMAIntrinsic and iree_gpu.MMAAttr ) for MFMA intrinsics in the tuner.

Motivation for this PR: The original MLIR processing relies heavily on string-based operations, making it fragile and prone to breaking with updates to the IREE Compiler. To address this, we aim to leverage key attributes directly through IREE Python bindings, enabled by exposing these attributes. For more details, refer to this issue.

Copy link
Member

@kuhar kuhar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In the PR description, could you include the motivation behind this change?

tuner/tuner/candidate_gen_test.py Outdated Show resolved Hide resolved
tuner/tuner/common.py Outdated Show resolved Hide resolved
tuner/tuner/common_test.py Show resolved Hide resolved
tuner/tuner/dispatch_constraints.py Outdated Show resolved Hide resolved
tuner/tuner/dispatch_constraints.py Outdated Show resolved Hide resolved
Copy link
Member

@kuhar kuhar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, just a couple of remaining issues

tuner/tuner/dispatch_constraints.py Outdated Show resolved Hide resolved
tuner/tuner/dispatch_constraints.py Outdated Show resolved Hide resolved
Signed-off-by: Bangtian Liu <liubangtian@gmail.com>
Signed-off-by: Bangtian Liu <liubangtian@gmail.com>
Signed-off-by: Bangtian Liu <liubangtian@gmail.com>
Signed-off-by: Bangtian Liu <liubangtian@gmail.com>
Copy link
Member

@kuhar kuhar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM % one suggestion. Thanks for all the fixes.

tuner/tuner/dispatch_constraints.py Outdated Show resolved Hide resolved
Signed-off-by: Bangtian Liu <liubangtian@gmail.com>
@kuhar kuhar merged commit 6bb24a3 into nod-ai:main Nov 26, 2024
4 of 8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants