Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NovaX] MacOs x86 Builds on GHA Nova #1129

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
43 changes: 43 additions & 0 deletions .github/workflows/build-conda-macos.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,43 @@
name: Build Macos Conda

on:
pull_request:
push:
branches:
- nightly
- main
- release/*
tags:
# NOTE: Binary build pipelines should only get triggered on release candidate builds
# Release candidate tags look like: v1.11.0-rc1
- v[0-9]+.[0-9]+.[0-9]+-rc[0-9]+
workflow_dispatch:

jobs:
generate-matrix:
uses: pytorch/test-infra/.github/workflows/generate_binary_build_matrix.yml@main
with:
package-type: conda
os: macos
test-infra-repository: pytorch/test-infra
test-infra-ref: main
build:
needs: generate-matrix
name: pytorch/data
uses: pytorch/test-infra/.github/workflows/build_conda_macos.yml@main
with:
conda-package-directory: packaging/torchdata
repository: pytorch/data
ref: ""
test-infra-repository: pytorch/test-infra
test-infra-ref: main
build-matrix: ${{ needs.generate-matrix.outputs.matrix }}
pre-script: ""
post-script: ""
package-name: torchdata
env-var-script: packaging/env-var-script.txt
smoke-test-script: test/smoke_test/smoke_test.py
runner-type: macos-12
trigger-event: dev
secrets:
CONDA_PYTORCHBOT_TOKEN: ${{ secrets.CONDA_PYTORCHBOT_TOKEN }}
43 changes: 43 additions & 0 deletions .github/workflows/build-wheels-macos.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,43 @@
name: Build Macos Wheels

on:
pull_request:
push:
branches:
- nightly
- main
- release/*
tags:
# NOTE: Binary build pipelines should only get triggered on release candidate builds
# Release candidate tags look like: v1.11.0-rc1
- v[0-9]+.[0-9]+.[0-9]+-rc[0-9]+
workflow_dispatch:

jobs:
generate-matrix:
uses: pytorch/test-infra/.github/workflows/generate_binary_build_matrix.yml@main
with:
package-type: wheel
os: macos
test-infra-repository: pytorch/test-infra
test-infra-ref: main
build:
needs: generate-matrix
name: pytorch/data
uses: pytorch/test-infra/.github/workflows/build_wheels_macos.yml@main
with:
repository: pytorch/data
ref: ""
test-infra-repository: pytorch/test-infra
test-infra-ref: main
build-matrix: ${{ needs.generate-matrix.outputs.matrix }}
pre-script: pre_build_script_macos.sh
post-script: ""
package-name: torchdata
env-var-script: packaging/env-var-script.txt
runner-type: macos-12
smoke-test-script: test/smoke_test/smoke_test.py
trigger-event: dev
secrets:
AWS_PYTORCH_UPLOADER_ACCESS_KEY_ID: ${{ secrets.AWS_PYTORCH_UPLOADER_ACCESS_KEY_ID }}
AWS_PYTORCH_UPLOADER_SECRET_ACCESS_KEY: ${{ secrets.AWS_PYTORCH_UPLOADER_SECRET_ACCESS_KEY }}
5 changes: 5 additions & 0 deletions packaging/pre_build_script_macos.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
set -euxo pipefail

pip install cmake ninja
echo "/home/runner/.local/bin" >> "$GITHUB_PATH"
echo $PATH