Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: Only run bench-packages in the next branch #29626

Closed
wants to merge 3 commits into from

Conversation

yannbf
Copy link
Member

@yannbf yannbf commented Nov 15, 2024

Closes #

What I did

The bench-packages script is failing in multiple occasions (apart from when it runs in the next branch), and as we don't have the time right now to fix it, we disable it.

Checklist for Contributors

Testing

The changes in this PR are covered in the following automated tests:

  • stories
  • unit tests
  • integration tests
  • end-to-end tests

Manual testing

This section is mandatory for all contributions. If you believe no manual test is necessary, please state so explicitly. Thanks!

Documentation

  • Add or update documentation reflecting your changes
  • If you are deprecating/removing a feature, make sure to update
    MIGRATION.MD

Checklist for Maintainers

  • When this PR is ready for testing, make sure to add ci:normal, ci:merged or ci:daily GH label to it to run a specific set of sandboxes. The particular set of sandboxes can be found in code/lib/cli-storybook/src/sandbox-templates.ts

  • Make sure this PR contains one of the labels below:

    Available labels
    • bug: Internal changes that fixes incorrect behavior.
    • maintenance: User-facing maintenance tasks.
    • dependencies: Upgrading (sometimes downgrading) dependencies.
    • build: Internal-facing build tooling & test updates. Will not show up in release changelog.
    • cleanup: Minor cleanup style change. Will not show up in release changelog.
    • documentation: Documentation only changes. Will not show up in release changelog.
    • feature request: Introducing a new feature.
    • BREAKING CHANGE: Changes that break compatibility in some way with current major version.
    • other: Changes that don't fit in the above categories.

🦋 Canary release

This PR does not have a canary release associated. You can request a canary release of this pull request by mentioning the @storybookjs/core team here.

core team members can create a canary release here or locally with gh workflow run --repo storybookjs/storybook canary-release-pr.yml --field pr=<PR_NUMBER>

name before after diff z %
createSize 0 B 0 B 0 B - -
generateSize 78.5 MB 78.5 MB -6.84 kB 1.06 0%
initSize 144 MB 144 MB -6.84 kB 1.07 0%
diffSize 65.2 MB 65.2 MB 0 B 1.45 0%
buildSize 6.87 MB 6.87 MB 0 B -1.1 0%
buildSbAddonsSize 1.51 MB 1.51 MB 0 B - 0%
buildSbCommonSize 195 kB 195 kB 0 B - 0%
buildSbManagerSize 1.9 MB 1.9 MB 0 B 0.97 0%
buildSbPreviewSize 271 kB 271 kB 0 B - 0%
buildStaticSize 0 B 0 B 0 B - -
buildPrebuildSize 3.88 MB 3.88 MB 0 B 0.97 0%
buildPreviewSize 2.99 MB 2.99 MB 0 B -1.11 0%
testBuildSize 0 B 0 B 0 B - -
testBuildSbAddonsSize 0 B 0 B 0 B - -
testBuildSbCommonSize 0 B 0 B 0 B - -
testBuildSbManagerSize 0 B 0 B 0 B - -
testBuildSbPreviewSize 0 B 0 B 0 B - -
testBuildStaticSize 0 B 0 B 0 B - -
testBuildPrebuildSize 0 B 0 B 0 B - -
testBuildPreviewSize 0 B 0 B 0 B - -
name before after diff z %
createTime 13.2s 17.6s 4.3s 0.45 24.7%
generateTime 35.1s 21.9s -13s -131ms -0.16 -59.8%
initTime 15.3s 15.7s 392ms 0.28 2.5%
buildTime 8.8s 8.4s -442ms -0.39 -5.3%
testBuildTime 0ms 0ms 0ms - -
devPreviewResponsive 6s 5.5s -539ms -0.23 -9.7%
devManagerResponsive 3.7s 3.2s -486ms -0.78 -15%
devManagerHeaderVisible 513ms 578ms 65ms 0.26 11.2%
devManagerIndexVisible 580ms 633ms 53ms 0.11 8.4%
devStoryVisibleUncached 932ms 854ms -78ms -0.79 -9.1%
devStoryVisible 547ms 607ms 60ms -0.03 9.9%
devAutodocsVisible 540ms 369ms -171ms -2.53 🔰-46.3%
devMDXVisible 515ms 497ms -18ms -0.1 -3.6%
buildManagerHeaderVisible 567ms 587ms 20ms 0.21 3.4%
buildManagerIndexVisible 577ms 599ms 22ms 0.13 3.7%
buildStoryVisible 565ms 588ms 23ms 0.25 3.9%
buildAutodocsVisible 456ms 439ms -17ms -0.76 -3.9%
buildMDXVisible 412ms 425ms 13ms -0.31 3.1%

Greptile Summary

Let me provide a clear and concise summary of the changes in this pull request:

Modifies CircleCI configuration to restrict the bench-packages job execution to only run on the next branch due to recurring failures in other scenarios.

  • Added branch filters in .circleci/config.yml to limit bench-packages job execution
  • Affects all CI workflows (normal, merged, daily)
  • Temporary solution until the team has time to properly fix the failing bench-packages script
  • Change is purely CI/build related and does not affect functionality

The change is focused on improving CI stability by limiting a problematic benchmark job to a specific branch where it's known to work correctly.

@yannbf yannbf added build Internal-facing build tooling & test updates ci:normal labels Nov 15, 2024
Copy link
Contributor

@greptile-apps greptile-apps bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

1 file(s) reviewed, no comment(s)
Edit PR Review Bot Settings | Greptile

Copy link

nx-cloud bot commented Nov 15, 2024

☁️ Nx Cloud Report

CI is running/has finished running commands for commit 54f7137. As they complete they will appear below. Click to see the status, the terminal output, and the build insights.

📂 See all runs for this CI Pipeline Execution


✅ Successfully ran 1 target

Sent with 💌 from NxCloud.

@storybook-pr-benchmarking
Copy link

storybook-pr-benchmarking bot commented Nov 15, 2024

Package Benchmarks

Commit: 54f7137, ran on 18 November 2024 at 15:13:28 UTC

No significant changes detected, all good. 👏

@yannbf yannbf self-assigned this Nov 18, 2024
@yannbf
Copy link
Member Author

yannbf commented Nov 22, 2024

This does not seem to be necessary anymore!

@yannbf yannbf closed this Nov 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build Internal-facing build tooling & test updates ci:normal
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

2 participants