Skip to content

Reduce test flakiness #69

Reduce test flakiness

Reduce test flakiness #69

Triggered via push January 26, 2024 06:15
Status Success
Total duration 7m 26s
Artifacts 19

ci.yml

on: push
Matrix: e2e-tests
merge-reports
26s
merge-reports
Fit to window
Zoom out
Zoom in

Annotations

5 errors, 18 warnings, and 16 notices
[webkit] β€Ί routing.spec.ts:22:5 β€Ί warns on invalid share links: tests/routing.spec.ts#L34
1) [webkit] β€Ί routing.spec.ts:22:5 β€Ί warns on invalid share links ──────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('heading', { name: 'Choose a template to begin' }) Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Choose a template to begin' }) 32 | await expect( 33 | page.getByRole('heading', { name: 'Choose a template to begin' }), > 34 | ).toBeVisible(); | ^ 35 | }); 36 | 37 | test('successfully imports fixtures/single_signature_p2pkh.share-link.json', async ({ at /__w/bitauth-ide/bitauth-ide/tests/routing.spec.ts:34:5
[firefox] β€Ί editor.spec.ts:64:5 β€Ί ignores misleading unicode characters: tests/editor.spec.ts#L1
1) [firefox] β€Ί editor.spec.ts:64:5 β€Ί ignores misleading unicode characters, shows compilation on hover Test timeout of 30000ms exceeded.
[firefox] β€Ί editor.spec.ts:64:5 β€Ί ignores misleading unicode characters: tests/test-utils.ts#L91
1) [firefox] β€Ί editor.spec.ts:64:5 β€Ί ignores misleading unicode characters, shows compilation on hover Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('button', { name: 'Import Template' }) - locator resolved to <button disabled type="button" tabindex="-1" class="bp5-…>…</button> - attempting click action - waiting for element to be visible, enabled and stable - element is not enabled - waiting... at test-utils.ts:91 89 | const fileChooser = await fileChooserPromise; 90 | await fileChooser.setFiles(path); > 91 | await page.getByRole('button', { name: 'Import Template' }).click(); | ^ 92 | }; 93 | 94 | /** at loadTemplate (/__w/bitauth-ide/bitauth-ide/tests/test-utils.ts:91:63) at /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts:67:3
[webkit] β€Ί welcome.spec.ts:3:5 β€Ί logs welcome message to console: tests/welcome.spec.ts#L1
1) [webkit] β€Ί welcome.spec.ts:3:5 β€Ί logs welcome message to console, indicates development/production mode Test timeout of 30000ms exceeded.
[webkit] β€Ί welcome.spec.ts:3:5 β€Ί logs welcome message to console: tests/welcome.spec.ts#L18
1) [webkit] β€Ί welcome.spec.ts:3:5 β€Ί logs welcome message to console, indicates development/production mode Error: expect(received).toContain(expected) // indexOf Expected substring: "Bitauth IDE is installed locally and ready to use offline." Received string: "%cWelcome to Bitauth IDE!Β·Β·Β· %cThe %clibauth%c library is available at%c libauth%c (%cwindow.libauth%c). You can click a line in the evaluation viewer to inspect the program state at that point in the evaluation.Β· %cTip: to quickly stringify an object which %cJSON.stringify%c doesn't support, try%c libauth.stringify%c. font-weight: bold; color: #2a5b8b; font-weight: bold; color: #cb1b15; font-weight: bold; color: #cb1b15; font-weight: bold; color: #888; font-style: italic; color: #cb1b15; font-weight: bold; font-style: italic; color: #888; font-style: italic; color: #cb1b15; font-weight: bold; font-style: italic; color: #888; font-style: italic;" Call Log: - Test timeout of 30000ms exceeded 16 | : 'Bitauth IDE is running in development mode.', 17 | ); > 18 | }).toPass(); | ^ 19 | }); 20 | 21 | preFixturesTest( at /__w/bitauth-ide/bitauth-ide/tests/welcome.spec.ts:18:6
lint
The process '/usr/bin/git' failed with exit code 128
e2e-tests (dev, 2/8)
The process '/usr/bin/git' failed with exit code 128
e2e-tests (prod, 2/8)
The process '/usr/bin/git' failed with exit code 128
e2e-tests (dev, 8/8)
The process '/usr/bin/git' failed with exit code 128
e2e-tests (dev, 4/8)
The process '/usr/bin/git' failed with exit code 128
e2e-tests (dev, 1/8)
The process '/usr/bin/git' failed with exit code 128
e2e-tests (dev, 6/8)
The process '/usr/bin/git' failed with exit code 128
e2e-tests (prod, 4/8)
The process '/usr/bin/git' failed with exit code 128
e2e-tests (prod, 1/8)
The process '/usr/bin/git' failed with exit code 128
e2e-tests (dev, 3/8)
The process '/usr/bin/git' failed with exit code 128
e2e-tests (prod, 3/8)
The process '/usr/bin/git' failed with exit code 128
e2e-tests (dev, 7/8)
The process '/usr/bin/git' failed with exit code 128
e2e-tests (dev, 5/8)
The process '/usr/bin/git' failed with exit code 128
e2e-tests (prod, 8/8)
The process '/usr/bin/git' failed with exit code 128
e2e-tests (prod, 6/8)
The process '/usr/bin/git' failed with exit code 128
e2e-tests (prod, 5/8)
The process '/usr/bin/git' failed with exit code 128
e2e-tests (prod, 7/8)
The process '/usr/bin/git' failed with exit code 128
merge-reports
The process '/usr/bin/git' failed with exit code 128
🎭 Playwright Run Summary
22 passed (1.6m)
🎭 Playwright Run Summary
22 passed (1.2m)
🎭 Playwright Run Summary
21 passed (1.9m)
🎭 Playwright Run Summary
21 passed (2.1m)
🎭 Playwright Run Summary
22 passed (2.1m)
🎭 Playwright Run Summary
1 flaky [webkit] β€Ί routing.spec.ts:22:5 β€Ί warns on invalid share links ───────────────────────────────── 20 passed (2.0m)
🎭 Playwright Run Summary
21 passed (1.4m)
🎭 Playwright Run Summary
22 passed (1.7m)
🎭 Playwright Run Summary
21 passed (2.5m)
🎭 Playwright Run Summary
1 flaky [firefox] β€Ί editor.spec.ts:64:5 β€Ί ignores misleading unicode characters, shows compilation on hover 20 passed (2.3m)
🎭 Playwright Run Summary
21 passed (3.0m)
🎭 Playwright Run Summary
21 passed (3.0m)
🎭 Playwright Run Summary
21 passed (2.2m)
🎭 Playwright Run Summary
1 flaky [webkit] β€Ί welcome.spec.ts:3:5 β€Ί logs welcome message to console, indicates development/production mode 20 passed (2.6m)
🎭 Playwright Run Summary
21 passed (3.6m)
🎭 Playwright Run Summary
21 passed (3.9m)

Artifacts

Produced during runtime
Name Size
blob-report-dev-1 Expired
38.6 KB
blob-report-dev-2 Expired
30 KB
blob-report-dev-3 Expired
37.1 KB
blob-report-dev-4 Expired
28.8 KB
blob-report-dev-5 Expired
37.3 KB
blob-report-dev-6 Expired
722 KB
blob-report-dev-7 Expired
37.2 KB
blob-report-dev-8 Expired
29.5 KB
blob-report-prod-1 Expired
41 KB
blob-report-prod-2 Expired
33.3 KB
blob-report-prod-3 Expired
1.06 MB
blob-report-prod-4 Expired
31.6 KB
blob-report-prod-5 Expired
40.1 KB
blob-report-prod-6 Expired
956 KB
blob-report-prod-7 Expired
39.9 KB
blob-report-prod-8 Expired
31.6 KB
dist Expired
7.18 MB
html-report-dev--run-1 Expired
1.23 MB
html-report-prod--run-1 Expired
2.5 MB