Small improvements to cody bench context (#5641) #21725
beyangci.yml
on: push
fast_tests_matrix_prep
0s
slow_tests_matrix_prep
0s
build
2m 12s
Matrix: test-integration
Matrix: test-unit
Matrix: test-e2e
Annotations
18 errors, 14 warnings, and 2 notices
|
test-unit (ubuntu, 20)
The v0 series of google-github-actions/auth is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions:
https://github.com/google-github-actions/auth
|
|
test-unit (ubuntu, 20)
The v0 series of google-github-actions/setup-gcloud is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions:
https://github.com/google-github-actions/setup-gcloud
|
|
test-unit (ubuntu, 18)
The v0 series of google-github-actions/setup-gcloud is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions:
https://github.com/google-github-actions/setup-gcloud
|
|
test-unit (ubuntu, 18)
The v0 series of google-github-actions/auth is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions:
https://github.com/google-github-actions/auth
|
|
test-unit (macos, 20)
The v0 series of google-github-actions/auth is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions:
https://github.com/google-github-actions/auth
|
|
test-unit (macos, 20)
The v0 series of google-github-actions/setup-gcloud is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions:
https://github.com/google-github-actions/setup-gcloud
|
|
test-unit (windows, 20)
The v0 series of google-github-actions/auth is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions:
https://github.com/google-github-actions/auth
|
|
test-unit (windows, 20)
The v0 series of google-github-actions/setup-gcloud is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions:
https://github.com/google-github-actions/setup-gcloud
|
|
command-edit.test.ts:95:1 › edit (fixup) input - range selection:
vscode\test\e2e\command-edit.test.ts#L113
1) command-edit.test.ts:95:1 › edit (fixup) input - range selection ──────────────────────────────
Error: expect(locator).toBeVisible()
Locator: getByText('Nearest Code Block')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('Nearest Code Block')
111 | // Check the correct range item is auto-selected
112 | const rangeItem = page.getByText('Nearest Code Block')
> 113 | expect(rangeItem).toBeVisible()
| ^
114 |
115 | // Open the range input and check it has the correct item selected
116 | await rangeItem.click()
at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:113:23
|
|
initial-context.test.ts:38:18 › initial context - file:
vscode\test\e2e\initial-context.test.ts#L1
2) initial-context.test.ts:38:18 › initial context - file ────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
|
initial-context.test.ts:38:18 › initial context - file:
vscode\test\e2e\initial-context.test.ts#L1
2) initial-context.test.ts:38:18 › initial context - file ────────────────────────────────────────
Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\initial_context___file\temp-videos\9d606fa4624000a03263f03e0813b86a.webm' -> 'D:\a\cody\cody\playwright\initial_context___file\videos\run_0_retry_0_failure.webm'
|
|
initial-context.test.ts:38:18 › initial context - file:
vscode\test\e2e\common.ts#L173
2) initial-context.test.ts:38:18 › initial context - file ────────────────────────────────────────
Error: locator.fill: Application exited
Call log:
- waiting for getByPlaceholder('Type the name of a command to run.')
- locator resolved to <input wrap="off" type="text" class="input" role="combo…/>
- fill("main.c")
- attempting fill action
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #1
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #20
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #21
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #22
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill
|
|
initial-context.test.ts:38:18 › initial context - file:
vscode\test\e2e\initial-context.test.ts#L1
2) initial-context.test.ts:38:18 › initial context - file ────────────────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
|
initial-context.test.ts:38:18 › initial context - file:
vscode\test\e2e\common.ts#L173
2) initial-context.test.ts:38:18 › initial context - file ────────────────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.fill: Application exited
Call log:
- waiting for getByPlaceholder('Type the name of a command to run.')
- locator resolved to <input wrap="off" type="text" class="input" role="combo…/>
- fill("main.c")
- attempting fill action
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #1
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #20
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #21
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #22
- waiting 500ms
- waiting f
|
|
initial-context.test.ts:38:18 › initial context - file:
vscode\test\e2e\initial-context.test.ts#L1
2) initial-context.test.ts:38:18 › initial context - file ────────────────────────────────────────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
|
initial-context.test.ts:38:18 › initial context - file:
vscode\test\e2e\common.ts#L173
2) initial-context.test.ts:38:18 › initial context - file ────────────────────────────────────────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.fill: Application exited
Call log:
- waiting for getByPlaceholder('Type the name of a command to run.')
- locator resolved to <input wrap="off" type="text" class="input" role="combo…/>
- fill("main.c")
- attempting fill action
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #1
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #20
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #21
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #22
- waiting 500ms
- waiting f
|
|
test-e2e (macos)
The job running on runner GitHub Actions 24 has exceeded the maximum execution time of 20 minutes.
|
|
test-e2e (macos)
The operation was canceled.
|
|
test-unit (ubuntu, 20)
The following actions use a deprecated Node.js version and will be forced to run on node20: google-github-actions/auth@v0, google-github-actions/setup-gcloud@v0. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
test-unit (ubuntu, 18)
The following actions use a deprecated Node.js version and will be forced to run on node20: google-github-actions/auth@v0, google-github-actions/setup-gcloud@v0. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
test-unit (macos, 20)
The following actions use a deprecated Node.js version and will be forced to run on node20: google-github-actions/auth@v0, google-github-actions/setup-gcloud@v0. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
test-unit (windows, 20)
The following actions use a deprecated Node.js version and will be forced to run on node20: google-github-actions/auth@v0, google-github-actions/setup-gcloud@v0. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
Slow Test:
vscode/chat-atFile.test.ts#L1
vscode/chat-atFile.test.ts took 1.1m
|
|
Slow Test:
vscode/command-custom.test.ts#L1
vscode/command-custom.test.ts took 1.0m
|
|
Slow Test:
vscode/chat-input.test.ts#L1
vscode/chat-input.test.ts took 47.6s
|
|
Slow Test:
vscode/initial-context.test.ts#L1
vscode/initial-context.test.ts took 41.5s
|
|
Slow Test:
vscode/command-edit.test.ts#L1
vscode/command-edit.test.ts took 36.8s
|
|
Slow Test:
vscode\chat-atFile.test.ts#L1
vscode\chat-atFile.test.ts took 1.3m
|
|
Slow Test:
vscode\command-custom.test.ts#L1
vscode\command-custom.test.ts took 1.1m
|
|
Slow Test:
vscode\chat-input.test.ts#L1
vscode\chat-input.test.ts took 54.4s
|
|
Slow Test:
vscode\command-core.test.ts#L1
vscode\command-core.test.ts took 43.7s
|
|
Slow Test:
vscode\code-actions.test.ts#L1
vscode\code-actions.test.ts took 34.1s
|
|
🎭 Playwright Run Summary
3 skipped
42 passed (8.3m)
|
|
🎭 Playwright Run Summary
2 flaky
command-edit.test.ts:95:1 › edit (fixup) input - range selection ───────────────────────────────
initial-context.test.ts:38:18 › initial context - file ─────────────────────────────────────────
3 skipped
40 passed (11.6m)
|