Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add workflow call #47

Merged
merged 14 commits into from
Sep 12, 2023
Merged

Add workflow call #47

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
e54f9f0
Add workflow call
fivegrant Sep 11, 2023
1719251
Use dispatch instead
fivegrant Sep 11, 2023
8eaab35
Force GH run
fivegrant Sep 11, 2023
04f1181
[revert this!] mock ta1
fivegrant Sep 11, 2023
46d9df9
Use secrets
fivegrant Sep 11, 2023
99f4ff2
Fix secret usage
fivegrant Sep 11, 2023
37c67a4
Revert back to no mocking
fivegrant Sep 12, 2023
6b21cfe
Use specific environment
fivegrant Sep 12, 2023
2530a81
Explicitly include vars
fivegrant Sep 12, 2023
93832e1
Run report on push on not on PR itself
fivegrant Sep 12, 2023
b41b2ea
Use push truly
fivegrant Sep 12, 2023
31ae006
Comment out F1 Scores
fivegrant Sep 12, 2023
addb8ac
Remove execution of GH Action
fivegrant Sep 12, 2023
2794208
Merge branch 'main' into fg/onworkflowcall
fivegrant Sep 12, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 11 additions & 4 deletions .github/workflows/report.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,11 +1,10 @@
---
name: Report
on:
schedule:
- cron: "0 1 * * 1"
on: workflow_dispatch
jobs:
test:
runs-on: ubuntu-latest
environment: "non-terarium ta1 deployments"
steps:
- uses: actions/checkout@v3
- name: Set up Python 3.10
Expand All @@ -23,5 +22,13 @@ jobs:
run: |
poetry install
- name: Run report
env:
AWS_ACCESS_KEY_ID: ${{secrets.AWS_PROD_ACCESS_KEY_ID}}
AWS_SECRET_ACCESS_KEY: ${{secrets.AWS_PROD_SECRET_ACCESS_KEY}}
BUCKET: ${{secrets.AWS_PROD_BUCKET}}
SKEMA_RS_URL: ${{vars.SKEMA_RS_URL}}
TA1_UNIFIED_URL: ${{vars.TA1_UNIFIED_URL}}
MIT_TR_URL: ${{vars.MIT_TR_URL}}
MOCK_TA1: ${{vars.MOCK_TA1}}
run: >
MOCK_TA1=FALSE poetry run poe report
poetry run poe report
11 changes: 5 additions & 6 deletions tests/test_e2e.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -160,8 +160,8 @@ def test_code_to_amr(
), f"AMR failed to validate to its provided schema: {amr_instance.validation_error}"

#### POSTAMBLE ####
if 'amr' in locals():
record_quality_check(context_dir, "code_to_amr", "F1 Score", amr_instance.f1(amr))
# if 'amr' in locals():
# record_quality_check(context_dir, "code_to_amr", "F1 Score", amr_instance.f1(amr))


@pytest.mark.parametrize("resource", params["equations_to_amr"])
Expand Down Expand Up @@ -265,10 +265,9 @@ def write_to_fake_configs(req, resp):
assert storage[1].get("model_id") == "test2"

#### POSTAMBLE ####
if "amr" in locals():
record_quality_check(
context_dir, "equations_to_amr", "F1 Score", amr_instance.f1(amr)
)
# if 'amr' in locals():
# record_quality_check(context_dir, "equations_to_amr", "F1 Score", amr_instance.f1(amr))



@pytest.mark.parametrize("resource", params["profile_dataset"])
Expand Down