Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Metadrive: run integration test in jenkins #30104

Closed
wants to merge 26 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
55f3ed9
install POCL
jnewb1 Sep 20, 2023
3008dd6
cleanup the script
jnewb1 Sep 20, 2023
669b8cf
remove cl base image
jnewb1 Sep 20, 2023
1b91262
fix model tests
jnewb1 Sep 20, 2023
38f6786
fix ci pt 2
jnewb1 Sep 20, 2023
51f39d7
PR cleanup
jnewb1 Sep 20, 2023
4538487
that seems to be required for mac
jnewb1 Sep 20, 2023
fbfc0b8
use prebuilt version
jnewb1 Sep 20, 2023
28dad52
Merge remote-tracking branch 'origin/master' into pocl-devcontainer
jnewb1 Sep 20, 2023
44e5f18
metadrive speedup rgb
jnewb1 Sep 28, 2023
5e4df41
test metadrive in jenkins
jnewb1 Sep 29, 2023
eaa0b81
pythonpath
jnewb1 Sep 29, 2023
b011bdd
workspace
jnewb1 Sep 29, 2023
760e9eb
update
jnewb1 Sep 29, 2023
a3c22ed
Merge remote-tracking branch 'origin/master' into metadrive-speedup-rgb
jnewb1 Sep 29, 2023
2788196
update poetry lock
jnewb1 Sep 29, 2023
1515f00
Merge branch 'metadrive-speedup-rgb' into test-metadrive-jenkins
jnewb1 Sep 29, 2023
7776cff
update lockfile
jnewb1 Sep 29, 2023
d84746e
Merge branch 'metadrive-speedup-rgb' into test-metadrive-jenkins
jnewb1 Sep 29, 2023
14e7fd9
update lockfile
jnewb1 Sep 29, 2023
f67bf5c
Merge branch 'metadrive-speedup-rgb' into test-metadrive-jenkins
jnewb1 Sep 29, 2023
f5344b2
Merge remote-tracking branch 'origin/master' into metadrive-speedup-rgb
jnewb1 Sep 29, 2023
75dd482
Merge branch 'metadrive-speedup-rgb' into test-metadrive-jenkins
jnewb1 Sep 29, 2023
edc14a4
Merge branch 'pocl-devcontainer' into test-metadrive-jenkins
jnewb1 Sep 29, 2023
8470eb3
disable warnings
jnewb1 Sep 29, 2023
de7be33
Merge remote-tracking branch 'origin/master' into test-metadrive-jenkins
jnewb1 Oct 2, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 2 additions & 8 deletions .github/workflows/selfdrive_tests.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,6 @@ concurrency:
env:
PYTHONWARNINGS: error
BASE_IMAGE: openpilot-base
CL_BASE_IMAGE: openpilot-base-cl
AZURE_TOKEN: ${{ secrets.AZURE_COMMADATACI_OPENPILOTCI_TOKEN }}

DOCKER_LOGIN: docker login ghcr.io -u ${{ github.actor }} -p ${{ secrets.GITHUB_TOKEN }}
Expand Down Expand Up @@ -236,25 +235,20 @@ jobs:
with:
submodules: true
- uses: ./.github/workflows/setup-with-retry
- name: Build base Docker image
run: eval "$BUILD"
- name: Build Docker image
# Sim docker is needed to get the OpenCL drivers
run: eval "$BUILD_CL"
- name: Build openpilot
run: |
${{ env.RUN }} "scons -j$(nproc)"
# PYTHONWARNINGS triggers a SyntaxError in onnxruntime
- name: Run model replay with ONNX
timeout-minutes: 3
run: |
${{ env.RUN_CL }} "unset PYTHONWARNINGS && \
${{ env.RUN }} "unset PYTHONWARNINGS && \
ONNXCPU=1 CI=1 NO_NAV=1 coverage run selfdrive/test/process_replay/model_replay.py && \
coverage xml"
- name: Run unit tests
timeout-minutes: 4
run: |
${{ env.RUN_CL }} "unset PYTHONWARNINGS && \
${{ env.RUN }} "unset PYTHONWARNINGS && \
$UNIT_TEST selfdrive/modeld && \
coverage xml"
- name: "Upload coverage to Codecov"
Expand Down
6 changes: 0 additions & 6 deletions .github/workflows/tools_tests.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -12,18 +12,12 @@ concurrency:

env:
BASE_IMAGE: openpilot-base
CL_BASE_IMAGE: openpilot-base-cl
DOCKER_LOGIN: docker login ghcr.io -u ${{ github.actor }} -p ${{ secrets.GITHUB_TOKEN }}

BUILD: selfdrive/test/docker_build.sh base

RUN: docker run --shm-size 1G -v $GITHUB_WORKSPACE:/tmp/openpilot -w /tmp/openpilot -e FILEREADER_CACHE=1 -e PYTHONPATH=/tmp/openpilot -e NUM_JOBS -e JOB_ID -e GITHUB_ACTION -e GITHUB_REF -e GITHUB_HEAD_REF -e GITHUB_SHA -e GITHUB_REPOSITORY -e GITHUB_RUN_ID -v $GITHUB_WORKSPACE/.ci_cache/scons_cache:/tmp/scons_cache -v $GITHUB_WORKSPACE/.ci_cache/comma_download_cache:/tmp/comma_download_cache -v $GITHUB_WORKSPACE/.ci_cache/openpilot_cache:/tmp/openpilot_cache $BASE_IMAGE /bin/sh -c

BUILD_CL: selfdrive/test/docker_build.sh cl

RUN_CL: docker run --shm-size 1G -v $GITHUB_WORKSPACE:/tmp/openpilot -w /tmp/openpilot -e PYTHONPATH=/tmp/openpilot -e NUM_JOBS -e JOB_ID -e GITHUB_ACTION -e GITHUB_REF -e GITHUB_HEAD_REF -e GITHUB_SHA -e GITHUB_REPOSITORY -e GITHUB_RUN_ID -v $GITHUB_WORKSPACE/.ci_cache/scons_cache:/tmp/scons_cache -v $GITHUB_WORKSPACE/.ci_cache/comma_download_cache:/tmp/comma_download_cache -v $GITHUB_WORKSPACE/.ci_cache/openpilot_cache:/tmp/openpilot_cache $CL_BASE_IMAGE /bin/sh -c


jobs:
plotjuggler:
name: plotjuggler
Expand Down
7 changes: 6 additions & 1 deletion Dockerfile.openpilot_base
Original file line number Diff line number Diff line change
Expand Up @@ -41,4 +41,9 @@ RUN cd /tmp && \
rm -rf /home/$USER/.cache

USER root
RUN sudo git config --global --add safe.directory /tmp/openpilot
RUN sudo git config --global --add safe.directory /tmp/openpilot

# Install PortableCL
RUN apt update && \
apt install -y pocl-opencl-icd && \
rm -rf /var/lib/apt/lists/*
37 changes: 0 additions & 37 deletions Dockerfile.openpilot_base_cl

This file was deleted.

6 changes: 6 additions & 0 deletions Jenkinsfile
Original file line number Diff line number Diff line change
Expand Up @@ -226,6 +226,12 @@ node {
sh label: "test_car_interfaces.py", script: "MAX_EXAMPLES=100 pytest -n42 selfdrive/car/tests/test_car_interfaces.py"
}
},
'simulation tests': {
pcStage("simulation tests") {
sh "scons -j30"
sh label: "test_metadrive_bridge.py", script: "PYTHONWARNINGS=default PYTHONPATH=$WORKSPACE python tools/sim/tests/test_metadrive_bridge.py"
}
},

)
}
Expand Down
Loading