[stdout] Docker app's state test === RUN TestAppStatus apps: '[eclient]' state: 'RUNNING' secs: 1200 time: 2023-10-19T13:17:50.571437889Z out: appName eclient state changed to UNKNOWN time: 2023-10-19T13:17:58.354618751Z out: appName eclient state changed to INITIAL time: 2023-10-19T13:18:00.355522918Z out: appName eclient state changed to RESOLVING_TAG time: 2023-10-19T13:18:04.358226919Z out: appName eclient state changed to DOWNLOAD_STARTED time: 2023-10-19T13:18:04.35826033Z out: appName eclient state changed to DOWNLOAD_STARTED (0%) time: 2023-10-19T13:18:14.365454539Z out: appName eclient state changed to DOWNLOAD_STARTED (100%) time: 2023-10-19T13:18:19.369661362Z out: appName eclient state changed to DOWNLOAD_STARTED (0%) time: 2023-10-19T13:18:23.372248424Z out: appName eclient state changed to DOWNLOAD_STARTED (1%) time: 2023-10-19T13:18:32.378971562Z out: appName eclient state changed to DOWNLOAD_STARTED (4%) time: 2023-10-19T13:18:35.382022382Z out: appName eclient state changed to DOWNLOAD_STARTED (9%) time: 2023-10-19T13:18:37.383376585Z out: appName eclient state changed to DOWNLOAD_STARTED (13%) time: 2023-10-19T13:18:39.385267649Z out: appName eclient state changed to DOWNLOAD_STARTED (20%) time: 2023-10-19T13:18:40.386746786Z out: appName eclient state changed to DOWNLOAD_STARTED (45%) time: 2023-10-19T13:18:42.388732161Z out: appName eclient state changed to DOWNLOAD_STARTED (56%) time: 2023-10-19T13:18:42.38876956Z out: appName eclient state changed to DOWNLOAD_STARTED (61%) time: 2023-10-19T13:18:43.389742926Z out: appName eclient state changed to DOWNLOAD_STARTED (67%) time: 2023-10-19T13:18:44.390693438Z out: appName eclient state changed to DOWNLOAD_STARTED (70%) time: 2023-10-19T13:18:45.391770558Z out: appName eclient state changed to DOWNLOAD_STARTED (76%) time: 2023-10-19T13:18:46.392708804Z out: appName eclient state changed to DOWNLOAD_STARTED (82%) time: 2023-10-19T13:18:47.39313106Z out: appName eclient state changed to DOWNLOAD_STARTED (85%) time: 2023-10-19T13:18:47.393158841Z out: appName eclient state changed to DOWNLOAD_STARTED (90%) time: 2023-10-19T13:18:52.397472351Z out: appName eclient state changed to DOWNLOAD_STARTED (97%) time: 2023-10-19T13:18:53.397839618Z out: appName eclient state changed to DOWNLOAD_STARTED (100%) time: 2023-10-19T13:18:53.39785641Z out: appName eclient state changed to LOADING time: 2023-10-19T13:19:03.404615041Z out: appName eclient state changed to DELIVERED time: 2023-10-19T13:19:06.406910185Z out: appName eclient state changed to CREATING_VOLUME time: 2023-10-19T13:19:50.431994371Z out: appName eclient state changed to INSTALLED time: 2023-10-19T13:24:34.646651856Z out: appName eclient state changed to UNKNOWN time: 2023-10-19T13:24:36.647365698Z out: appName eclient state changed to INITIAL time: 2023-10-19T13:25:06.666898889Z out: appName eclient state changed to INSTALLED time: 2023-10-19T13:25:19.675748004Z out: appName eclient state changed to INSTALLED: [description:"setting up OCI spec for domain ec84deca-7908-4fe6-90f8-5138114de182.1.1 failed unexpected end of JSON input" timestamp:{seconds:1697721918 nanos:669220503} severity:SEVERITY_ERROR] app_test.go:171: ASSERTION FAILED (2023-10-19T13:37:50.571839384Z): expected apps [eclient] in RUNNING state app_test.go:173: actual eclient: INSTALLED: [description:"setting up OCI spec for domain ec84deca-7908-4fe6-90f8-5138114de182.1.1 failed unexpected end of JSON input" timestamp:{seconds:1697721918 nanos:669220503} severity:SEVERITY_ERROR] app_test.go:175: history of states for eclient: app_test.go:177: state: no info from controller received in: 2023-10-19T13:17:50.568368687Z app_test.go:177: state: UNKNOWN received in: 2023-10-19T13:17:50.571436477Z app_test.go:177: state: INITIAL received in: 2023-10-19T13:17:58.35461309Z app_test.go:177: state: RESOLVING_TAG received in: 2023-10-19T13:18:00.35551885Z app_test.go:177: state: DOWNLOAD_STARTED received in: 2023-10-19T13:18:04.35822202Z app_test.go:177: state:

Process completed with exit code 1.

[stdout] Reboot Test === RUN TestReboot reboot_test.go:162: time: 2023-10-19T14:03:21.558511827Z out: Wait for state of 420bc65c-4a15-43e4-a527-0fbe8d9568ef testContext.go:380: done waiting for State reboot_test.go:166: time: 2023-10-19T14:03:21.558533287Z out: timewait: 2562047h47m16.854775807s reboot_test.go:167: time: 2023-10-19T14:03:21.558537705Z out: reboot: false reboot_test.go:168: time: 2023-10-19T14:03:21.558541142Z out: count: 1 reboot_test.go:172: time: 2023-10-19T14:03:21.558546151Z out: LastRebootTime: 2023-10-19 14:01:06.327936357 +0000 UTC reboot_test.go:174: time: 2023-10-19T14:03:21.558549808Z out: LastRebootReason: NORMAL: First boot of device - at 2023-10-19T14:01:06.327936357Z rebooted with reason Reboot reason - kernel crash (no kdump) - at 2023-10-19T14:11:17.955175808Z at 2023-10-19 14:11:17.955175808 +0000 UTC/n testProc.go:84: time: 2023-10-19T14:12:34.784866766Z out: projects.ProcInfoFunc done with return: abnormal reboot: Reboot reason - kernel crash (no kdump) - at 2023-10-19T14:11:17.955175808Z testContext.go:271: done for device 420bc65c-4a15-43e4-a527-0fbe8d9568ef reboot_test.go:186: time: 2023-10-19T14:12:34.784974565Z out: Number of reboots: 0 --- PASS: TestReboot (553.23s) PASS [stderr] time="2023-10-19T14:12:34Z" level=info msg="time: 2023-10-19T14:12:34.784866766Z out: projects.ProcInfoFunc done with return: abnormal reboot: Reboot reason - kernel crash (no kdump) - at 2023-10-19T14:11:17.955175808Z" FAIL: ../eclient/testdata/profile.txt:28: unexpected command success

[stdout] Docker app's state test === RUN TestAppStatus apps: '[local-manager]' state: 'RUNNING' secs: 600 time: 2023-10-19T14:03:55.264581712Z out: appName local-manager state changed to UNKNOWN time: 2023-10-19T14:04:01.027708895Z out: appName local-manager state changed to INITIAL time: 2023-10-19T14:04:03.028301201Z out: appName local-manager state changed to UNKNOWN time: 2023-10-19T14:04:25.044777381Z out: appName local-manager state changed to RESOLVING_TAG time: 2023-10-19T14:04:29.047457996Z out: appName local-manager state changed to DOWNLOAD_STARTED time: 2023-10-19T14:04:29.047479013Z out: appName local-manager state changed to DOWNLOAD_STARTED (0%) time: 2023-10-19T14:04:40.05412634Z out: appName local-manager state changed to DOWNLOAD_STARTED (100%) time: 2023-10-19T14:04:45.057791826Z out: appName local-manager state changed to DOWNLOAD_STARTED (0%) time: 2023-10-19T14:04:53.062476554Z out: appName local-manager state changed to DOWNLOAD_STARTED (3%) time: 2023-10-19T14:04:57.065741667Z out: appName local-manager state changed to DOWNLOAD_STARTED (7%) time: 2023-10-19T14:05:00.067930655Z out: appName local-manager state changed to DOWNLOAD_STARTED (17%) time: 2023-10-19T14:05:01.069085088Z out: appName local-manager state changed to DOWNLOAD_STARTED (26%) time: 2023-10-19T14:05:05.072329941Z out: appName local-manager state changed to DOWNLOAD_STARTED (51%) time: 2023-10-19T14:05:06.072666053Z out: appName local-manager state changed to DOWNLOAD_STARTED (68%) time: 2023-10-19T14:05:06.072682603Z out: appName local-manager state changed to DOWNLOAD_STARTED (71%) time: 2023-10-19T14:05:07.073328007Z out: appName local-manager state changed to DOWNLOAD_STARTED (76%) time: 2023-10-19T14:05:08.07420589Z out: appName local-manager state changed to DOWNLOAD_STARTED (83%) time: 2023-10-19T14:05:09.075301481Z out: appName local-manager state changed to DOWNLOAD_STARTED (86%) time: 2023-10-19T14:05:10.076024313Z out: appName local-manager state changed to DOWNLOAD_STARTED (89%) time: 2023-10-19T14:05:15.083793075Z out: appName local-manager state changed to DOWNLOAD_STARTED (93%) time: 2023-10-19T14:05:17.085809018Z out: appName local-manager state changed to LOADING time: 2023-10-19T14:05:31.096613282Z out: appName local-manager state changed to CREATING_VOLUME time: 2023-10-19T14:06:36.13762228Z out: appName local-manager state changed to INSTALLED time: 2023-10-19T14:12:34.339363094Z out: appName local-manager state changed to INITIAL [context canceled] FAIL: ../eclient/testdata/profile.txt:28: test interrupted while running command

Process completed with exit code 1.

[stdout] time="2023-10-19T14:30:35Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:30:49Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:31:03Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:31:16Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:31:30Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:31:43Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:31:57Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:32:10Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:32:24Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:32:37Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:32:51Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:33:04Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:33:18Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:33:31Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:33:45Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:33:59Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:34:12Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:34:25Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:34:39Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:34:53Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:35:06Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:35:20Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:35:33Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:35:47Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:36:00Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:36:14Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:36:27Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:36:41Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:36:54Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:37:08Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:37:21Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:37:35Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:37:48Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:38:02Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:38:15Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:38:29Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:38:42Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:38:56Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:39:09Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:39:23Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:39:36Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:39:50Z" level=fatal msg="command ssh failed: exit status 1" time="2023-10-19T14:40:03Z" level=fatal msg="command ssh failed: exit status 1" [stderr] ERROR 2002 (HY000): Can't connect to server on '10.11.12.3' (115) ERROR 2002 (HY000): Can't connect to server on '10.11.12.3' (115) ERROR 2002 (HY000): Can't connect to server on '10.11.12.3' (115) ERROR 2002 (HY000): Can't connect to server on '10.11.12.3' (115) ERROR 2002 (HY000): Can't connect to server on '10.11.12.3' (115) ERROR 2002 (HY000): Can't connect to server on '10.11.12.3' (115) ERROR 2002 (HY000): Can't connect to server on '10.11.12.3' (115) ERROR 2002 (HY000): Can't connect to server on '10.11.12.3' (115) ERROR 2002 (HY000): Can't connect to server on '10.11.12.3' (115) ERROR 2002 (HY000): Can't connect to server

Process completed with exit code 1.

[stdout] VNC access to app Test === RUN TestVNCVMStart vnc_test.go:245: Add app to list config changed, to see config run 'eden controller edge-node get-config' vnc_test.go:251: Add processing of app running messages vnc_test.go:101: state: INITIAL received in: 2023-10-19T14:58:58.162152282Z vnc_test.go:101: state: DOWNLOAD_STARTED received in: 2023-10-19T14:58:59.16263201Z vnc_test.go:101: state: LOADING received in: 2023-10-19T15:05:39.441289092Z vnc_test.go:101: state: DELIVERED received in: 2023-10-19T15:08:47.570213715Z vnc_test.go:101: state: CREATING_VOLUME received in: 2023-10-19T15:08:49.571872279Z vnc_test.go:101: state: INSTALLED received in: 2023-10-19T15:12:58.783780164Z --- app vnc-app logs --- ------ testContext.go:285: WaitForProcWithErrorCallback terminated by timeout 15m0s --- FAIL: TestVNCVMStart (901.04s) FAIL [stderr] time="2023-10-19T14:58:53Z" level=info msg="Starting download of image from https://cloud-images.ubuntu.com/releases/groovy/release-20210108/ubuntu-20.10-server-cloudimg-amd64.img" [exit status 1] FAIL: ../vnc/testdata/vnc_test.txt:7: command failure

Process completed with exit code 1.

[stdout] Docker app's state test === RUN TestAppStatus apps: '[t1 t2]' state: 'RUNNING' secs: 600 time: 2023-10-19T15:28:44.324758419Z out: appName t1 state changed to UNKNOWN time: 2023-10-19T15:28:44.324793492Z out: appName t2 state changed to UNKNOWN time: 2023-10-19T15:28:55.344196542Z out: appName t1 state changed to INITIAL time: 2023-10-19T15:28:57.345307346Z out: appName t2 state changed to INITIAL time: 2023-10-19T15:28:58.345661094Z out: appName t1 state changed to RESOLVING_TAG time: 2023-10-19T15:29:01.348116325Z out: appName t1 state changed to DOWNLOAD_STARTED time: 2023-10-19T15:29:02.348468454Z out: appName t1 state changed to DOWNLOAD_STARTED (0%) time: 2023-10-19T15:29:04.350591499Z out: appName t2 state changed to DOWNLOAD_STARTED time: 2023-10-19T15:29:05.351488976Z out: appName t2 state changed to DOWNLOAD_STARTED (0%) time: 2023-10-19T15:29:05.351524181Z out: appName t1 state changed to DOWNLOAD_STARTED (100%) time: 2023-10-19T15:29:41.379354816Z out: appName t2 state changed to DOWNLOAD_STARTED (100%) time: 2023-10-19T15:29:44.38191226Z out: appName t2 state changed to DOWNLOAD_STARTED (0%) time: 2023-10-19T15:29:56.390304904Z out: appName t1 state changed to DOWNLOAD_STARTED (0%) time: 2023-10-19T15:30:05.396824962Z out: appName t1 state changed to DOWNLOAD_STARTED (1%) time: 2023-10-19T15:30:06.397591229Z out: appName t2 state changed to DOWNLOAD_STARTED (2%) time: 2023-10-19T15:30:09.399405569Z out: appName t1 state changed to DOWNLOAD_STARTED (2%) time: 2023-10-19T15:30:11.400877087Z out: appName t1 state changed to DOWNLOAD_STARTED (4%) time: 2023-10-19T15:30:14.404203879Z out: appName t2 state changed to DOWNLOAD_STARTED (5%) time: 2023-10-19T15:30:14.40422106Z out: appName t1 state changed to DOWNLOAD_STARTED (6%) time: 2023-10-19T15:30:17.406663724Z out: appName t2 state changed to DOWNLOAD_STARTED (6%) time: 2023-10-19T15:30:23.411053361Z out: appName t1 state changed to DOWNLOAD_STARTED (7%) time: 2023-10-19T15:30:24.411714339Z out: appName t2 state changed to DOWNLOAD_STARTED (7%) time: 2023-10-19T15:30:27.413863242Z out: appName t1 state changed to DOWNLOAD_STARTED (8%) time: 2023-10-19T15:30:28.414893154Z out: appName t2 state changed to DOWNLOAD_STARTED (8%) time: 2023-10-19T15:30:30.416805581Z out: appName t2 state changed to DOWNLOAD_STARTED (9%) time: 2023-10-19T15:30:32.418272605Z out: appName t1 state changed to DOWNLOAD_STARTED (9%) time: 2023-10-19T15:30:36.421933514Z out: appName t1 state changed to DOWNLOAD_STARTED (69%) time: 2023-10-19T15:30:39.42379516Z out: appName t2 state changed to DOWNLOAD_STARTED (39%) time: 2023-10-19T15:30:41.426059558Z out: appName t2 state changed to DOWNLOAD_STARTED (69%) time: 2023-10-19T15:30:45.429676368Z out: appName t2 state changed to DOWNLOAD_STARTED (70%) time: 2023-10-19T15:30:46.429869427Z out: appName t1 state changed to DOWNLOAD_STARTED (70%) time: 2023-10-19T15:30:49.431586227Z out: appName t1 state changed to DOWNLOAD_STARTED (71%) time: 2023-10-19T15:30:49.431640607Z out: appName t2 state changed to DOWNLOAD_STARTED (71%) time: 2023-10-19T15:30:50.432091585Z out: appName t2 state changed to DOWNLOAD_STARTED (73%) time: 2023-10-19T15:30:52.43382152Z out: appName t1 state changed to DOWNLOAD_STARTED (74%) time: 2023-10-19T15:30:54.435302973Z out: appName t2 state changed to DOWNLOAD_STARTED (74%) time: 2023-10-19T15:30:54.435352415Z out: appName t1 state changed to DOWNLOAD_STARTED (76%) time: 2023-10-19T15:30:55.436206016Z out: appName t2 state changed to DOWNLOAD_STARTED (100%) time: 2023-10-19T15:32:37.513897797Z out: appName t2 state changed to LOADING time: 2023-10-19T15:32:37.513920398Z out: appName t1 state changed to VERIFIED time: 2023-10-19T15:34:15.590079547Z out: appName t2 state changed to DELIVERED time: 2023-10-19T15:34:16.591416349Z out: appName t1 state changed to LOADING time: 2023-10-19T15:34:22.59693621Z out: appName t1 state changed to DELIVERED time: 2023-10-19T15:34:28.601651102Z out: appName t2 state changed to CREATING_VOLUME time: 2023-10-19T15:34:29.602298434Z