[stdout] Reboot Test === RUN TestReboot reboot_test.go:162: time: 2023-10-04T15:07:39.077279156Z out: Wait for state of a80ecefc-4f18-45b5-af78-60f29f78104a testContext.go:380: done waiting for State reboot_test.go:166: time: 2023-10-04T15:07:39.077393756Z out: timewait: 2562047h47m16.854775807s reboot_test.go:167: time: 2023-10-04T15:07:39.077406356Z out: reboot: false reboot_test.go:168: time: 2023-10-04T15:07:39.077413156Z out: count: 1 reboot_test.go:172: time: 2023-10-04T15:07:39.077440956Z out: LastRebootTime: 2023-10-04 14:59:55.951147016 +0000 UTC reboot_test.go:174: time: 2023-10-04T15:07:39.077461656Z out: LastRebootReason: NORMAL: First boot of device - at 2023-10-04T14:59:55.951147016Z rebooted with reason Reboot reason - kernel crash (no kdump) - at 2023-10-04T15:29:11.279297677Z at 2023-10-04 15:29:11.279297677 +0000 UTC/n testProc.go:84: time: 2023-10-04T15:31:08.334086336Z out: projects.ProcInfoFunc done with return: abnormal reboot: Reboot reason - kernel crash (no kdump) - at 2023-10-04T15:29:11.279297677Z testContext.go:271: done for device a80ecefc-4f18-45b5-af78-60f29f78104a reboot_test.go:186: time: 2023-10-04T15:31:08.334933337Z out: Number of reboots: 0 --- PASS: TestReboot (1409.26s) PASS [stderr] time="2023-10-04T15:31:08Z" level=info msg="time: 2023-10-04T15:31:08.334086336Z out: projects.ProcInfoFunc done with return: abnormal reboot: Reboot reason - kernel crash (no kdump) - at 2023-10-04T15:29:11.279297677Z" FAIL: ../volume/testdata/volumes_test.txt:60: unexpected command success

[stdout] Docker app's state test === RUN TestAppStatus apps: '[eclient-mount]' state: 'RUNNING' secs: 900 time: 2023-10-04T15:22:43.376515691Z out: appName eclient-mount state changed to DELIVERED: [description:"Remaining disk space 1478219336 volume needs 3098542080\n\n\n" timestamp:{seconds:1696432919 nanos:342594761} severity:SEVERITY_ERROR entities:{entity:ENTITY_VOLUME entity_id:"f8bf8d3d-a2a1-4229-9118-6ecd0d74e2a1"} retry_condition:"Will retry when more space will be available"] time: 2023-10-04T15:22:58.290797605Z out: appName eclient-mount state changed to CREATING_VOLUME time: 2023-10-04T15:23:18.300395853Z out: appName eclient-mount state changed to INSTALLED time: 2023-10-04T15:30:36.537373005Z out: appName eclient-mount state changed to INITIAL [context canceled] FAIL: ../volume/testdata/volumes_test.txt:60: test interrupted while running command

Process completed with exit code 1.

[stdout] Docker app's state test === RUN TestAppStatus apps: '[local-manager]' state: 'RUNNING' secs: 600 time: 2023-10-04T16:09:30.59452611Z out: appName local-manager state changed to UNKNOWN time: 2023-10-04T16:09:42.414481704Z out: appName local-manager state changed to INITIAL time: 2023-10-04T16:09:45.416354356Z out: appName local-manager state changed to RESOLVING_TAG time: 2023-10-04T16:09:51.42247626Z out: appName local-manager state changed to DOWNLOAD_STARTED time: 2023-10-04T16:09:53.423612709Z out: appName local-manager state changed to DOWNLOAD_STARTED (0%) time: 2023-10-04T16:10:31.457557436Z out: appName local-manager state changed to DOWNLOAD_STARTED (100%) time: 2023-10-04T16:10:54.477297306Z out: appName local-manager state changed to DOWNLOAD_STARTED (0%) time: 2023-10-04T16:11:34.511713926Z out: appName local-manager state changed to DOWNLOAD_STARTED (1%) time: 2023-10-04T16:11:47.522779725Z out: appName local-manager state changed to DOWNLOAD_STARTED (2%) time: 2023-10-04T16:11:50.524354565Z out: appName local-manager state changed to DOWNLOAD_STARTED (3%) time: 2023-10-04T16:11:52.526378543Z out: appName local-manager state changed to DOWNLOAD_STARTED (5%) time: 2023-10-04T16:12:09.543020904Z out: appName local-manager state changed to DOWNLOAD_STARTED (7%) time: 2023-10-04T16:12:21.551783604Z out: appName local-manager state changed to DOWNLOAD_STARTED (8%) time: 2023-10-04T16:12:32.56132536Z out: appName local-manager state changed to DOWNLOAD_STARTED (26%) time: 2023-10-04T16:12:34.563183365Z out: appName local-manager state changed to DOWNLOAD_STARTED (48%) time: 2023-10-04T16:12:36.564367869Z out: appName local-manager state changed to DOWNLOAD_STARTED (49%) time: 2023-10-04T16:12:40.566449731Z out: appName local-manager state changed to DOWNLOAD_STARTED (51%) time: 2023-10-04T16:12:48.573333577Z out: appName local-manager state changed to DOWNLOAD_STARTED (52%) time: 2023-10-04T16:12:52.57686316Z out: appName local-manager state changed to DOWNLOAD_STARTED (54%) time: 2023-10-04T16:12:54.578504987Z out: appName local-manager state changed to DOWNLOAD_STARTED (55%) time: 2023-10-04T16:12:55.57923743Z out: appName local-manager state changed to DOWNLOAD_STARTED (56%) time: 2023-10-04T16:12:59.582714904Z out: appName local-manager state changed to DOWNLOAD_STARTED (57%) time: 2023-10-04T16:13:06.587717061Z out: appName local-manager state changed to DOWNLOAD_STARTED (77%) time: 2023-10-04T16:13:12.593011372Z out: appName local-manager state changed to DOWNLOAD_STARTED (78%) time: 2023-10-04T16:13:15.596016412Z out: appName local-manager state changed to DOWNLOAD_STARTED (79%) time: 2023-10-04T16:13:18.599806486Z out: appName local-manager state changed to DOWNLOAD_STARTED (80%) time: 2023-10-04T16:13:22.603159301Z out: appName local-manager state changed to DOWNLOAD_STARTED (82%) time: 2023-10-04T16:13:29.608365799Z out: appName local-manager state changed to DOWNLOAD_STARTED (84%) time: 2023-10-04T16:13:34.611758691Z out: appName local-manager state changed to DOWNLOAD_STARTED (86%) time: 2023-10-04T16:13:35.612912519Z out: appName local-manager state changed to DOWNLOAD_STARTED (87%) time: 2023-10-04T16:13:42.617222508Z out: appName local-manager state changed to DOWNLOAD_STARTED (88%) time: 2023-10-04T16:13:49.622617638Z out: appName local-manager state changed to DOWNLOAD_STARTED (90%) time: 2023-10-04T16:13:59.629310772Z out: appName local-manager state changed to DOWNLOAD_STARTED (91%) time: 2023-10-04T16:14:14.639381836Z out: appName local-manager state changed to LOADING time: 2023-10-04T16:15:11.688851173Z out: appName local-manager state changed to CREATING_VOLUME time: 2023-10-04T16:18:18.834923676Z out: appName local-manager state changed to INSTALLED app_test.go:171: ASSERTION FAILED (2023-10-04T16:19:30.59473517Z): expected apps [local-manager] in RUNNING state app_test.go:173: actual local-manager: INSTALLED app_test.go:175: history of states for local-manager: app_test.go:177: state: no info from controller received in: 20

Process completed with exit code 1.

[stdout] Docker app's state test === RUN TestAppStatus apps: '[local-manager]' state: 'RUNNING' secs: 600 time: 2023-10-04T16:18:11.867985035Z out: appName local-manager state changed to UNKNOWN time: 2023-10-04T16:18:18.332310908Z out: appName local-manager state changed to INITIAL time: 2023-10-04T16:18:19.332712686Z out: appName local-manager state changed to RESOLVING_TAG time: 2023-10-04T16:18:26.337555174Z out: appName local-manager state changed to DOWNLOAD_STARTED time: 2023-10-04T16:18:42.347948932Z out: appName local-manager state changed to DOWNLOAD_STARTED (0%) time: 2023-10-04T16:19:04.365206287Z out: appName local-manager state changed to DOWNLOAD_STARTED (100%) time: 2023-10-04T16:19:16.375493545Z out: appName local-manager state changed to DOWNLOAD_STARTED (0%) time: 2023-10-04T16:19:50.403679994Z out: appName local-manager state changed to DOWNLOAD_STARTED (1%) time: 2023-10-04T16:20:06.417247538Z out: appName local-manager state changed to DOWNLOAD_STARTED (2%) time: 2023-10-04T16:20:20.427234666Z out: appName local-manager state changed to DOWNLOAD_STARTED (29%) time: 2023-10-04T16:20:24.431370973Z out: appName local-manager state changed to DOWNLOAD_STARTED (38%) time: 2023-10-04T16:20:27.433604262Z out: appName local-manager state changed to DOWNLOAD_STARTED (39%) time: 2023-10-04T16:20:30.436620078Z out: appName local-manager state changed to DOWNLOAD_STARTED (40%) time: 2023-10-04T16:20:39.444645131Z out: appName local-manager state changed to DOWNLOAD_STARTED (41%) time: 2023-10-04T16:20:50.452404604Z out: appName local-manager state changed to DOWNLOAD_STARTED (42%) time: 2023-10-04T16:21:05.463186789Z out: appName local-manager state changed to DOWNLOAD_STARTED (43%) time: 2023-10-04T16:21:14.470592912Z out: appName local-manager state changed to DOWNLOAD_STARTED (70%) time: 2023-10-04T16:21:18.474723647Z out: appName local-manager state changed to DOWNLOAD_STARTED (72%) time: 2023-10-04T16:21:20.476799271Z out: appName local-manager state changed to DOWNLOAD_STARTED (73%) time: 2023-10-04T16:21:22.479472606Z out: appName local-manager state changed to DOWNLOAD_STARTED (74%) time: 2023-10-04T16:21:24.480369452Z out: appName local-manager state changed to DOWNLOAD_STARTED (75%) time: 2023-10-04T16:21:25.481073524Z out: appName local-manager state changed to DOWNLOAD_STARTED (76%) time: 2023-10-04T16:21:32.486269962Z out: appName local-manager state changed to DOWNLOAD_STARTED (77%) time: 2023-10-04T16:21:38.491685662Z out: appName local-manager state changed to DOWNLOAD_STARTED (94%) time: 2023-10-04T16:21:39.492540986Z out: appName local-manager state changed to DOWNLOAD_STARTED (96%) time: 2023-10-04T16:21:40.493016298Z out: appName local-manager state changed to DOWNLOAD_STARTED (97%) time: 2023-10-04T16:21:45.495739567Z out: appName local-manager state changed to DOWNLOAD_STARTED (98%) time: 2023-10-04T16:22:09.511529104Z out: appName local-manager state changed to LOADING time: 2023-10-04T16:22:45.536472727Z out: appName local-manager state changed to DELIVERED time: 2023-10-04T16:22:48.539418193Z out: appName local-manager state changed to CREATING_VOLUME time: 2023-10-04T16:26:23.713881483Z out: appName local-manager state changed to INSTALLED app_test.go:171: ASSERTION FAILED (2023-10-04T16:28:11.86888185Z): expected apps [local-manager] in RUNNING state app_test.go:173: actual local-manager: INSTALLED app_test.go:175: history of states for local-manager: app_test.go:177: state: no info from controller received in: 2023-10-04T16:18:11.835013628Z app_test.go:177: state: UNKNOWN received in: 2023-10-04T16:18:11.867983435Z app_test.go:177: state: INITIAL received in: 2023-10-04T16:18:18.332303007Z app_test.go:177: state: RESOLVING_TAG received in: 2023-10-04T16:18:19.332699486Z app_test.go:177: state: DOWNLOAD_STARTED received in: 2023-10-04T16:18:26.337546474Z app_test.go:177: state: DOWNLOAD_STARTED (0%) received in: 2023-10-04T16:18:42.347946432Z app_test.go:177: state: DOWNLOAD_STARTED (100%) receive

Process completed with exit code 1.

[stdout] Reboot Test === RUN TestReboot reboot_test.go:162: time: 2023-10-04T18:54:29.353120496Z out: Wait for state of 346c4b91-ceb8-45ef-b19c-6b4f9e1ee615 testContext.go:380: done waiting for State reboot_test.go:166: time: 2023-10-04T18:54:29.353191996Z out: timewait: 1h40m0s reboot_test.go:167: time: 2023-10-04T18:54:29.353208697Z out: reboot: false reboot_test.go:168: time: 2023-10-04T18:54:29.353223597Z out: count: 3 reboot_test.go:172: time: 2023-10-04T18:54:29.353239197Z out: LastRebootTime: 2023-10-04 14:59:22.183274835 +0000 UTC reboot_test.go:174: time: 2023-10-04T18:54:29.353367997Z out: LastRebootReason: NORMAL: First boot of device - at 2023-10-04T14:59:22.183274835Z rebooted with reason NORMAL: controller reboot at EVE version pr-kvm-amd64 at 2023-10-04T19:10:41.904804397Z at 2023-10-04 19:10:42.785402947 +0000 UTC/nrebooted with reason NORMAL: local profile server power off at EVE version pr-kvm-amd64 at 2023-10-04T19:20:56.724128224Z at 2023-10-04 19:20:57.082611006 +0000 UTC/nrebooted with reason Reboot reason - kernel crash (no kdump) - at 2023-10-04T19:34:08.854180881Z at 2023-10-04 19:34:08.854180881 +0000 UTC/n testProc.go:84: time: 2023-10-04T19:35:17.4282682Z out: projects.ProcInfoFunc done with return: abnormal reboot: Reboot reason - kernel crash (no kdump) - at 2023-10-04T19:34:08.854180881Z testContext.go:271: done for device 346c4b91-ceb8-45ef-b19c-6b4f9e1ee615 reboot_test.go:186: time: 2023-10-04T19:35:17.428578801Z out: Number of reboots: 2 --- PASS: TestReboot (2448.08s) PASS [stderr] time="2023-10-04T19:35:17Z" level=info msg="time: 2023-10-04T19:35:17.4282682Z out: projects.ProcInfoFunc done with return: abnormal reboot: Reboot reason - kernel crash (no kdump) - at 2023-10-04T19:34:08.854180881Z" FAIL: ../eclient/testdata/dev_local_info.txt:128: unexpected command success

[stdout] Docker app's state test === RUN TestAppStatus apps: '[app1]' state: 'RUNNING' secs: 1200 time: 2023-10-04T19:23:47.042771992Z out: appName app1 state changed to HALTED time: 2023-10-04T19:27:17.130453503Z out: appName app1 state changed to UNKNOWN time: 2023-10-04T19:27:20.132552799Z out: appName app1 state changed to INITIAL time: 2023-10-04T19:28:07.207641235Z out: appName app1 state changed to INSTALLED [context canceled] FAIL: ../eclient/testdata/dev_local_info.txt:128: test interrupted while running command