Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] Check duration of controller_managers_srv test #1267

Open
christophfroehlich opened this issue Jan 3, 2024 · 8 comments
Open

[CI] Check duration of controller_managers_srv test #1267

christophfroehlich opened this issue Jan 3, 2024 · 8 comments
Assignees

Comments

@christophfroehlich
Copy link
Contributor

Do you think it make sense to relax the test by reducing the number of controllers? or we simply increase the timeout? Any opinions on this are welcome. If we decided to reduce the number, I can open another PR reducing the number

If the test makes sense this shouldn't be a problem. I'm just curious why it takes so long actually? There is no sleep or timing in there? Does the service call take so much time?

Originally posted by @christophfroehlich in #1260 (comment)

@saikishor
Copy link
Member

Hello!

I just looked into this issue. It seems like, this is happening due to the the limit of the CPU cores. On my PC, the test runs for 33 seconds

6: [ RUN      ] TestControllerManagerSrvs.list_large_number_of_controllers_with_chains
6: [WARN] [1704444119.165846149] [test_controller_manager]: 'update_rate' parameter not set, using default value.
6: [INFO] [1704444119.166026852] [test_controller_manager]: Subscribing to '/test_controller_manager/robot_description' topic for robot description.
6: [INFO] [1704444119.167658860] [test_controller_manager]: Received robot description from topic.
6: [INFO] [1704444119.167782832] [resource_manager]: Loading hardware 'TestActuatorHardware' 
6: [INFO] [1704444119.167900694] [resource_manager]: Initialize hardware 'TestActuatorHardware' 
6: [INFO] [1704444119.167918705] [resource_manager]: Successful initialization of hardware 'TestActuatorHardware'
6: [INFO] [1704444119.167950555] [resource_manager]: Loading hardware 'TestSensorHardware' 
6: [INFO] [1704444119.168033497] [resource_manager]: Initialize hardware 'TestSensorHardware' 
6: [INFO] [1704444119.168045967] [resource_manager]: Successful initialization of hardware 'TestSensorHardware'
6: [INFO] [1704444119.168057277] [resource_manager]: Loading hardware 'TestSystemHardware' 
6: [INFO] [1704444119.168135668] [resource_manager]: Initialize hardware 'TestSystemHardware' 
6: [INFO] [1704444119.168149509] [resource_manager]: Successful initialization of hardware 'TestSystemHardware'
6: [INFO] [1704444119.168220110] [resource_manager]: 'configure' hardware 'TestSystemHardware' 
6: [INFO] [1704444119.168252270] [resource_manager]: Successful 'configure' of hardware 'TestSystemHardware'
6: [INFO] [1704444119.168261430] [resource_manager]: 'activate' hardware 'TestSystemHardware' 
6: [INFO] [1704444119.168264940] [resource_manager]: Successful 'activate' of hardware 'TestSystemHardware'
6: [INFO] [1704444119.168272241] [resource_manager]: 'configure' hardware 'TestSensorHardware' 
6: [INFO] [1704444119.168276051] [resource_manager]: Successful 'configure' of hardware 'TestSensorHardware'
6: [INFO] [1704444119.168280331] [resource_manager]: 'activate' hardware 'TestSensorHardware' 
6: [INFO] [1704444119.168283751] [resource_manager]: Successful 'activate' of hardware 'TestSensorHardware'
6: [INFO] [1704444119.168289281] [resource_manager]: 'configure' hardware 'TestActuatorHardware' 
6: [INFO] [1704444119.168293091] [resource_manager]: Successful 'configure' of hardware 'TestActuatorHardware'
6: [INFO] [1704444119.168298961] [resource_manager]: 'activate' hardware 'TestActuatorHardware' 
6: [INFO] [1704444119.168302061] [resource_manager]: Successful 'activate' of hardware 'TestActuatorHardware'
6: [INFO] [1704444119.220322652] [srv_client]: Initializing controller : test_random_controllers_0 !
6: [INFO] [1704444119.220343073] [srv_client]: Initializing controller : test_random_controllers_1 !
6: [INFO] [1704444119.220350133] [srv_client]: Initializing controller : test_random_controllers_2 !
6: [INFO] [1704444119.220356263] [srv_client]: Initializing controller : test_random_controllers_3 !
6: [INFO] [1704444119.220362363] [srv_client]: Initializing controller : test_random_controllers_4 !
6: [INFO] [1704444119.220368393] [srv_client]: Initializing controller : test_random_controllers_5 !
6: [INFO] [1704444119.220374453] [srv_client]: Initializing controller : test_random_controllers_6 !
6: [INFO] [1704444119.220380443] [srv_client]: Initializing controller : test_random_controllers_7 !
6: [INFO] [1704444119.220386553] [srv_client]: Initializing controller : test_random_controllers_8 !
6: [INFO] [1704444119.220392514] [srv_client]: Initializing controller : test_random_controllers_9 !
6: [INFO] [1704444119.220398514] [srv_client]: Initializing controller : test_random_controllers_10 !
6: [INFO] [1704444119.220405744] [srv_client]: Initializing controller : test_random_controllers_11 !
6: [INFO] [1704444119.220411814] [srv_client]: Initializing controller : test_random_controllers_12 !
6: [INFO] [1704444119.220417904] [srv_client]: Initializing controller : test_random_controllers_13 !
6: [INFO] [1704444119.220424024] [srv_client]: Initializing controller : test_random_controllers_14 !
6: [INFO] [1704444119.220430134] [srv_client]: Initializing controller : test_random_controllers_15 !
6: [INFO] [1704444119.220436144] [srv_client]: Initializing controller : test_random_controllers_16 !
6: [INFO] [1704444119.220442254] [srv_client]: Initializing controller : test_random_controllers_17 !
6: [INFO] [1704444119.220448415] [srv_client]: Initializing controller : test_random_controllers_18 !
6: [INFO] [1704444119.220454735] [srv_client]: Initializing controller : test_random_controllers_19 !
6: [INFO] [1704444119.220460775] [srv_client]: Initializing controller : test_random_controllers_20 !
6: [INFO] [1704444119.220466815] [srv_client]: Initializing controller : test_random_controllers_21 !
6: [INFO] [1704444119.220472885] [srv_client]: Initializing controller : test_random_controllers_22 !
6: [INFO] [1704444119.220479185] [srv_client]: Initializing controller : test_random_controllers_23 !
6: [INFO] [1704444119.220485385] [srv_client]: Initializing controller : test_random_controllers_24 !
6: [INFO] [1704444119.220491735] [srv_client]: Initializing controller : test_random_controllers_25 !
6: [INFO] [1704444119.220497825] [srv_client]: Initializing controller : test_random_controllers_26 !
6: [INFO] [1704444119.220504116] [srv_client]: Initializing controller : test_random_controllers_27 !
6: [INFO] [1704444119.220512776] [srv_client]: Initializing controller : test_random_controllers_28 !
6: [INFO] [1704444119.220518926] [srv_client]: Initializing controller : test_random_controllers_29 !
6: [INFO] [1704444119.220525166] [srv_client]: Initializing controller : test_random_controllers_30 !
6: [INFO] [1704444119.220553806] [srv_client]: Initializing controller : test_random_controllers_31 !
6: [INFO] [1704444119.220560766] [srv_client]: Initializing controller : test_random_controllers_32 !
6: [INFO] [1704444119.220567047] [srv_client]: Initializing controller : test_random_controllers_33 !
6: [INFO] [1704444119.220573257] [srv_client]: Initializing controller : test_random_controllers_34 !
6: [INFO] [1704444119.220579367] [srv_client]: Initializing controller : test_random_controllers_35 !
6: [INFO] [1704444119.220585797] [srv_client]: Initializing controller : test_random_controllers_36 !
6: [INFO] [1704444119.220591897] [srv_client]: Initializing controller : test_random_controllers_37 !
6: [INFO] [1704444119.220597977] [srv_client]: Initializing controller : test_random_controllers_38 !
6: [INFO] [1704444119.220604247] [srv_client]: Initializing controller : test_random_controllers_39 !
6: [INFO] [1704444119.220610317] [srv_client]: Initializing controller : test_random_controllers_40 !
6: [INFO] [1704444119.220616297] [srv_client]: Initializing controller : test_random_controllers_41 !
6: [INFO] [1704444119.220622678] [srv_client]: Initializing controller : test_random_controllers_42 !
6: [INFO] [1704444119.220628658] [srv_client]: Initializing controller : test_random_controllers_43 !
6: [INFO] [1704444119.220634988] [srv_client]: Initializing controller : test_random_controllers_44 !
6: [INFO] [1704444119.220640958] [srv_client]: Initializing controller : test_random_controllers_45 !
6: [INFO] [1704444119.220647408] [srv_client]: Initializing controller : test_random_controllers_46 !
6: [INFO] [1704444119.220653528] [srv_client]: Initializing controller : test_random_controllers_47 !
6: [INFO] [1704444119.220660558] [srv_client]: Initializing controller : test_random_controllers_48 !
6: [INFO] [1704444119.220667498] [srv_client]: Initializing controller : test_random_controllers_49 !
6: [INFO] [1704444119.220674198] [srv_client]: Initializing controller : test_random_controllers_50 !
6: [INFO] [1704444119.220680719] [srv_client]: Initializing controller : test_random_controllers_51 !
6: [INFO] [1704444119.220687289] [srv_client]: Initializing controller : test_random_controllers_52 !
6: [INFO] [1704444119.220693739] [srv_client]: Initializing controller : test_random_controllers_53 !
6: [INFO] [1704444119.220700019] [srv_client]: Initializing controller : test_random_controllers_54 !
6: [INFO] [1704444119.220706319] [srv_client]: Initializing controller : test_random_controllers_55 !
6: [INFO] [1704444119.220712659] [srv_client]: Initializing controller : test_random_controllers_56 !
6: [INFO] [1704444119.220718949] [srv_client]: Initializing controller : test_random_controllers_57 !
6: [INFO] [1704444119.220725309] [srv_client]: Initializing controller : test_random_controllers_58 !
6: [INFO] [1704444119.220731649] [srv_client]: Initializing controller : test_random_controllers_59 !
6: [INFO] [1704444119.220737980] [srv_client]: Initializing controller : test_random_controllers_60 !
6: [INFO] [1704444119.220744340] [srv_client]: Initializing controller : test_random_controllers_61 !
6: [INFO] [1704444119.220750710] [srv_client]: Initializing controller : test_random_controllers_62 !
6: [INFO] [1704444119.220757030] [srv_client]: Initializing controller : test_random_controllers_63 !
6: [INFO] [1704444119.220763130] [srv_client]: Initializing controller : test_random_controllers_64 !
6: [INFO] [1704444119.220769380] [srv_client]: Initializing controller : test_random_controllers_65 !
6: [INFO] [1704444119.220776000] [srv_client]: Initializing controller : test_random_controllers_66 !
6: [INFO] [1704444119.220782350] [srv_client]: Initializing controller : test_random_controllers_67 !
6: [INFO] [1704444119.220788610] [srv_client]: Initializing controller : test_random_controllers_68 !
6: [INFO] [1704444119.220794921] [srv_client]: Initializing controller : test_random_controllers_69 !
6: [INFO] [1704444119.220801311] [srv_client]: Initializing controller : test_random_controllers_70 !
6: [INFO] [1704444119.220807691] [srv_client]: Initializing controller : test_random_controllers_71 !
6: [INFO] [1704444119.220821761] [srv_client]: Initializing controller : test_random_controllers_72 !
6: [INFO] [1704444119.220829111] [srv_client]: Initializing controller : test_random_controllers_73 !
6: [INFO] [1704444119.220835481] [srv_client]: Initializing controller : test_random_controllers_74 !
6: [INFO] [1704444119.220842021] [srv_client]: Initializing controller : test_random_controllers_75 !
6: [INFO] [1704444119.220848312] [srv_client]: Initializing controller : test_random_controllers_76 !
6: [INFO] [1704444119.220854602] [srv_client]: Initializing controller : test_random_controllers_77 !
6: [INFO] [1704444119.220861062] [srv_client]: Initializing controller : test_random_controllers_78 !
6: [INFO] [1704444119.220867512] [srv_client]: Initializing controller : test_random_controllers_79 !
6: [INFO] [1704444119.220873832] [srv_client]: Initializing controller : test_random_controllers_80 !
6: [INFO] [1704444119.220880082] [srv_client]: Initializing controller : test_random_controllers_81 !
6: [INFO] [1704444119.220886412] [srv_client]: Initializing controller : test_random_controllers_82 !
6: [INFO] [1704444119.220892702] [srv_client]: Initializing controller : test_random_controllers_83 !
6: [INFO] [1704444119.220899422] [srv_client]: Initializing controller : test_random_controllers_84 !
6: [INFO] [1704444119.220905763] [srv_client]: Initializing controller : test_random_controllers_85 !
6: [INFO] [1704444119.220912553] [srv_client]: Initializing controller : test_random_controllers_86 !
6: [INFO] [1704444119.220918853] [srv_client]: Initializing controller : test_random_controllers_87 !
6: [INFO] [1704444119.220925283] [srv_client]: Initializing controller : test_random_controllers_88 !
6: [INFO] [1704444119.220931623] [srv_client]: Initializing controller : test_random_controllers_89 !
6: [INFO] [1704444119.220938173] [srv_client]: Initializing controller : test_random_controllers_90 !
6: [INFO] [1704444119.220944403] [srv_client]: Initializing controller : test_random_controllers_91 !
6: [INFO] [1704444119.220950383] [srv_client]: Initializing controller : test_random_controllers_92 !
6: [INFO] [1704444119.220956703] [srv_client]: Initializing controller : test_random_controllers_93 !
6: [INFO] [1704444119.220962954] [srv_client]: Initializing controller : test_random_controllers_94 !
6: [INFO] [1704444119.220969474] [srv_client]: Initializing controller : test_random_controllers_95 !
6: [INFO] [1704444119.220975744] [srv_client]: Initializing controller : test_random_controllers_96 !
6: [INFO] [1704444119.220982044] [srv_client]: Initializing controller : test_random_controllers_97 !
6: [INFO] [1704444119.220988394] [srv_client]: Initializing controller : test_random_controllers_98 !
6: [INFO] [1704444119.220994654] [srv_client]: Initializing controller : test_random_controllers_99 !
6: [ERROR] [1704444119.328706399] [srv_client]: Added controller!
6: [ERROR] [1704444119.338684822] [srv_client]: Added controller!
6: [ERROR] [1704444119.348580594] [srv_client]: Added controller!
6: [ERROR] [1704444119.358590067] [srv_client]: Added controller!
6: [ERROR] [1704444119.368670062] [srv_client]: Added controller!
6: [ERROR] [1704444119.378635134] [srv_client]: Added controller!
6: [ERROR] [1704444119.388479605] [srv_client]: Added controller!
6: [ERROR] [1704444119.398728632] [srv_client]: Added controller!
6: [ERROR] [1704444119.408495011] [srv_client]: Added controller!
6: [ERROR] [1704444119.418506285] [srv_client]: Added controller!
6: [ERROR] [1704444119.428525029] [srv_client]: Added controller!
6: [ERROR] [1704444119.438714275] [srv_client]: Added controller!
6: [ERROR] [1704444119.448595946] [srv_client]: Added controller!
6: [ERROR] [1704444119.458772152] [srv_client]: Added controller!
6: [ERROR] [1704444119.468802076] [srv_client]: Added controller!
6: [ERROR] [1704444119.478625266] [srv_client]: Added controller!
6: [ERROR] [1704444119.488741161] [srv_client]: Added controller!
6: [ERROR] [1704444119.498631953] [srv_client]: Added controller!
6: [ERROR] [1704444119.508710397] [srv_client]: Added controller!
6: [ERROR] [1704444119.518637729] [srv_client]: Added controller!
6: [ERROR] [1704444119.528896837] [srv_client]: Added controller!
6: [ERROR] [1704444119.538879030] [srv_client]: Added controller!
6: [ERROR] [1704444119.548874773] [srv_client]: Added controller!
6: [ERROR] [1704444119.558643342] [srv_client]: Added controller!
6: [ERROR] [1704444119.568699506] [srv_client]: Added controller!
6: [ERROR] [1704444119.578773721] [srv_client]: Added controller!
6: [ERROR] [1704444119.588653392] [srv_client]: Added controller!
6: [ERROR] [1704444119.598816228] [srv_client]: Added controller!
6: [ERROR] [1704444119.608658068] [srv_client]: Added controller!
6: [ERROR] [1704444119.618543140] [srv_client]: Added controller!
6: [ERROR] [1704444119.628716526] [srv_client]: Added controller!
6: [ERROR] [1704444119.638726479] [srv_client]: Added controller!
6: [ERROR] [1704444119.648609700] [srv_client]: Added controller!
6: [ERROR] [1704444119.658799037] [srv_client]: Added controller!
6: [ERROR] [1704444119.671152531] [srv_client]: Added controller!
6: [ERROR] [1704444119.688813077] [srv_client]: Added controller!
6: [ERROR] [1704444119.701295403] [srv_client]: Added controller!
6: [ERROR] [1704444119.718930719] [srv_client]: Added controller!
6: [ERROR] [1704444119.731588458] [srv_client]: Added controller!
6: [ERROR] [1704444119.749040060] [srv_client]: Added controller!
6: [ERROR] [1704444119.761616498] [srv_client]: Added controller!
6: [ERROR] [1704444119.778954828] [srv_client]: Added controller!
6: [ERROR] [1704444119.792056245] [srv_client]: Added controller!
6: [ERROR] [1704444119.808950368] [srv_client]: Added controller!
6: [ERROR] [1704444119.829173338] [srv_client]: Added controller!
6: [ERROR] [1704444119.842346306] [srv_client]: Added controller!
6: [ERROR] [1704444119.859042825] [srv_client]: Added controller!
6: [ERROR] [1704444119.879036802] [srv_client]: Added controller!
6: [ERROR] [1704444119.899210441] [srv_client]: Added controller!
6: [ERROR] [1704444119.919091656] [srv_client]: Added controller!
6: [ERROR] [1704444119.939031871] [srv_client]: Added controller!
6: [ERROR] [1704444119.959124469] [srv_client]: Added controller!
6: [ERROR] [1704444119.973268024] [srv_client]: Added controller!
6: [ERROR] [1704444119.988522048] [srv_client]: Added controller!
6: [ERROR] [1704444120.009248468] [srv_client]: Added controller!
6: [ERROR] [1704444120.029172982] [srv_client]: Added controller!
6: [ERROR] [1704444120.049328382] [srv_client]: Added controller!
6: [ERROR] [1704444120.069241056] [srv_client]: Added controller!
6: [ERROR] [1704444120.089209623] [srv_client]: Added controller!
6: [ERROR] [1704444120.109337722] [srv_client]: Added controller!
6: [ERROR] [1704444120.129304177] [srv_client]: Added controller!
6: [ERROR] [1704444120.149270623] [srv_client]: Added controller!
6: [ERROR] [1704444120.174595602] [srv_client]: Added controller!
6: [ERROR] [1704444120.194721441] [srv_client]: Added controller!
6: [ERROR] [1704444120.214910871] [srv_client]: Added controller!
6: [ERROR] [1704444120.239467296] [srv_client]: Added controller!
6: [ERROR] [1704444120.258536776] [srv_client]: Added controller!
6: [ERROR] [1704444120.278609954] [srv_client]: Added controller!
6: [ERROR] [1704444120.298651121] [srv_client]: Added controller!
6: [ERROR] [1704444120.318767040] [srv_client]: Added controller!
6: [ERROR] [1704444120.338827607] [srv_client]: Added controller!
6: [ERROR] [1704444120.358715272] [srv_client]: Added controller!
6: [ERROR] [1704444120.378710849] [srv_client]: Added controller!
6: [ERROR] [1704444120.406336507] [srv_client]: Added controller!
6: [ERROR] [1704444120.428623833] [srv_client]: Added controller!
6: [ERROR] [1704444120.456885453] [srv_client]: Added controller!
6: [ERROR] [1704444120.487212928] [srv_client]: Added controller!
6: [ERROR] [1704444120.517317030] [srv_client]: Added controller!
6: [ERROR] [1704444120.547614805] [srv_client]: Added controller!
6: [ERROR] [1704444120.577846429] [srv_client]: Added controller!
6: [ERROR] [1704444120.607915740] [srv_client]: Added controller!
6: [ERROR] [1704444120.638269006] [srv_client]: Added controller!
6: [ERROR] [1704444120.668326526] [srv_client]: Added controller!
6: [ERROR] [1704444120.698721193] [srv_client]: Added controller!
6: [ERROR] [1704444120.728941067] [srv_client]: Added controller!
6: [ERROR] [1704444120.759234421] [srv_client]: Added controller!
6: [ERROR] [1704444120.788522148] [srv_client]: Added controller!
6: [ERROR] [1704444120.819510276] [srv_client]: Added controller!
6: [ERROR] [1704444120.848574379] [srv_client]: Added controller!
6: [ERROR] [1704444120.879512545] [srv_client]: Added controller!
6: [ERROR] [1704444120.919954206] [srv_client]: Added controller!
6: [ERROR] [1704444120.959888018] [srv_client]: Added controller!
6: [ERROR] [1704444121.000058684] [srv_client]: Added controller!
6: [ERROR] [1704444121.040016996] [srv_client]: Added controller!
6: [ERROR] [1704444121.071482421] [srv_client]: Added controller!
6: [ERROR] [1704444121.110212103] [srv_client]: Added controller!
6: [ERROR] [1704444121.150409659] [srv_client]: Added controller!
6: [ERROR] [1704444121.182213740] [srv_client]: Added controller!
6: [ERROR] [1704444121.220190999] [srv_client]: Added controller!
6: [ERROR] [1704444121.260020799] [srv_client]: Added controller!
6: [ERROR] [1704444121.300199315] [srv_client]: Added controller!
6: [ERROR] [1704444121.340123257] [srv_client]: Added controller!
6: [ERROR] [1704444121.380190112] [srv_client]: Added controller!
6: [ERROR] [1704444121.420166444] [srv_client]: Added controller!
6: [ERROR] [1704444121.460264559] [srv_client]: Added controller!
6: [ERROR] [1704444121.500239662] [srv_client]: Added controller!
6: [ERROR] [1704444121.538629397] [srv_client]: Added controller!
6: [ERROR] [1704444121.578724852] [srv_client]: Added controller!
6: [ERROR] [1704444121.618678695] [srv_client]: Added controller!
6: [ERROR] [1704444121.659055234] [srv_client]: Added controller!
6: [ERROR] [1704444121.699546646] [srv_client]: Added controller!
6: [ERROR] [1704444121.739597350] [srv_client]: Added controller!
6: [ERROR] [1704444121.779920459] [srv_client]: Added controller!
6: [ERROR] [1704444121.827008965] [srv_client]: Added controller!
6: [ERROR] [1704444121.877346567] [srv_client]: Added controller!
6: [ERROR] [1704444121.928006795] [srv_client]: Added controller!
6: [ERROR] [1704444121.978298146] [srv_client]: Added controller!
6: [ERROR] [1704444122.028914243] [srv_client]: Added controller!
6: [ERROR] [1704444122.079196515] [srv_client]: Added controller!
6: [ERROR] [1704444122.129676940] [srv_client]: Added controller!
6: [ERROR] [1704444122.179882671] [srv_client]: Added controller!
6: [ERROR] [1704444122.240359159] [srv_client]: Added controller!
[Processing: controller_manager]
6: [ERROR] [1704444122.298694920] [srv_client]: Added controller!
6: [ERROR] [1704444122.361473608] [srv_client]: Added controller!
6: [ERROR] [1704444122.420463010] [srv_client]: Added controller!
6: [ERROR] [1704444122.480681945] [srv_client]: Added controller!
6: [ERROR] [1704444122.538724461] [srv_client]: Added controller!
6: [ERROR] [1704444122.600842448] [srv_client]: Added controller!
6: [ERROR] [1704444122.653793045] [srv_client]: Added controller!
6: [ERROR] [1704444122.709979239] [srv_client]: Added controller!
6: [ERROR] [1704444122.764767129] [srv_client]: Added controller!
6: [ERROR] [1704444122.820463865] [srv_client]: Added controller!
6: [ERROR] [1704444122.877421802] [srv_client]: Added controller!
6: [ERROR] [1704444122.938370408] [srv_client]: Added controller!
6: [ERROR] [1704444122.999064110] [srv_client]: Added controller!
6: [ERROR] [1704444123.059756393] [srv_client]: Added controller!
6: [ERROR] [1704444123.120460055] [srv_client]: Added controller!
6: [ERROR] [1704444123.181022105] [srv_client]: Added controller!
6: [ERROR] [1704444123.240408725] [srv_client]: Added controller!
6: [ERROR] [1704444123.299651462] [srv_client]: Added controller!
6: [ERROR] [1704444123.358899219] [srv_client]: Added controller!
6: [ERROR] [1704444123.419642302] [srv_client]: Added controller!
6: [ERROR] [1704444123.484015058] [srv_client]: Added controller!
6: [ERROR] [1704444123.548703450] [srv_client]: Added controller!
6: [ERROR] [1704444123.615447777] [srv_client]: Added controller!
6: [ERROR] [1704444123.686225664] [srv_client]: Added controller!
6: [ERROR] [1704444123.748502874] [srv_client]: Added controller!
6: [ERROR] [1704444123.817545602] [srv_client]: Added controller!
6: [ERROR] [1704444123.888247537] [srv_client]: Added controller!
6: [ERROR] [1704444123.959143686] [srv_client]: Added controller!
6: [ERROR] [1704444124.029923383] [srv_client]: Added controller!
6: [ERROR] [1704444124.099327707] [srv_client]: Added controller!
6: [ERROR] [1704444124.171317516] [srv_client]: Added controller!
6: [ERROR] [1704444124.238510631] [srv_client]: Added controller!
6: [ERROR] [1704444124.308701039] [srv_client]: Added controller!
6: [ERROR] [1704444124.379648409] [srv_client]: Added controller!
6: [ERROR] [1704444124.449866327] [srv_client]: Added controller!
6: [ERROR] [1704444124.518588968] [srv_client]: Added controller!
6: [ERROR] [1704444124.589863695] [srv_client]: Added controller!
6: [ERROR] [1704444124.666174708] [srv_client]: Added controller!
6: [ERROR] [1704444124.738796747] [srv_client]: Added controller!
6: [ERROR] [1704444124.817675225] [srv_client]: Added controller!
6: [ERROR] [1704444124.898626919] [srv_client]: Added controller!
6: [ERROR] [1704444124.979488522] [srv_client]: Added controller!
6: [ERROR] [1704444125.058763847] [srv_client]: Added controller!
6: [ERROR] [1704444125.138738144] [srv_client]: Added controller!
6: [ERROR] [1704444125.222130931] [srv_client]: Added controller!
6: [ERROR] [1704444125.302772919] [srv_client]: Added controller!
6: [ERROR] [1704444125.383664012] [srv_client]: Added controller!
6: [ERROR] [1704444125.464445254] [srv_client]: Added controller!
6: [ERROR] [1704444125.549397047] [srv_client]: Added controller!
6: [ERROR] [1704444125.635952709] [srv_client]: Added controller!
6: [ERROR] [1704444125.719153222] [srv_client]: Added controller!
6: [ERROR] [1704444125.807589276] [srv_client]: Added controller!
6: [ERROR] [1704444125.898545864] [srv_client]: Added controller!
6: [ERROR] [1704444125.989558563] [srv_client]: Added controller!
6: [ERROR] [1704444126.078532647] [srv_client]: Added controller!
6: [ERROR] [1704444126.171336666] [srv_client]: Added controller!
6: [ERROR] [1704444126.259908114] [srv_client]: Added controller!
6: [ERROR] [1704444126.350452214] [srv_client]: Added controller!
6: [ERROR] [1704444126.440557278] [srv_client]: Added controller!
6: [ERROR] [1704444126.530173693] [srv_client]: Added controller!
6: [ERROR] [1704444126.625982395] [srv_client]: Added controller!
6: [ERROR] [1704444126.720928453] [srv_client]: Added controller!
6: [ERROR] [1704444126.818118889] [srv_client]: Added controller!
6: [ERROR] [1704444126.919083511] [srv_client]: Added controller!
6: [ERROR] [1704444127.019900470] [srv_client]: Added controller!
6: [ERROR] [1704444127.119003520] [srv_client]: Added controller!
6: [ERROR] [1704444127.223579625] [srv_client]: Added controller!
6: [ERROR] [1704444127.321436253] [srv_client]: Added controller!
6: [ERROR] [1704444127.418830883] [srv_client]: Added controller!
6: [ERROR] [1704444127.516212824] [srv_client]: Added controller!
6: [ERROR] [1704444127.617493431] [srv_client]: Added controller!
6: [ERROR] [1704444127.718705198] [srv_client]: Added controller!
6: [ERROR] [1704444127.819266443] [srv_client]: Added controller!
6: [ERROR] [1704444127.920957838] [srv_client]: Added controller!
6: [ERROR] [1704444128.022231786] [srv_client]: Added controller!
6: [ERROR] [1704444128.123633066] [srv_client]: Added controller!
6: [ERROR] [1704444128.224662039] [srv_client]: Added controller!
6: [ERROR] [1704444128.329032041] [srv_client]: Added controller!
6: [ERROR] [1704444128.437121837] [srv_client]: The duration to add all the controllers is : 9108.511019!
6: [INFO] [1704444128.450586541] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_3'
6: [INFO] [1704444128.471230130] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_5'
6: [INFO] [1704444128.491450691] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_9'
6: [INFO] [1704444128.511535090] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_1'
6: [INFO] [1704444128.531668049] [test_controller_manager]: Configuring controller 'test_controller_name_1'
6: [INFO] [1704444128.552020902] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_4'
6: [INFO] [1704444128.573542555] [test_controller_manager]: Configuring controller 'test_controller_name_2'
6: [INFO] [1704444128.592255861] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_2'
6: [INFO] [1704444128.613263445] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_6'
6: [INFO] [1704444128.643027282] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_7'
6: [INFO] [1704444128.663178822] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_8'
6: [ERROR] [1704444128.693790823] [srv_client]: The duration to configure the ctrls_order is : 243.204892!
6: [INFO] [1704444128.693838494] [test_controller_manager]: Configuring controller 'test_random_controllers_96'
6: [INFO] [1704444128.713437924] [test_controller_manager]: Configuring controller 'test_random_controllers_95'
6: [INFO] [1704444128.733357420] [test_controller_manager]: Configuring controller 'test_random_controllers_92'
6: [INFO] [1704444128.753470039] [test_controller_manager]: Configuring controller 'test_random_controllers_91'
6: [INFO] [1704444128.773363334] [test_controller_manager]: Configuring controller 'test_random_controllers_89'
6: [INFO] [1704444128.793282761] [test_controller_manager]: Configuring controller 'test_random_controllers_86'
6: [INFO] [1704444128.813623783] [test_controller_manager]: Configuring controller 'test_random_controllers_85'
6: [INFO] [1704444128.833270135] [test_controller_manager]: Configuring controller 'test_random_controllers_83'
6: [INFO] [1704444128.853398934] [test_controller_manager]: Configuring controller 'test_random_controllers_82'
6: [INFO] [1704444128.873372380] [test_controller_manager]: Configuring controller 'test_random_controllers_80'
6: [INFO] [1704444128.893286027] [test_controller_manager]: Configuring controller 'test_random_controllers_79'
6: [INFO] [1704444128.913778202] [test_controller_manager]: Configuring controller 'test_random_controllers_93'
6: [INFO] [1704444128.933272380] [test_controller_manager]: Configuring controller 'test_random_controllers_76'
6: [INFO] [1704444128.953147306] [test_controller_manager]: Configuring controller 'test_random_controllers_71'
6: [INFO] [1704444128.973701512] [test_controller_manager]: Configuring controller 'test_random_controllers_70'
6: [INFO] [1704444128.993404665] [test_controller_manager]: Configuring controller 'test_random_controllers_67'
6: [INFO] [1704444129.015365516] [test_controller_manager]: Configuring controller 'test_random_controllers_66'
6: [INFO] [1704444129.036153456] [test_controller_manager]: Configuring controller 'test_random_controllers_65'
6: [INFO] [1704444129.063766396] [test_controller_manager]: Configuring controller 'test_random_controllers_64'
6: [INFO] [1704444129.086773866] [test_controller_manager]: Configuring controller 'test_random_controllers_63'
6: [INFO] [1704444129.113366908] [test_controller_manager]: Configuring controller 'test_random_controllers_58'
6: [INFO] [1704444129.133254452] [test_controller_manager]: Configuring controller 'test_random_controllers_56'
6: [INFO] [1704444129.153347622] [test_controller_manager]: Configuring controller 'test_random_controllers_51'
6: [INFO] [1704444129.177670544] [test_controller_manager]: Configuring controller 'test_random_controllers_50'
6: [INFO] [1704444129.203451822] [test_controller_manager]: Configuring controller 'test_random_controllers_49'
6: [INFO] [1704444129.228035478] [test_controller_manager]: Configuring controller 'test_random_controllers_46'
6: [INFO] [1704444129.253945708] [test_controller_manager]: Configuring controller 'test_random_controllers_44'
6: [INFO] [1704444129.278542295] [test_controller_manager]: Configuring controller 'test_random_controllers_43'
6: [INFO] [1704444129.298803417] [test_controller_manager]: Configuring controller 'test_random_controllers_41'
6: [INFO] [1704444129.323475926] [test_controller_manager]: Configuring controller 'test_random_controllers_40'
6: [INFO] [1704444129.353371914] [test_controller_manager]: Configuring controller 'test_random_controllers_99'
6: [INFO] [1704444129.379533519] [test_controller_manager]: Configuring controller 'test_random_controllers_84'
6: [INFO] [1704444129.403345472] [test_controller_manager]: Configuring controller 'test_random_controllers_69'
6: [INFO] [1704444129.430041966] [test_controller_manager]: Configuring controller 'test_random_controllers_59'
6: [INFO] [1704444129.460229880] [test_controller_manager]: Configuring controller 'test_random_controllers_33'
6: [INFO] [1704444129.483404602] [test_controller_manager]: Configuring controller 'test_random_controllers_52'
6: [INFO] [1704444129.510753567] [test_controller_manager]: Configuring controller 'test_random_controllers_32'
6: [INFO] [1704444129.541064633] [test_controller_manager]: Configuring controller 'test_random_controllers_31'
6: [INFO] [1704444129.571180556] [test_controller_manager]: Configuring controller 'test_random_controllers_30'
6: [INFO] [1704444129.601441852] [test_controller_manager]: Configuring controller 'test_random_controllers_28'
6: [INFO] [1704444129.631801369] [test_controller_manager]: Configuring controller 'test_broadcaster_54'
6: [INFO] [1704444129.662008033] [test_controller_manager]: Configuring controller 'test_random_controllers_47'
6: [INFO] [1704444129.692328550] [test_controller_manager]: Configuring controller 'test_broadcaster_55'
6: [INFO] [1704444129.722467113] [test_controller_manager]: Configuring controller 'test_random_controllers_90'
6: [INFO] [1704444129.762806004] [test_controller_manager]: Configuring controller 'test_random_controllers_87'
6: [INFO] [1704444129.793242182] [test_controller_manager]: Configuring controller 'test_broadcaster_16'
6: [INFO] [1704444129.823457627] [test_controller_manager]: Configuring controller 'test_random_controllers_42'
6: [INFO] [1704444129.853371356] [test_controller_manager]: Configuring controller 'test_broadcaster_53'
6: [INFO] [1704444129.883555810] [test_controller_manager]: Configuring controller 'test_random_controllers_81'
6: [INFO] [1704444129.913788635] [test_controller_manager]: Configuring controller 'test_broadcaster_31'
6: [INFO] [1704444129.943567692] [test_controller_manager]: Configuring controller 'test_broadcaster_52'
6: [INFO] [1704444129.983243551] [test_controller_manager]: Configuring controller 'test_broadcaster_49'
6: [INFO] [1704444130.013370135] [test_controller_manager]: Configuring controller 'test_broadcaster_47'
6: [INFO] [1704444130.043802993] [test_controller_manager]: Configuring controller 'test_broadcaster_27'
6: [INFO] [1704444130.073533519] [test_controller_manager]: Configuring controller 'test_random_controllers_74'
6: [INFO] [1704444130.103739743] [test_controller_manager]: Configuring controller 'test_broadcaster_72'
6: [INFO] [1704444130.133602922] [test_controller_manager]: Configuring controller 'test_random_controllers_38'
6: [INFO] [1704444130.166691327] [test_controller_manager]: Configuring controller 'test_broadcaster_44'
6: [INFO] [1704444130.203474886] [test_controller_manager]: Configuring controller 'test_broadcaster_10'
6: [INFO] [1704444130.233712361] [test_controller_manager]: Configuring controller 'test_broadcaster_57'
6: [INFO] [1704444130.263868315] [test_controller_manager]: Configuring controller 'test_random_controllers_55'
6: [INFO] [1704444130.293742874] [test_controller_manager]: Configuring controller 'test_broadcaster_0'
6: [INFO] [1704444130.323665253] [test_controller_manager]: Configuring controller 'test_random_controllers_73'
6: [INFO] [1704444130.348306111] [test_controller_manager]: Configuring controller 'test_random_controllers_7'
6: [INFO] [1704444130.378809841] [test_controller_manager]: Configuring controller 'test_random_controllers_10'
6: [INFO] [1704444130.419028609] [test_controller_manager]: Configuring controller 'test_random_controllers_22'
6: [INFO] [1704444130.449391727] [test_controller_manager]: Configuring controller 'test_broadcaster_41'
6: [INFO] [1704444130.479578271] [test_controller_manager]: Configuring controller 'test_random_controllers_3'
6: [INFO] [1704444130.509783045] [test_controller_manager]: Configuring controller 'test_broadcaster_40'
6: [INFO] [1704444130.540104072] [test_controller_manager]: Configuring controller 'test_broadcaster_99'
6: [INFO] [1704444130.570305637] [test_controller_manager]: Configuring controller 'test_broadcaster_39'
6: [INFO] [1704444130.600644144] [test_controller_manager]: Configuring controller 'test_broadcaster_37'
6: [INFO] [1704444130.640848072] [test_controller_manager]: Configuring controller 'test_random_controllers_75'
6: [INFO] [1704444130.671236660] [test_controller_manager]: Configuring controller 'test_broadcaster_3'
6: [INFO] [1704444130.701512525] [test_controller_manager]: Configuring controller 'test_broadcaster_34'
6: [INFO] [1704444130.733642064] [test_controller_manager]: Configuring controller 'test_broadcaster_32'
6: [INFO] [1704444130.772147692] [test_controller_manager]: Configuring controller 'test_random_controllers_62'
6: [INFO] [1704444130.802435338] [test_controller_manager]: Configuring controller 'test_random_controllers_60'
6: [INFO] [1704444130.832513451] [test_controller_manager]: Configuring controller 'test_broadcaster_15'
6: [INFO] [1704444130.883130480] [test_controller_manager]: Configuring controller 'test_random_controllers_0'
6: [INFO] [1704444130.923317257] [test_controller_manager]: Configuring controller 'test_broadcaster_29'
6: [INFO] [1704444130.962837134] [test_controller_manager]: Configuring controller 'test_random_controllers_61'
6: [INFO] [1704444131.003318067] [test_controller_manager]: Configuring controller 'test_broadcaster_98'
6: [INFO] [1704444131.043526846] [test_controller_manager]: Configuring controller 'test_broadcaster_59'
6: [INFO] [1704444131.073538127] [test_controller_manager]: Configuring controller 'test_broadcaster_11'
6: [INFO] [1704444131.103529318] [test_controller_manager]: Configuring controller 'test_random_controllers_17'
6: [INFO] [1704444131.152917166] [test_controller_manager]: Configuring controller 'test_broadcaster_77'
6: [INFO] [1704444131.186033211] [test_controller_manager]: Configuring controller 'test_random_controllers_57'
6: [INFO] [1704444131.223519092] [test_controller_manager]: Configuring controller 'test_random_controllers_53'
6: [INFO] [1704444131.263333493] [test_controller_manager]: Configuring controller 'test_random_controllers_48'
6: [INFO] [1704444131.303289318] [test_controller_manager]: Configuring controller 'test_broadcaster_7'
6: [INFO] [1704444131.333286449] [test_controller_manager]: Configuring controller 'test_broadcaster_84'
6: [INFO] [1704444131.363002945] [test_controller_manager]: Configuring controller 'test_broadcaster_50'
6: [INFO] [1704444131.413346899] [test_controller_manager]: Configuring controller 'test_broadcaster_33'
6: [INFO] [1704444131.448503440] [test_controller_manager]: Configuring controller 'test_broadcaster_56'
6: [INFO] [1704444131.483732543] [test_controller_manager]: Configuring controller 'test_broadcaster_13'
6: [INFO] [1704444131.519068836] [test_controller_manager]: Configuring controller 'test_broadcaster_30'
6: [INFO] [1704444131.553183579] [test_controller_manager]: Configuring controller 'test_broadcaster_20'
6: [INFO] [1704444131.583305782] [test_controller_manager]: Configuring controller 'test_broadcaster_42'
6: [INFO] [1704444131.613486346] [test_controller_manager]: Configuring controller 'test_broadcaster_35'
6: [INFO] [1704444131.660440232] [test_controller_manager]: Configuring controller 'test_broadcaster_9'
6: [INFO] [1704444131.700814583] [test_controller_manager]: Configuring controller 'test_broadcaster_6'
6: [INFO] [1704444131.741000312] [test_controller_manager]: Configuring controller 'test_broadcaster_12'
6: [INFO] [1704444131.781379083] [test_controller_manager]: Configuring controller 'test_random_controllers_4'
6: [INFO] [1704444131.823331232] [test_controller_manager]: Configuring controller 'test_random_controllers_72'
6: [INFO] [1704444131.862205517] [test_controller_manager]: Configuring controller 'test_broadcaster_46'
6: [INFO] [1704444131.892544464] [test_controller_manager]: Configuring controller 'test_random_controllers_15'
6: [INFO] [1704444131.922682018] [test_controller_manager]: Configuring controller 'test_broadcaster_93'
6: [INFO] [1704444131.973086974] [test_controller_manager]: Configuring controller 'test_broadcaster_14'
6: [INFO] [1704444132.013352423] [test_controller_manager]: Configuring controller 'test_broadcaster_38'
6: [INFO] [1704444132.052785028] [test_controller_manager]: Configuring controller 'test_random_controllers_34'
6: [INFO] [1704444132.093343563] [test_controller_manager]: Configuring controller 'test_broadcaster_97'
6: [INFO] [1704444132.133591182] [test_controller_manager]: Configuring controller 'test_broadcaster_4'
6: [INFO] [1704444132.166793799] [test_controller_manager]: Configuring controller 'test_random_controllers_78'
6: [INFO] [1704444132.203680070] [test_controller_manager]: Configuring controller 'test_broadcaster_24'
6: [INFO] [1704444132.258972761] [test_controller_manager]: Configuring controller 'test_broadcaster_92'
6: [INFO] [1704444132.300336989] [test_controller_manager]: Configuring controller 'test_broadcaster_83'
6: [INFO] [1704444132.341418423] [test_controller_manager]: Configuring controller 'test_random_controllers_5'
6: [INFO] [1704444132.381796094] [test_controller_manager]: Configuring controller 'test_broadcaster_86'
6: [INFO] [1704444132.422300939] [test_controller_manager]: Configuring controller 'test_broadcaster_18'
6: [INFO] [1704444132.452532634] [test_controller_manager]: Configuring controller 'test_broadcaster_17'
6: [INFO] [1704444132.493052647] [test_controller_manager]: Configuring controller 'test_broadcaster_51'
6: [INFO] [1704444132.553166352] [test_controller_manager]: Configuring controller 'test_broadcaster_64'
6: [INFO] [1704444132.593360400] [test_controller_manager]: Configuring controller 'test_random_controllers_77'
6: [INFO] [1704444132.633344585] [test_controller_manager]: Configuring controller 'test_broadcaster_58'
6: [INFO] [1704444132.673647235] [test_controller_manager]: Configuring controller 'test_broadcaster_65'
6: [INFO] [1704444132.713602020] [test_controller_manager]: Configuring controller 'test_broadcaster_22'
6: [INFO] [1704444132.743567350] [test_controller_manager]: Configuring controller 'test_broadcaster_19'
6: [INFO] [1704444132.779722749] [test_controller_manager]: Configuring controller 'test_broadcaster_1'
6: [INFO] [1704444132.833256109] [test_controller_manager]: Configuring controller 'test_broadcaster_23'
6: [INFO] [1704444132.872260546] [test_controller_manager]: Configuring controller 'test_broadcaster_26'
6: [INFO] [1704444132.913175958] [test_controller_manager]: Configuring controller 'test_random_controllers_98'
6: [INFO] [1704444132.952768995] [test_controller_manager]: Configuring controller 'test_broadcaster_36'
6: [INFO] [1704444132.993794229] [test_controller_manager]: Configuring controller 'test_broadcaster_25'
6: [INFO] [1704444133.026547438] [test_controller_manager]: Configuring controller 'test_random_controllers_88'
6: [INFO] [1704444133.063386288] [test_controller_manager]: Configuring controller 'test_broadcaster_8'
6: [INFO] [1704444133.120259007] [test_controller_manager]: Configuring controller 'test_broadcaster_89'
6: [INFO] [1704444133.160697479] [test_controller_manager]: Configuring controller 'test_random_controllers_14'
6: [INFO] [1704444133.201355266] [test_controller_manager]: Configuring controller 'test_broadcaster_28'
6: [INFO] [1704444133.242236796] [test_controller_manager]: Configuring controller 'test_broadcaster_60'
6: [INFO] [1704444133.282605788] [test_controller_manager]: Configuring controller 'test_broadcaster_74'
6: [INFO] [1704444133.323363086] [test_controller_manager]: Configuring controller 'test_broadcaster_62'
6: [INFO] [1704444133.363042516] [test_controller_manager]: Configuring controller 'test_broadcaster_63'
6: [INFO] [1704444133.423112560] [test_controller_manager]: Configuring controller 'test_random_controllers_11'
6: [INFO] [1704444133.463205676] [test_controller_manager]: Configuring controller 'test_random_controllers_94'
6: [INFO] [1704444133.503340334] [test_controller_manager]: Configuring controller 'test_random_controllers_35'
6: [INFO] [1704444133.547483311] [test_controller_manager]: Configuring controller 'test_broadcaster_67'
6: [INFO] [1704444133.588771779] [test_controller_manager]: Configuring controller 'test_broadcaster_48'
6: [INFO] [1704444133.623543003] [test_controller_manager]: Configuring controller 'test_broadcaster_21'
6: [INFO] [1704444133.660542126] [test_controller_manager]: Configuring controller 'test_broadcaster_68'
6: [INFO] [1704444133.722028305] [test_controller_manager]: Configuring controller 'test_broadcaster_69'
6: [INFO] [1704444133.773357237] [test_controller_manager]: Configuring controller 'test_random_controllers_27'
6: [INFO] [1704444133.815219474] [test_controller_manager]: Configuring controller 'test_broadcaster_45'
6: [INFO] [1704444133.863032576] [test_controller_manager]: Configuring controller 'test_random_controllers_6'
6: [INFO] [1704444133.907191243] [test_controller_manager]: Configuring controller 'test_broadcaster_73'
6: [INFO] [1704444133.943683397] [test_controller_manager]: Configuring controller 'test_broadcaster_71'
6: [INFO] [1704444133.978878909] [test_controller_manager]: Configuring controller 'test_broadcaster_75'
6: [INFO] [1704444134.040542671] [test_controller_manager]: Configuring controller 'test_random_controllers_97'
6: [INFO] [1704444134.083371315] [test_controller_manager]: Configuring controller 'test_broadcaster_66'
6: [INFO] [1704444134.133423265] [test_controller_manager]: Configuring controller 'test_random_controllers_25'
6: [INFO] [1704444134.184151557] [test_controller_manager]: Configuring controller 'test_broadcaster_80'
6: [INFO] [1704444134.233329162] [test_controller_manager]: Configuring controller 'test_broadcaster_76'
6: [INFO] [1704444134.273623393] [test_controller_manager]: Configuring controller 'test_broadcaster_78'
6: [INFO] [1704444134.313433275] [test_controller_manager]: Configuring controller 'test_broadcaster_79'
6: [INFO] [1704444134.377517848] [test_controller_manager]: Configuring controller 'test_random_controllers_20'
6: [INFO] [1704444134.423433417] [test_controller_manager]: Configuring controller 'test_random_controllers_45'
6: [INFO] [1704444134.470540286] [test_controller_manager]: Configuring controller 'test_broadcaster_81'
6: [INFO] [1704444134.523322733] [test_controller_manager]: Configuring controller 'test_random_controllers_54'
6: [INFO] [1704444134.573357623] [test_controller_manager]: Configuring controller 'test_broadcaster_82'
6: [INFO] [1704444134.613356028] [test_controller_manager]: Configuring controller 'test_random_controllers_16'
6: [INFO] [1704444134.653634518] [test_controller_manager]: Configuring controller 'test_random_controllers_68'
6: [INFO] [1704444134.723426132] [test_controller_manager]: Configuring controller 'test_broadcaster_88'
6: [INFO] [1704444134.773465972] [test_controller_manager]: Configuring controller 'test_broadcaster_85'
6: [INFO] [1704444134.820885516] [test_controller_manager]: Configuring controller 'test_broadcaster_70'
6: [INFO] [1704444134.872470563] [test_controller_manager]: Configuring controller 'test_broadcaster_87'
6: [INFO] [1704444134.923463959] [test_controller_manager]: Configuring controller 'test_broadcaster_90'
6: [INFO] [1704444134.962998976] [test_controller_manager]: Configuring controller 'test_random_controllers_36'
6: [INFO] [1704444135.003321367] [test_controller_manager]: Configuring controller 'test_broadcaster_91'
6: [INFO] [1704444135.078564155] [test_controller_manager]: Configuring controller 'test_broadcaster_94'
6: [INFO] [1704444135.129769816] [test_controller_manager]: Configuring controller 'test_broadcaster_43'
6: [INFO] [1704444135.180275074] [test_controller_manager]: Configuring controller 'test_broadcaster_95'
6: [INFO] [1704444135.231529405] [test_controller_manager]: Configuring controller 'test_random_controllers_29'
6: [INFO] [1704444135.282992380] [test_controller_manager]: Configuring controller 'test_broadcaster_2'
6: [INFO] [1704444135.323320121] [test_controller_manager]: Configuring controller 'test_random_controllers_21'
6: [INFO] [1704444135.363818195] [test_controller_manager]: Configuring controller 'test_random_controllers_37'
6: [INFO] [1704444135.438043256] [test_controller_manager]: Configuring controller 'test_broadcaster_96'
6: [INFO] [1704444135.489326848] [test_controller_manager]: Configuring controller 'test_random_controllers_1'
6: [INFO] [1704444135.541087088] [test_controller_manager]: Configuring controller 'test_broadcaster_5'
6: [INFO] [1704444135.592535382] [test_controller_manager]: Configuring controller 'test_random_controllers_2'
6: [INFO] [1704444135.643147092] [test_controller_manager]: Configuring controller 'test_random_controllers_9'
6: [INFO] [1704444135.683696227] [test_controller_manager]: Configuring controller 'test_random_controllers_39'
6: [INFO] [1704444135.726551203] [test_controller_manager]: Configuring controller 'test_random_controllers_8'
6: [INFO] [1704444135.809168629] [test_controller_manager]: Configuring controller 'test_random_controllers_12'
6: [INFO] [1704444135.863455223] [test_controller_manager]: Configuring controller 'test_random_controllers_13'
6: [INFO] [1704444135.921610034] [test_controller_manager]: Configuring controller 'test_random_controllers_23'
6: [INFO] [1704444135.983577702] [test_controller_manager]: Configuring controller 'test_broadcaster_61'
6: [INFO] [1704444136.043320310] [test_controller_manager]: Configuring controller 'test_random_controllers_19'
6: [INFO] [1704444136.085907361] [test_controller_manager]: Configuring controller 'test_random_controllers_18'
6: [INFO] [1704444136.133308285] [test_controller_manager]: Configuring controller 'test_random_controllers_24'
6: [INFO] [1704444136.220046444] [test_controller_manager]: Configuring controller 'test_random_controllers_26'
6: [ERROR] [1704444136.281777358] [srv_client]: The duration to configure the random_ctrl is : 7587.939504!
6: [INFO] [1704444136.302768113] [srv_client]: Check successful!
[Processing: controller_manager]                           
6: [       OK ] TestControllerManagerSrvs.list_large_number_of_controllers_with_chains (33356 ms)

However, on the CI it seems to take longer due to the limit in the CPUs and also as they are not so powerful enough. It took more than 120 seconds for around 160+ controllers (more or less 40 controllers remaining to configure).

[ RUN      ] TestControllerManagerSrvs.list_large_number_of_controllers_with_chains
[WARN] [1703851740.712249680] [test_controller_manager]: 'update_rate' parameter not set, using default value.
[INFO] [1703851740.712295736] [test_controller_manager]: Subscribing to '~/robot_description' topic for robot description file.
[INFO] [1703851740.717237805] [test_controller_manager]: Received robot description file.
[INFO] [1703851740.717395047] [resource_manager]: Loading hardware 'TestActuatorHardware' 
[INFO] [1703851740.718328574] [resource_manager]: Initialize hardware 'TestActuatorHardware' 
[INFO] [1703851740.718372606] [resource_manager]: Successful initialization of hardware 'TestActuatorHardware'
[INFO] [1703851740.718428239] [resource_manager]: Loading hardware 'TestSensorHardware' 
[INFO] [1703851740.718947473] [resource_manager]: Initialize hardware 'TestSensorHardware' 
[INFO] [1703851740.718994090] [resource_manager]: Successful initialization of hardware 'TestSensorHardware'
[INFO] [1703851740.719031650] [resource_manager]: Loading hardware 'TestSystemHardware' 
[INFO] [1703851740.719563307] [resource_manager]: Initialize hardware 'TestSystemHardware' 
[INFO] [1703851740.719610595] [resource_manager]: Successful initialization of hardware 'TestSystemHardware'
[INFO] [1703851740.719658724] [test_system]: Exporting configuration interfaces.
[INFO] [1703851740.719762377] [resource_manager]: 'configure' hardware 'TestActuatorHardware' 
[INFO] [1703851740.719790269] [resource_manager]: Successful 'configure' of hardware 'TestActuatorHardware'
[INFO] [1703851740.719806228] [resource_manager]: 'activate' hardware 'TestActuatorHardware' 
[INFO] [1703851740.719822599] [resource_manager]: Successful 'activate' of hardware 'TestActuatorHardware'
[INFO] [1703851740.719855169] [resource_manager]: 'configure' hardware 'TestSensorHardware' 
[INFO] [1703851740.719874956] [resource_manager]: Successful 'configure' of hardware 'TestSensorHardware'
[INFO] [1703851740.719888431] [resource_manager]: 'activate' hardware 'TestSensorHardware' 
[INFO] [1703851740.719905993] [resource_manager]: Successful 'activate' of hardware 'TestSensorHardware'
[INFO] [1703851740.719925720] [resource_manager]: 'configure' hardware 'TestSystemHardware' 
[INFO] [1703851740.719943904] [resource_manager]: Successful 'configure' of hardware 'TestSystemHardware'
[INFO] [1703851740.719969331] [resource_manager]: 'activate' hardware 'TestSystemHardware' 
[INFO] [1703851740.719986914] [resource_manager]: Successful 'activate' of hardware 'TestSystemHardware'
[ERROR] [1703851740.774606895] [srv_client]: Initializing controller : test_random_controllers_0 !
[ERROR] [1703851740.774656106] [srv_client]: Initializing controller : test_random_controllers_1 !
[ERROR] [1703851740.774696922] [srv_client]: Initializing controller : test_random_controllers_2 !
[ERROR] [1703851740.774732879] [srv_client]: Initializing controller : test_random_controllers_3 !
[ERROR] [1703851740.774764497] [srv_client]: Initializing controller : test_random_controllers_4 !
[ERROR] [1703851740.774789333] [srv_client]: Initializing controller : test_random_controllers_5 !
[ERROR] [1703851740.774810563] [srv_client]: Initializing controller : test_random_controllers_6 !
[ERROR] [1703851740.774830901] [srv_client]: Initializing controller : test_random_controllers_7 !
[ERROR] [1703851740.774852791] [srv_client]: Initializing controller : test_random_controllers_8 !
[ERROR] [1703851740.774883198] [srv_client]: Initializing controller : test_random_controllers_9 !
[ERROR] [1703851740.774912162] [srv_client]: Initializing controller : test_random_controllers_10 !
[ERROR] [1703851740.774933882] [srv_client]: Initializing controller : test_random_controllers_11 !
[ERROR] [1703851740.774963808] [srv_client]: Initializing controller : test_random_controllers_12 !
[ERROR] [1703851740.774986850] [srv_client]: Initializing controller : test_random_controllers_13 !
[ERROR] [1703851740.775009052] [srv_client]: Initializing controller : test_random_controllers_14 !
[ERROR] [1703851740.775030852] [srv_client]: Initializing controller : test_random_controllers_15 !
[ERROR] [1703851740.775060427] [srv_client]: Initializing controller : test_random_controllers_16 !
[ERROR] [1703851740.775080444] [srv_client]: Initializing controller : test_random_controllers_17 !
[ERROR] [1703851740.775097616] [srv_client]: Initializing controller : test_random_controllers_18 !
[ERROR] [1703851740.775123023] [srv_client]: Initializing controller : test_random_controllers_19 !
[ERROR] [1703851740.775133663] [srv_client]: Initializing controller : test_random_controllers_20 !
[ERROR] [1703851740.775144633] [srv_client]: Initializing controller : test_random_controllers_21 !
[ERROR] [1703851740.775163799] [srv_client]: Initializing controller : test_random_controllers_22 !
[ERROR] [1703851740.775185940] [srv_client]: Initializing controller : test_random_controllers_23 !
[ERROR] [1703851740.775220294] [srv_client]: Initializing controller : test_random_controllers_24 !
[ERROR] [1703851740.775249889] [srv_client]: Initializing controller : test_random_controllers_25 !
[ERROR] [1703851740.775271639] [srv_client]: Initializing controller : test_random_controllers_26 !
[ERROR] [1703851740.775300082] [srv_client]: Initializing controller : test_random_controllers_27 !
[ERROR] [1703851740.775326351] [srv_client]: Initializing controller : test_random_controllers_28 !
[ERROR] [1703851740.775357339] [srv_client]: Initializing controller : test_random_controllers_29 !
[ERROR] [1703851740.775379199] [srv_client]: Initializing controller : test_random_controllers_30 !
[ERROR] [1703851740.775405087] [srv_client]: Initializing controller : test_random_controllers_31 !
[ERROR] [1703851740.775424914] [srv_client]: Initializing controller : test_random_controllers_32 !
[ERROR] [1703851740.775446153] [srv_client]: Initializing controller : test_random_controllers_33 !
[ERROR] [1703851740.775476089] [srv_client]: Initializing controller : test_random_controllers_34 !
[ERROR] [1703851740.775500194] [srv_client]: Initializing controller : test_random_controllers_35 !
[ERROR] [1703851740.775529488] [srv_client]: Initializing controller : test_random_controllers_36 !
[ERROR] [1703851740.775541801] [srv_client]: Initializing controller : test_random_controllers_37 !
[ERROR] [1703851740.775555937] [srv_client]: Initializing controller : test_random_controllers_38 !
[ERROR] [1703851740.775576776] [srv_client]: Initializing controller : test_random_controllers_39 !
[ERROR] [1703851740.775599017] [srv_client]: Initializing controller : test_random_controllers_40 !
[ERROR] [1703851740.775618674] [srv_client]: Initializing controller : test_random_controllers_41 !
[ERROR] [1703851740.775647558] [srv_client]: Initializing controller : test_random_controllers_42 !
[ERROR] [1703851740.775687962] [srv_client]: Initializing controller : test_random_controllers_43 !
[ERROR] [1703851740.775719591] [srv_client]: Initializing controller : test_random_controllers_44 !
[ERROR] [1703851740.775748625] [srv_client]: Initializing controller : test_random_controllers_45 !
[ERROR] [1703851740.775770205] [srv_client]: Initializing controller : test_random_controllers_46 !
[ERROR] [1703851740.775796715] [srv_client]: Initializing controller : test_random_controllers_47 !
[ERROR] [1703851740.775819246] [srv_client]: Initializing controller : test_random_controllers_48 !
[ERROR] [1703851740.775845735] [srv_client]: Initializing controller : test_random_controllers_49 !
[ERROR] [1703851740.775871493] [srv_client]: Initializing controller : test_random_controllers_50 !
[ERROR] [1703851740.775892953] [srv_client]: Initializing controller : test_random_controllers_51 !
[ERROR] [1703851740.775921897] [srv_client]: Initializing controller : test_random_controllers_52 !
[ERROR] [1703851740.775945160] [srv_client]: Initializing controller : test_random_controllers_53 !
[ERROR] [1703851740.775967401] [srv_client]: Initializing controller : test_random_controllers_54 !
[ERROR] [1703851740.775994582] [srv_client]: Initializing controller : test_random_controllers_55 !
[ERROR] [1703851740.776016924] [srv_client]: Initializing controller : test_random_controllers_56 !
[ERROR] [1703851740.776044565] [srv_client]: Initializing controller : test_random_controllers_57 !
[ERROR] [1703851740.776067538] [srv_client]: Initializing controller : test_random_controllers_58 !
[ERROR] [1703851740.776088857] [srv_client]: Initializing controller : test_random_controllers_59 !
[ERROR] [1703851740.776110006] [srv_client]: Initializing controller : test_random_controllers_60 !
[ERROR] [1703851740.776133750] [srv_client]: Initializing controller : test_random_controllers_61 !
[ERROR] [1703851740.776154228] [srv_client]: Initializing controller : test_random_controllers_62 !
[ERROR] [1703851740.776176720] [srv_client]: Initializing controller : test_random_controllers_63 !
[ERROR] [1703851740.776203600] [srv_client]: Initializing controller : test_random_controllers_64 !
[ERROR] [1703851740.776224830] [srv_client]: Initializing controller : test_random_controllers_65 !
[ERROR] [1703851740.776253232] [srv_client]: Initializing controller : test_random_controllers_66 !
[ERROR] [1703851740.776277036] [srv_client]: Initializing controller : test_random_controllers_67 !
[ERROR] [1703851740.776300310] [srv_client]: Initializing controller : test_random_controllers_68 !
[ERROR] [1703851740.776324965] [srv_client]: Initializing controller : test_random_controllers_69 !
[ERROR] [1703851740.776346465] [srv_client]: Initializing controller : test_random_controllers_70 !
[ERROR] [1703851740.776357356] [srv_client]: Initializing controller : test_random_controllers_71 !
[ERROR] [1703851740.776376120] [srv_client]: Initializing controller : test_random_controllers_72 !
[ERROR] [1703851740.776394665] [srv_client]: Initializing controller : test_random_controllers_73 !
[ERROR] [1703851740.776405104] [srv_client]: Initializing controller : test_random_controllers_74 !
[ERROR] [1703851740.776422286] [srv_client]: Initializing controller : test_random_controllers_75 !
[ERROR] [1703851740.776444968] [srv_client]: Initializing controller : test_random_controllers_76 !
[ERROR] [1703851740.776466619] [srv_client]: Initializing controller : test_random_controllers_77 !
[ERROR] [1703851740.776489942] [srv_client]: Initializing controller : test_random_controllers_78 !
[ERROR] [1703851740.776511983] [srv_client]: Initializing controller : test_random_controllers_79 !
[ERROR] [1703851740.776532661] [srv_client]: Initializing controller : test_random_controllers_80 !
[ERROR] [1703851740.776599008] [srv_client]: Initializing controller : test_random_controllers_81 !
[ERROR] [1703851740.776630847] [srv_client]: Initializing controller : test_random_controllers_82 !
[ERROR] [1703851740.776653549] [srv_client]: Initializing controller : test_random_controllers_83 !
[ERROR] [1703851740.776697571] [srv_client]: Initializing controller : test_random_controllers_84 !
[ERROR] [1703851740.776731524] [srv_client]: Initializing controller : test_random_controllers_85 !
[ERROR] [1703851740.776754857] [srv_client]: Initializing controller : test_random_controllers_86 !
[ERROR] [1703851740.776785504] [srv_client]: Initializing controller : test_random_controllers_87 !
[ERROR] [1703851740.776808136] [srv_client]: Initializing controller : test_random_controllers_88 !
[ERROR] [1703851740.776839555] [srv_client]: Initializing controller : test_random_controllers_89 !
[ERROR] [1703851740.776859923] [srv_client]: Initializing controller : test_random_controllers_90 !
[ERROR] [1703851740.776880170] [srv_client]: Initializing controller : test_random_controllers_91 !
[ERROR] [1703851740.776908042] [srv_client]: Initializing controller : test_random_controllers_92 !
[ERROR] [1703851740.776930083] [srv_client]: Initializing controller : test_random_controllers_93 !
[ERROR] [1703851740.776952885] [srv_client]: Initializing controller : test_random_controllers_94 !
[ERROR] [1703851740.776974185] [srv_client]: Initializing controller : test_random_controllers_95 !
[ERROR] [1703851740.777037162] [srv_client]: Initializing controller : test_random_controllers_96 !
[ERROR] [1703851740.777097624] [srv_client]: Initializing controller : test_random_controllers_97 !
[ERROR] [1703851740.777131046] [srv_client]: Initializing controller : test_random_controllers_98 !
[ERROR] [1703851740.777156503] [srv_client]: Initializing controller : test_random_controllers_99 !
[INFO] [1703851747.691247534] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_3'
[INFO] [1703851747.728510237] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_5'
[INFO] [1703851747.790583999] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_9'
[INFO] [1703851747.859605766] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_1'
[INFO] [1703851747.913723657] [test_controller_manager]: Configuring controller 'test_controller_name_1'
[INFO] [1703851747.982773045] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_4'
[INFO] [1703851748.033578439] [test_controller_manager]: Configuring controller 'test_controller_name_2'
[INFO] [1703851748.083339029] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_2'
[INFO] [1703851748.162238227] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_6'
[INFO] [1703851748.257522540] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_7'
[INFO] [1703851748.342838461] [test_controller_manager]: Configuring controller 'test_chainable_controller_name_8'
[INFO] [1703851748.509528711] [test_controller_manager]: Configuring controller 'test_random_controllers_96'
[INFO] [1703851748.643574196] [test_controller_manager]: Configuring controller 'test_random_controllers_95'
[INFO] [1703851748.793334921] [test_controller_manager]: Configuring controller 'test_random_controllers_92'
[INFO] [1703851748.968552725] [test_controller_manager]: Configuring controller 'test_random_controllers_91'
[INFO] [1703851749.150204179] [test_controller_manager]: Configuring controller 'test_random_controllers_89'
[INFO] [1703851749.322087161] [test_controller_manager]: Configuring controller 'test_random_controllers_86'
[INFO] [1703851749.531400961] [test_controller_manager]: Configuring controller 'test_random_controllers_85'
[INFO] [1703851749.640407265] [test_controller_manager]: Configuring controller 'test_random_controllers_83'
[INFO] [1703851749.860935381] [test_controller_manager]: Configuring controller 'test_random_controllers_82'
[INFO] [1703851750.132213678] [test_controller_manager]: Configuring controller 'test_random_controllers_80'
[INFO] [1703851750.360654918] [test_controller_manager]: Configuring controller 'test_random_controllers_79'
[INFO] [1703851750.618743373] [test_controller_manager]: Configuring controller 'test_random_controllers_93'
[INFO] [1703851750.939002154] [test_controller_manager]: Configuring controller 'test_random_controllers_76'
[INFO] [1703851751.183662642] [test_controller_manager]: Configuring controller 'test_random_controllers_71'
[INFO] [1703851751.332902015] [test_controller_manager]: Configuring controller 'test_random_controllers_70'
[INFO] [1703851751.532887438] [test_controller_manager]: Configuring controller 'test_random_controllers_67'
[INFO] [1703851751.929538361] [test_controller_manager]: Configuring controller 'test_random_controllers_66'
[INFO] [1703851752.319172172] [test_controller_manager]: Configuring controller 'test_random_controllers_65'
[INFO] [1703851752.641151644] [test_controller_manager]: Configuring controller 'test_random_controllers_64'
[INFO] [1703851752.963655033] [test_controller_manager]: Configuring controller 'test_random_controllers_63'
[INFO] [1703851753.273886220] [test_controller_manager]: Configuring controller 'test_random_controllers_58'
[INFO] [1703851753.482059618] [test_controller_manager]: Configuring controller 'test_random_controllers_56'
[INFO] [1703851753.727774020] [test_controller_manager]: Configuring controller 'test_random_controllers_51'
[INFO] [1703851754.206002777] [test_controller_manager]: Configuring controller 'test_random_controllers_50'
[INFO] [1703851754.589375325] [test_controller_manager]: Configuring controller 'test_random_controllers_49'
[INFO] [1703851754.899266803] [test_controller_manager]: Configuring controller 'test_random_controllers_46'
[INFO] [1703851755.282547631] [test_controller_manager]: Configuring controller 'test_random_controllers_44'
[INFO] [1703851755.658675551] [test_controller_manager]: Configuring controller 'test_random_controllers_43'
[INFO] [1703851755.882839894] [test_controller_manager]: Configuring controller 'test_random_controllers_41'
[INFO] [1703851756.141627588] [test_controller_manager]: Configuring controller 'test_random_controllers_40'
[INFO] [1703851756.751696492] [test_controller_manager]: Configuring controller 'test_random_controllers_99'
[INFO] [1703851757.151390199] [test_controller_manager]: Configuring controller 'test_random_controllers_84'
[INFO] [1703851757.573645687] [test_controller_manager]: Configuring controller 'test_random_controllers_69'
[INFO] [1703851757.988716459] [test_controller_manager]: Configuring controller 'test_random_controllers_59'
[INFO] [1703851758.435185225] [test_controller_manager]: Configuring controller 'test_random_controllers_33'
[INFO] [1703851758.750985335] [test_controller_manager]: Configuring controller 'test_random_controllers_52'
[INFO] [1703851759.071462199] [test_controller_manager]: Configuring controller 'test_random_controllers_32'
[INFO] [1703851759.872987082] [test_controller_manager]: Configuring controller 'test_random_controllers_31'
[INFO] [1703851760.307598464] [test_controller_manager]: Configuring controller 'test_random_controllers_30'
[INFO] [1703851760.802694194] [test_controller_manager]: Configuring controller 'test_random_controllers_28'
[INFO] [1703851761.292612181] [test_controller_manager]: Configuring controller 'test_broadcaster_54'
[INFO] [1703851761.833582270] [test_controller_manager]: Configuring controller 'test_random_controllers_47'
[INFO] [1703851762.203534819] [test_controller_manager]: Configuring controller 'test_broadcaster_55'
[INFO] [1703851762.627967617] [test_controller_manager]: Configuring controller 'test_random_controllers_90'
[INFO] [1703851763.651427565] [test_controller_manager]: Configuring controller 'test_random_controllers_87'
[INFO] [1703851764.152519509] [test_controller_manager]: Configuring controller 'test_broadcaster_16'
[INFO] [1703851764.661946104] [test_controller_manager]: Configuring controller 'test_random_controllers_42'
[INFO] [1703851765.270049680] [test_controller_manager]: Configuring controller 'test_broadcaster_53'
[INFO] [1703851765.807259095] [test_controller_manager]: Configuring controller 'test_random_controllers_81'
[INFO] [1703851766.221764354] [test_controller_manager]: Configuring controller 'test_broadcaster_31'
[INFO] [1703851766.646399408] [test_controller_manager]: Configuring controller 'test_broadcaster_52'
[INFO] [1703851767.640540048] [test_controller_manager]: Configuring controller 'test_broadcaster_49'
[INFO] [1703851768.181264865] [test_controller_manager]: Configuring controller 'test_broadcaster_47'
[INFO] [1703851768.690897768] [test_controller_manager]: Configuring controller 'test_broadcaster_27'
[INFO] [1703851769.281763875] [test_controller_manager]: Configuring controller 'test_random_controllers_74'
[INFO] [1703851769.893118884] [test_controller_manager]: Configuring controller 'test_broadcaster_72'
[INFO] [1703851770.262386162] [test_controller_manager]: Configuring controller 'test_random_controllers_38'
[INFO] [1703851770.692899633] [test_controller_manager]: Configuring controller 'test_broadcaster_44'
[INFO] [1703851771.663558299] [test_controller_manager]: Configuring controller 'test_broadcaster_10'
[INFO] [1703851772.212187475] [test_controller_manager]: Configuring controller 'test_broadcaster_57'
[INFO] [1703851772.770702400] [test_controller_manager]: Configuring controller 'test_random_controllers_55'
[INFO] [1703851773.390044299] [test_controller_manager]: Configuring controller 'test_broadcaster_0'
[INFO] [1703851774.022462749] [test_controller_manager]: Configuring controller 'test_random_controllers_73'
[INFO] [1703851774.387466121] [test_controller_manager]: Configuring controller 'test_random_controllers_7'
[INFO] [1703851774.830004675] [test_controller_manager]: Configuring controller 'test_random_controllers_10'
[INFO] [1703851775.900292811] [test_controller_manager]: Configuring controller 'test_random_controllers_22'
[INFO] [1703851776.551722449] [test_controller_manager]: Configuring controller 'test_broadcaster_41'
[INFO] [1703851777.162214883] [test_controller_manager]: Configuring controller 'test_random_controllers_3'
[INFO] [1703851777.780726901] [test_controller_manager]: Configuring controller 'test_broadcaster_40'
[INFO] [1703851778.432258552] [test_controller_manager]: Configuring controller 'test_broadcaster_99'
[INFO] [1703851778.819687074] [test_controller_manager]: Configuring controller 'test_broadcaster_39'
[INFO] [1703851779.282793878] [test_controller_manager]: Configuring controller 'test_broadcaster_37'
[INFO] [1703851780.350831065] [test_controller_manager]: Configuring controller 'test_random_controllers_75'
[INFO] [1703851780.981078877] [test_controller_manager]: Configuring controller 'test_broadcaster_3'
[INFO] [1703851781.651836455] [test_controller_manager]: Configuring controller 'test_broadcaster_34'
[INFO] [1703851782.330184544] [test_controller_manager]: Configuring controller 'test_broadcaster_32'
[INFO] [1703851783.062266777] [test_controller_manager]: Configuring controller 'test_random_controllers_62'
[INFO] [1703851783.490240962] [test_controller_manager]: Configuring controller 'test_random_controllers_60'
[INFO] [1703851783.961406548] [test_controller_manager]: Configuring controller 'test_broadcaster_15'
[INFO] [1703851785.192824016] [test_controller_manager]: Configuring controller 'test_random_controllers_0'
[INFO] [1703851785.963460146] [test_controller_manager]: Configuring controller 'test_broadcaster_29'
[INFO] [1703851786.642928299] [test_controller_manager]: Configuring controller 'test_random_controllers_61'
[INFO] [1703851787.354055611] [test_controller_manager]: Configuring controller 'test_broadcaster_98'
[INFO] [1703851788.161128910] [test_controller_manager]: Configuring controller 'test_broadcaster_59'
[INFO] [1703851788.612263740] [test_controller_manager]: Configuring controller 'test_broadcaster_11'
[INFO] [1703851789.085389750] [test_controller_manager]: Configuring controller 'test_random_controllers_17'
[INFO] [1703851790.357402281] [test_controller_manager]: Configuring controller 'test_broadcaster_77'
[INFO] [1703851791.118720259] [test_controller_manager]: Configuring controller 'test_random_controllers_57'
[INFO] [1703851791.829926018] [test_controller_manager]: Configuring controller 'test_random_controllers_53'
[INFO] [1703851792.589578933] [test_controller_manager]: Configuring controller 'test_random_controllers_48'
[INFO] [1703851793.321765519] [test_controller_manager]: Configuring controller 'test_broadcaster_7'
[INFO] [1703851793.858759800] [test_controller_manager]: Configuring controller 'test_broadcaster_84'
[INFO] [1703851794.432682761] [test_controller_manager]: Configuring controller 'test_broadcaster_50'
[INFO] [1703851795.782800699] [test_controller_manager]: Configuring controller 'test_broadcaster_33'
[INFO] [1703851796.557470527] [test_controller_manager]: Configuring controller 'test_broadcaster_56'
[INFO] [1703851797.282654131] [test_controller_manager]: Configuring controller 'test_broadcaster_13'
[INFO] [1703851798.071827682] [test_controller_manager]: Configuring controller 'test_broadcaster_30'
[INFO] [1703851798.871839704] [test_controller_manager]: Configuring controller 'test_broadcaster_20'
[INFO] [1703851799.448732031] [test_controller_manager]: Configuring controller 'test_broadcaster_42'
[INFO] [1703851800.058088599] [test_controller_manager]: Configuring controller 'test_broadcaster_35'
[INFO] [1703851801.190431281] [test_controller_manager]: Configuring controller 'test_broadcaster_9'
[INFO] [1703851801.940566228] [test_controller_manager]: Configuring controller 'test_broadcaster_6'
[INFO] [1703851802.943402674] [test_controller_manager]: Configuring controller 'test_broadcaster_12'
[INFO] [1703851803.939048021] [test_controller_manager]: Configuring controller 'test_random_controllers_4'
[INFO] [1703851805.051269162] [test_controller_manager]: Configuring controller 'test_random_controllers_72'
[INFO] [1703851805.851110043] [test_controller_manager]: Configuring controller 'test_broadcaster_46'
[INFO] [1703851806.401814207] [test_controller_manager]: Configuring controller 'test_random_controllers_15'
[INFO] [1703851807.069757790] [test_controller_manager]: Configuring controller 'test_broadcaster_93'
[INFO] [1703851808.587613627] [test_controller_manager]: Configuring controller 'test_broadcaster_14'
[INFO] [1703851809.372433539] [test_controller_manager]: Configuring controller 'test_broadcaster_38'
[INFO] [1703851810.204595899] [test_controller_manager]: Configuring controller 'test_random_controllers_34'
[INFO] [1703851811.010607481] [test_controller_manager]: Configuring controller 'test_broadcaster_97'
[INFO] [1703851811.865028774] [test_controller_manager]: Configuring controller 'test_broadcaster_4'
[INFO] [1703851812.439632414] [test_controller_manager]: Configuring controller 'test_random_controllers_78'
[INFO] [1703851813.079852384] [test_controller_manager]: Configuring controller 'test_broadcaster_24'
[INFO] [1703851814.577181642] [test_controller_manager]: Configuring controller 'test_broadcaster_92'
[INFO] [1703851815.471945526] [test_controller_manager]: Configuring controller 'test_broadcaster_83'
[INFO] [1703851816.338941264] [test_controller_manager]: Configuring controller 'test_random_controllers_5'
[INFO] [1703851817.226438532] [test_controller_manager]: Configuring controller 'test_broadcaster_86'
[INFO] [1703851818.081491251] [test_controller_manager]: Configuring controller 'test_broadcaster_18'
[INFO] [1703851818.704239320] [test_controller_manager]: Configuring controller 'test_broadcaster_17'
[INFO] [1703851819.303907734] [test_controller_manager]: Configuring controller 'test_broadcaster_51'
[INFO] [1703851820.853565464] [test_controller_manager]: Configuring controller 'test_broadcaster_64'
[INFO] [1703851821.691828492] [test_controller_manager]: Configuring controller 'test_random_controllers_77'
[INFO] [1703851822.528928961] [test_controller_manager]: Configuring controller 'test_broadcaster_58'
[INFO] [1703851823.420420553] [test_controller_manager]: Configuring controller 'test_broadcaster_65'
[INFO] [1703851824.331657294] [test_controller_manager]: Configuring controller 'test_broadcaster_22'
[INFO] [1703851824.892137890] [test_controller_manager]: Configuring controller 'test_broadcaster_19'
[INFO] [1703851825.573653111] [test_controller_manager]: Configuring controller 'test_broadcaster_1'
[INFO] [1703851827.220120209] [test_controller_manager]: Configuring controller 'test_broadcaster_23'
[INFO] [1703851828.159972507] [test_controller_manager]: Configuring controller 'test_broadcaster_26'
[INFO] [1703851829.029823892] [test_controller_manager]: Configuring controller 'test_random_controllers_98'
[INFO] [1703851829.971654029] [test_controller_manager]: Configuring controller 'test_broadcaster_36'
[INFO] [1703851830.940349775] [test_controller_manager]: Configuring controller 'test_broadcaster_25'
[INFO] [1703851831.533942078] [test_controller_manager]: Configuring controller 'test_random_controllers_88'
[INFO] [1703851832.187546857] [test_controller_manager]: Configuring controller 'test_broadcaster_8'
[INFO] [1703851833.898712676] [test_controller_manager]: Configuring controller 'test_broadcaster_89'
[INFO] [1703851834.800504592] [test_controller_manager]: Configuring controller 'test_random_controllers_14'
[INFO] [1703851835.719118191] [test_controller_manager]: Configuring controller 'test_broadcaster_28'
[INFO] [1703851836.632235645] [test_controller_manager]: Configuring controller 'test_broadcaster_60'
[INFO] [1703851837.650553802] [test_controller_manager]: Configuring controller 'test_broadcaster_74'
[INFO] [1703851838.289831459] [test_controller_manager]: Configuring controller 'test_broadcaster_62'
[INFO] [1703851838.980776695] [test_controller_manager]: Configuring controller 'test_broadcaster_63'
[INFO] [1703851840.589988140] [test_controller_manager]: Configuring controller 'test_random_controllers_11'
[INFO] [1703851841.539185781] [test_controller_manager]: Configuring controller 'test_random_controllers_94'
[INFO] [1703851842.557418507] [test_controller_manager]: Configuring controller 'test_random_controllers_35'
[INFO] [1703851843.500681948] [test_controller_manager]: Configuring controller 'test_broadcaster_67'
[INFO] [1703851844.501399296] [test_controller_manager]: Configuring controller 'test_broadcaster_48'
[INFO] [1703851845.118958074] [test_controller_manager]: Configuring controller 'test_broadcaster_21'
[INFO] [1703851845.829341392] [test_controller_manager]: Configuring controller 'test_broadcaster_68'
[INFO] [1703851847.609576335] [test_controller_manager]: Configuring controller 'test_broadcaster_69'
[INFO] [1703851848.542073180] [test_controller_manager]: Configuring controller 'test_random_controllers_27'
[INFO] [1703851849.509180147] [test_controller_manager]: Configuring controller 'test_broadcaster_45'
[INFO] [1703851850.529252949] [test_controller_manager]: Configuring controller 'test_random_controllers_6'
[INFO] [1703851851.561758287] [test_controller_manager]: Configuring controller 'test_broadcaster_73'
[INFO] [1703851852.211398900] [test_controller_manager]: Configuring controller 'test_broadcaster_71'
[INFO] [1703851853.000109375] [test_controller_manager]: Configuring controller 'test_broadcaster_75'
[INFO] [1703851854.879287544] [test_controller_manager]: Configuring controller 'test_random_controllers_97'
[INFO] [1703851855.921129782] [test_controller_manager]: Configuring controller 'test_broadcaster_66'
[INFO] [1703851856.951663812] [test_controller_manager]: Configuring controller 'test_random_controllers_25'
[INFO] [1703851858.021174567] [test_controller_manager]: Configuring controller 'test_broadcaster_80'
>>>
build/controller_manager/test_results/controller_manager/test_controller_manager_srvs.gtest.xml: 1 test, 1 error, 0 failures, 0 skipped
- controller_manager test_controller_manager_srvs.gtest.missing_result
<<< error message
The test did not generate a result file.
>>>

As this is the case, I recommend reducing the number of controllers for the sake for determinism and less run time on Ci

@saikishor
Copy link
Member

I've also tried to reduce the number of CPUs used by my docker container recommended by as @moriarty. I also see that the runtime of the tests is nearly double.

@christophfroehlich
Copy link
Contributor Author

Can't we improve the speed of the service itself? Or which part is taking such a long time per controller?

@christophfroehlich
Copy link
Contributor Author

It seems to be fixed with #1384 on rolling, test_controller_manager_srvs needs 30s on my local docker instance vs 45s with humble.

There wasn't any failing test due to a timeout in the last weeks on humble/iron, so I hope this is not a problem any more.

@christophfroehlich
Copy link
Contributor Author

@saikishor I analyzed the times for the failing CI in #1700 with #1781

Times are in ms, iron behaves similar to rolling.

  humble iron
TestControllerManagerSrvs.list_controller_types 107 123
TestControllerManagerSrvs.list_controllers_srv 192 209
TestControllerManagerSrvs.list_chained_controllers_srv 166 192
TestControllerManagerSrvs.reload_controller_libraries_srv 439 446
TestControllerManagerSrvs.load_controller_srv 136 145
TestControllerManagerSrvs.unload_controller_srv 145 158
TestControllerManagerSrvs.configure_controller_srv 194 209
TestControllerManagerSrvs.list_sorted_chained_controllers 217 240
TestControllerManagerSrvs.list_sorted_complex_chained_controllers 263 285
TestControllerManagerSrvs.list_sorted_independent_chained_controllers 312 339
TestControllerManagerSrvs.list_large_number_of_controllers_with_chains 185696 31100
TestControllerManagerSrvs.list_sorted_large_chained_controller_tree 22836 6420
TestControllerManagerSrvs.activate_chained_controllers_one_by_one 217 225
TestControllerManagerSrvs.activate_chained_controllers_all_at_once 171 190

#1384 hasn't been backported to iron, why is iron fine but humble not?
How should we fix this in humble:

  • increase timeout
  • decrease amount of controllers in the tests
  • anything else?

@saikishor
Copy link
Member

@christophfroehlich if the Iron doesn't have #1384 it doesn't make a lot of sense as you said. Moreover, it's like 6 times. Maybe we can reduce the number for now and see. Moreover, in that test, we have like 100+ controllers, this is not so usual case, so it shouldn't be a lot of problem.

What do you say?

@christophfroehlich
Copy link
Contributor Author

I have no idea actually :D You are more familiar with this test, could you have a quick look and compare the test from humble/iron?
If you don't find a possible conceptional cause of this, I prefer to reduce the number of controllers for the tests on humble to get back to "stable" CI.

@saikishor
Copy link
Member

Sure, I will check it once I get some free time :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants