startup_regtest not starting more than one node successfully

[daywalker90]

Even with #7854 startup_regtest.sh is not working for me on master right now. If i try to start 2 nodes with start_ln 2 only one of them (random choice) will start, the other will not. On cli this gets printed:

Reading JSON input: Connection reset by peerReading JSON input: Connection reset by peerReading JSON input: Connection reset by peerReading JSON input: Connection reset by peerReading JSON input: Connection reset by peerReading JSON input: Connection reset by peerLost connection to the RPC socket.Lost connection to the RPC socket.Reading JSON input: Connection reset by peerLost connection to the RPC socket.Reading JSON input: Connection reset by peerLost connection to the RPC socket.[2]+  Exit 1

Logs from the node that didn't start:

2024-11-22T13:19:46.665Z INFO    lightningd: v24.08-462-g4186591
2024-11-22T13:19:46.767Z DEBUG   lightningd: Opened log file /tmp/l2/log
2024-11-22T13:19:46.776Z DEBUG   plugin-manager: started(162250) /home/user/lightning/plugins/autoclean
2024-11-22T13:19:46.784Z DEBUG   plugin-manager: started(162252) /home/user/lightning/plugins/chanbackup
2024-11-22T13:19:46.792Z DEBUG   plugin-manager: started(162254) /home/user/lightning/plugins/bcli
2024-11-22T13:19:46.800Z DEBUG   plugin-manager: started(162256) /home/user/lightning/plugins/commando
2024-11-22T13:19:46.808Z DEBUG   plugin-manager: started(162258) /home/user/lightning/plugins/funder
2024-11-22T13:19:46.816Z DEBUG   plugin-manager: started(162260) /home/user/lightning/plugins/topology
2024-11-22T13:19:46.824Z DEBUG   plugin-manager: started(162262) /home/user/lightning/plugins/exposesecret
2024-11-22T13:19:46.832Z DEBUG   plugin-manager: started(162264) /home/user/lightning/plugins/keysend
2024-11-22T13:19:46.840Z DEBUG   plugin-manager: started(162266) /home/user/lightning/plugins/offers
2024-11-22T13:19:46.848Z DEBUG   plugin-manager: started(162268) /home/user/lightning/plugins/pay
2024-11-22T13:19:46.856Z DEBUG   plugin-manager: started(162270) /home/user/lightning/plugins/recklessrpc
2024-11-22T13:19:46.864Z DEBUG   plugin-manager: started(162272) /home/user/lightning/plugins/recover
2024-11-22T13:19:46.871Z DEBUG   plugin-manager: started(162274) /home/user/lightning/plugins/txprepare
2024-11-22T13:19:46.879Z DEBUG   plugin-manager: started(162276) /home/user/lightning/plugins/cln-renepay
2024-11-22T13:19:46.886Z DEBUG   plugin-manager: started(162278) /home/user/lightning/plugins/cln-xpay
2024-11-22T13:19:46.894Z DEBUG   plugin-manager: started(162280) /home/user/lightning/plugins/spenderp
2024-11-22T13:19:46.902Z DEBUG   plugin-manager: started(162282) /home/user/lightning/plugins/cln-askrene
2024-11-22T13:19:46.909Z DEBUG   plugin-manager: started(162284) /home/user/lightning/plugins/sql
2024-11-22T13:19:46.917Z DEBUG   plugin-manager: started(162286) /home/user/lightning/plugins/cln-grpc
2024-11-22T13:19:46.925Z DEBUG   plugin-manager: started(162289) /home/user/lightning/plugins/bookkeeper
2024-11-22T13:19:46.932Z DEBUG   plugin-manager: started(162292) /home/user/lightning/plugins/clnrest/clnrest
2024-11-22T13:19:46.940Z DEBUG   plugin-manager: started(162294) /home/user/lightning/plugins/wss-proxy/wss-proxy
2024-11-22T13:19:47.272Z UNUSUAL plugin-bookkeeper: topic 'utxo_deposit' is not a known notification topic
2024-11-22T13:19:47.272Z UNUSUAL plugin-bookkeeper: topic 'utxo_spend' is not a known notification topic
2024-11-22T13:19:47.272Z DEBUG   lightningd: io_break: check_plugins_manifests
2024-11-22T13:19:47.272Z DEBUG   lightningd: io_loop_with_timers: plugins_init
2024-11-22T13:19:47.273Z DEBUG   lightningd: testing /home/user/lightning/lightningd/lightning_channeld
2024-11-22T13:19:47.274Z DEBUG   lightningd: testing /home/user/lightning/lightningd/lightning_closingd
2024-11-22T13:19:47.275Z DEBUG   lightningd: testing /home/user/lightning/lightningd/lightning_connectd
2024-11-22T13:19:47.276Z DEBUG   lightningd: testing /home/user/lightning/lightningd/lightning_gossipd
2024-11-22T13:19:47.276Z DEBUG   lightningd: testing /home/user/lightning/lightningd/lightning_hsmd
2024-11-22T13:19:47.277Z DEBUG   lightningd: testing /home/user/lightning/lightningd/lightning_onchaind
2024-11-22T13:19:47.278Z DEBUG   lightningd: testing /home/user/lightning/lightningd/lightning_openingd
2024-11-22T13:19:47.279Z DEBUG   hsmd: pid 162310, msgfd 62
2024-11-22T13:19:47.280Z DEBUG   hsmd: capability +WIRE_HSMD_CHECK_PUBKEY
2024-11-22T13:19:47.280Z DEBUG   hsmd: capability +WIRE_HSMD_SIGN_ANY_DELAYED_PAYMENT_TO_US
2024-11-22T13:19:47.280Z DEBUG   hsmd: capability +WIRE_HSMD_SIGN_ANCHORSPEND
2024-11-22T13:19:47.280Z DEBUG   hsmd: capability +WIRE_HSMD_SIGN_HTLC_TX_MINGLE
2024-11-22T13:19:47.280Z DEBUG   hsmd: capability +WIRE_HSMD_SIGN_SPLICE_TX
2024-11-22T13:19:47.280Z DEBUG   hsmd: capability +WIRE_HSMD_CHECK_OUTPOINT
2024-11-22T13:19:47.280Z DEBUG   hsmd: capability +WIRE_HSMD_FORGET_CHANNEL
2024-11-22T13:19:47.280Z DEBUG   hsmd: capability +WIRE_HSMD_REVOKE_COMMITMENT_TX
2024-11-22T13:19:47.280Z DEBUG   hsmd: capability +WIRE_HSMD_SIGN_BOLT12_2
2024-11-22T13:19:47.280Z DEBUG   hsmd: capability +WIRE_HSMD_PREAPPROVE_INVOICE_CHECK
2024-11-22T13:19:47.280Z DEBUG   hsmd: capability +WIRE_HSMD_PREAPPROVE_KEYSEND_CHECK
2024-11-22T13:19:47.282Z DEBUG   connectd: pid 162312, msgfd 66
2024-11-22T13:19:47.282Z DEBUG   hsmd: preinit: dev_fail_preapprove = 0, dev_no_preapprove_check = 0
2024-11-22T13:19:47.282Z DEBUG   hsmd: Client: Received message 27 from client
2024-11-22T13:19:47.282Z DEBUG   hsmd: Client: Received message 27 from client
2024-11-22T13:19:47.282Z DEBUG   hsmd: Client: Received message 27 from client
2024-11-22T13:19:47.282Z DEBUG   hsmd: new_client: 0
2024-11-22T13:19:47.350Z DEBUG   connectd: Created listener on 127.0.0.1:7272
2024-11-22T13:19:47.350Z DEBUG   connectd: REPLY WIRE_CONNECTD_INIT_REPLY with 0 fds
2024-11-22T13:19:47.350Z DEBUG   lightningd: io_break: connect_init_done
2024-11-22T13:19:47.351Z DEBUG   lightningd: io_loop: connectd_init
2024-11-22T13:19:47.367Z INFO    plugin-bcli: bitcoin-cli initialized and connected to bitcoind.
2024-11-22T13:19:47.367Z DEBUG   lightningd: io_break: plugin_config_cb
2024-11-22T13:19:47.367Z DEBUG   lightningd: io_loop_with_timers: config_plugin
2024-11-22T13:19:47.367Z DEBUG   lightningd: All Bitcoin plugin commands registered
2024-11-22T13:19:47.395Z DEBUG   lightningd: Adding block 490: 3226a742dfadb1c77f55996a91715991d48969836096e50b977b6f6143872c18
2024-11-22T13:19:47.398Z DEBUG   wallet: Loaded 0 channels from DB
2024-11-22T13:19:47.398Z DEBUG   lightningd: Increasing file descriptor limit to 65536 (0 channels, max is 524288)
2024-11-22T13:19:47.399Z DEBUG   gossipd: pid 162333, msgfd 65
2024-11-22T13:19:47.399Z DEBUG   hsmd: new_client: 0
2024-11-22T13:19:47.400Z DEBUG   gossipd: Store compact time: 0 msec
2024-11-22T13:19:47.400Z DEBUG   gossipd: gossip_store: Read 0/0/0/0 cannounce/cupdate/nannounce/delete from store in 23 bytes, now 1 bytes (populated=false)
2024-11-22T13:19:47.400Z DEBUG   gossipd: seeker: state = STARTING_UP New seeker
2024-11-22T13:19:47.401Z DEBUG   gossipd: REPLY WIRE_GOSSIPD_INIT_REPLY with 0 fds
2024-11-22T13:19:47.401Z DEBUG   lightningd: io_break: gossipd_init_done
2024-11-22T13:19:47.401Z DEBUG   lightningd: io_loop: gossip_init
2024-11-22T13:19:47.406Z DEBUG   plugin-bookkeeper: Setting up database at sqlite3://accounts.sqlite3
2024-11-22T13:19:47.406Z DEBUG   lightningd: Looking for [autoclean,succeededforwards,num]
2024-11-22T13:19:47.406Z DEBUG   plugin-wss-proxy: Initiating websocket secure server...
2024-11-22T13:19:47.406Z DEBUG   plugin-wss-proxy: Killing plugin: disabled itself at init: `wss-bind-addr` option is not configured
2024-11-22T13:19:47.407Z INFO    plugin-cln-grpc: Killing plugin: exited during normal operation
2024-11-22T13:19:47.407Z **BROKEN** plugin-cln-grpc: Plugin marked as important, shutting down lightningd!
2024-11-22T13:19:47.407Z DEBUG   lightningd: io_break: lightningd_exit
2024-11-22T13:19:47.409Z **BROKEN** plugin-exposesecret: Reading JSON input: Connection reset by peer
2024-11-22T13:19:47.409Z INFO    plugin-exposesecret: Killing plugin: exited before replying to init
2024-11-22T13:19:47.409Z **BROKEN** plugin-exposesecret: Plugin marked as important, shutting down lightningd!
2024-11-22T13:19:47.410Z DEBUG   lightningd: io_break: lightningd_exit
2024-11-22T13:19:47.410Z **BROKEN** plugin-offers: Reading JSON input: Connection reset by peer
2024-11-22T13:19:47.410Z INFO    plugin-offers: Killing plugin: exited before replying to init
2024-11-22T13:19:47.410Z **BROKEN** plugin-offers: Plugin marked as important, shutting down lightningd!
2024-11-22T13:19:47.410Z DEBUG   lightningd: io_break: lightningd_exit
2024-11-22T13:19:47.410Z **BROKEN** plugin-funder: Reading JSON input: Connection reset by peer
2024-11-22T13:19:47.410Z INFO    plugin-funder: Killing plugin: exited before replying to init
2024-11-22T13:19:47.410Z **BROKEN** plugin-funder: Plugin marked as important, shutting down lightningd!
2024-11-22T13:19:47.410Z DEBUG   lightningd: io_break: lightningd_exit
2024-11-22T13:19:47.411Z **BROKEN** plugin-pay: Reading JSON input: Connection reset by peer
2024-11-22T13:19:47.411Z INFO    plugin-pay: Killing plugin: exited before replying to init
2024-11-22T13:19:47.411Z **BROKEN** plugin-pay: Plugin marked as important, shutting down lightningd!
2024-11-22T13:19:47.411Z DEBUG   lightningd: io_break: lightningd_exit
2024-11-22T13:19:47.411Z DEBUG   connectd: REPLY WIRE_CONNECTD_START_SHUTDOWN_REPLY with 0 fds
2024-11-22T13:19:47.411Z DEBUG   lightningd: io_break: connectd_start_shutdown_reply
2024-11-22T13:19:47.412Z **BROKEN** plugin-bookkeeper: Lost connection to the RPC socket.
2024-11-22T13:19:47.413Z DEBUG   plugin-bookkeeper: Killing plugin: exited during normal operation
2024-11-22T13:19:47.413Z **BROKEN** plugin-cln-xpay: Lost connection to the RPC socket.
2024-11-22T13:19:47.413Z DEBUG   plugin-cln-xpay: Killing plugin: exited during normal operation
2024-11-22T13:19:47.413Z **BROKEN** plugin-spenderp: Lost connection to the RPC socket.
2024-11-22T13:19:47.413Z DEBUG   plugin-spenderp: Killing plugin: exited during normal operation
2024-11-22T13:19:47.413Z DEBUG   plugin-bcli: Killing plugin: exited during normal operation
2024-11-22T13:19:47.414Z **BROKEN** plugin-txprepare: Lost connection to the RPC socket.
2024-11-22T13:19:47.414Z DEBUG   plugin-txprepare: Killing plugin: exited during normal operation
2024-11-22T13:19:47.414Z DEBUG   plugin-commando: Killing plugin: exited during normal operation
2024-11-22T13:19:47.414Z DEBUG   lightningd: io_break: destroy_plugin
2024-11-22T13:19:47.414Z DEBUG   connectd: Shutting down
2024-11-22T13:19:47.414Z DEBUG   gossipd: Shutting down
2024-11-22T13:19:47.415Z DEBUG   hsmd: Shutting down