You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
version 1.11.9
EC is besu, BN Nimbus
HW: Kingston KC3000 2TB, CPU is i7-8550U (not ideal but meets the minimum benchmar required and does the job), 16 GB DDR4 RAM. Network is perfectly stable 1/1 Gbps fiber.
Discussed a lot on discord, and found out some details.
RP node runs smoothly and validates properly most of the time. But every 5 minutes rockepool_node performs some task that makes the besu EC consume a lot of I/O and CPU time (lasting about a minute). During these spikes attestations fail and I have also missed a proposal during such a load.
For testing purposes (as advised on RP Discord support) I stopped rocketpool_node for 30 mins and confirmed the high load was gone.
The screenshot below illustrates the CPU and I/O reduction with disabled node:
Node log shows no errors/warnings.
BN log has a few "Missed multiple heartbeats" entries during peaks.
FUN FACT:
This is a Proxmox virtualization host, with LXC Containers (very low overhead). There are two containers running:
Rocketpool node - all functions (EC,BN,Validator,Node, mev, prometheus...etc)
Stader - Runing just a Validator role (no EC, no BN), connecting to Rocketpool clients using http. It validates perfectly, no misses at all!
So the performance impact is only in the RP container (don't know what to do with this info...)
EC Clients is set to 25, BN to 100 (Tried 160 and 50 as well - but not much change at all. Using 100 for performance reasons)
Any ideas?
Is there something to be configured in the rocketpool_node to prevent these spikes?
The text was updated successfully, but these errors were encountered:
version 1.11.9
EC is besu, BN Nimbus
HW: Kingston KC3000 2TB, CPU is i7-8550U (not ideal but meets the minimum benchmar required and does the job), 16 GB DDR4 RAM. Network is perfectly stable 1/1 Gbps fiber.
Discussed a lot on discord, and found out some details.
RP node runs smoothly and validates properly most of the time. But every 5 minutes rockepool_node performs some task that makes the besu EC consume a lot of I/O and CPU time (lasting about a minute). During these spikes attestations fail and I have also missed a proposal during such a load.
For testing purposes (as advised on RP Discord support) I stopped rocketpool_node for 30 mins and confirmed the high load was gone.
The screenshot below illustrates the CPU and I/O reduction with disabled node:
Node log shows no errors/warnings.
BN log has a few "Missed multiple heartbeats" entries during peaks.
FUN FACT:
This is a Proxmox virtualization host, with LXC Containers (very low overhead). There are two containers running:
So the performance impact is only in the RP container (don't know what to do with this info...)
EC Clients is set to 25, BN to 100 (Tried 160 and 50 as well - but not much change at all. Using 100 for performance reasons)
Any ideas?
Is there something to be configured in the rocketpool_node to prevent these spikes?
The text was updated successfully, but these errors were encountered: