Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: activate blob interop CI tests #6049

Draft
wants to merge 4 commits into
base: unstable
Choose a base branch
from
Draft

Conversation

g11tech
Copy link
Contributor

@g11tech g11tech commented Oct 18, 2023

ci tests testing single node blob network with blob transactions and syncing peers using beacon block by root, and beacon block by range req/resp

need to update the blob txs because of

@g11tech g11tech requested a review from a team as a code owner October 18, 2023 16:50

- name: Test Lodestar <> ethereumjs withdrawals
run: yarn test:sim:withdrawals
- name: Test Lodestar <> ethereumjs blobs
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

shifting these tests to blobs as withdrawals already tested above with geth

@github-actions
Copy link
Contributor

github-actions bot commented Oct 18, 2023

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: 3f9a512 Previous: c50db8f Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 532.33 us/op 743.51 us/op 0.72
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 84.654 us/op 99.374 us/op 0.85
BLS verify - blst-native 1.3210 ms/op 1.3228 ms/op 1.00
BLS verifyMultipleSignatures 3 - blst-native 2.7790 ms/op 2.8666 ms/op 0.97
BLS verifyMultipleSignatures 8 - blst-native 6.0669 ms/op 6.3445 ms/op 0.96
BLS verifyMultipleSignatures 32 - blst-native 22.026 ms/op 23.040 ms/op 0.96
BLS verifyMultipleSignatures 64 - blst-native 43.514 ms/op 46.305 ms/op 0.94
BLS verifyMultipleSignatures 128 - blst-native 87.056 ms/op 97.284 ms/op 0.89
BLS deserializing 10000 signatures 909.86 ms/op 978.06 ms/op 0.93
BLS deserializing 100000 signatures 8.7840 s/op 10.045 s/op 0.87
BLS verifyMultipleSignatures - same message - 3 - blst-native 1.3140 ms/op 1.4331 ms/op 0.92
BLS verifyMultipleSignatures - same message - 8 - blst-native 1.4848 ms/op 1.5968 ms/op 0.93
BLS verifyMultipleSignatures - same message - 32 - blst-native 2.2790 ms/op 2.5968 ms/op 0.88
BLS verifyMultipleSignatures - same message - 64 - blst-native 3.3586 ms/op 3.6750 ms/op 0.91
BLS verifyMultipleSignatures - same message - 128 - blst-native 5.5274 ms/op 5.8244 ms/op 0.95
BLS aggregatePubkeys 32 - blst-native 25.125 us/op 27.043 us/op 0.93
BLS aggregatePubkeys 128 - blst-native 98.068 us/op 107.15 us/op 0.92
getAttestationsForBlock 40.950 ms/op 51.546 ms/op 0.79
isKnown best case - 1 super set check 323.00 ns/op 563.00 ns/op 0.57
isKnown normal case - 2 super set checks 280.00 ns/op 474.00 ns/op 0.59
isKnown worse case - 16 super set checks 296.00 ns/op 549.00 ns/op 0.54
CheckpointStateCache - add get delete 5.0920 us/op 6.3880 us/op 0.80
validate api signedAggregateAndProof - struct 2.7498 ms/op 3.1252 ms/op 0.88
validate gossip signedAggregateAndProof - struct 2.7338 ms/op 3.0455 ms/op 0.90
validate gossip attestation - vc 640000 1.3272 ms/op 1.5191 ms/op 0.87
batch validate gossip attestation - vc 640000 - chunk 32 155.33 us/op 179.94 us/op 0.86
batch validate gossip attestation - vc 640000 - chunk 64 139.29 us/op 161.85 us/op 0.86
batch validate gossip attestation - vc 640000 - chunk 128 130.97 us/op 142.40 us/op 0.92
batch validate gossip attestation - vc 640000 - chunk 256 127.78 us/op 142.08 us/op 0.90
pickEth1Vote - no votes 1.2596 ms/op 1.3145 ms/op 0.96
pickEth1Vote - max votes 11.229 ms/op 12.961 ms/op 0.87
pickEth1Vote - Eth1Data hashTreeRoot value x2048 19.186 ms/op 25.065 ms/op 0.77
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 27.630 ms/op 31.565 ms/op 0.88
pickEth1Vote - Eth1Data fastSerialize value x2048 594.44 us/op 672.13 us/op 0.88
pickEth1Vote - Eth1Data fastSerialize tree x2048 5.7268 ms/op 8.0820 ms/op 0.71
bytes32 toHexString 568.00 ns/op 510.00 ns/op 1.11
bytes32 Buffer.toString(hex) 316.00 ns/op 308.00 ns/op 1.03
bytes32 Buffer.toString(hex) from Uint8Array 443.00 ns/op 479.00 ns/op 0.92
bytes32 Buffer.toString(hex) + 0x 278.00 ns/op 298.00 ns/op 0.93
Object access 1 prop 0.15200 ns/op 0.15500 ns/op 0.98
Map access 1 prop 0.13900 ns/op 0.14900 ns/op 0.93
Object get x1000 7.0830 ns/op 7.3800 ns/op 0.96
Map get x1000 0.61000 ns/op 0.64300 ns/op 0.95
Object set x1000 48.510 ns/op 53.072 ns/op 0.91
Map set x1000 41.752 ns/op 40.881 ns/op 1.02
Return object 10000 times 0.23940 ns/op 0.25660 ns/op 0.93
Throw Error 10000 times 3.7490 us/op 4.0287 us/op 0.93
fastMsgIdFn sha256 / 200 bytes 3.2280 us/op 3.4530 us/op 0.93
fastMsgIdFn h32 xxhash / 200 bytes 267.00 ns/op 304.00 ns/op 0.88
fastMsgIdFn h64 xxhash / 200 bytes 341.00 ns/op 360.00 ns/op 0.95
fastMsgIdFn sha256 / 1000 bytes 11.252 us/op 11.765 us/op 0.96
fastMsgIdFn h32 xxhash / 1000 bytes 411.00 ns/op 440.00 ns/op 0.93
fastMsgIdFn h64 xxhash / 1000 bytes 412.00 ns/op 437.00 ns/op 0.94
fastMsgIdFn sha256 / 10000 bytes 104.12 us/op 109.05 us/op 0.95
fastMsgIdFn h32 xxhash / 10000 bytes 1.9660 us/op 2.0110 us/op 0.98
fastMsgIdFn h64 xxhash / 10000 bytes 1.3620 us/op 1.3960 us/op 0.98
send data - 1000 256B messages 19.654 ms/op 21.821 ms/op 0.90
send data - 1000 512B messages 26.225 ms/op 27.849 ms/op 0.94
send data - 1000 1024B messages 41.194 ms/op 43.151 ms/op 0.95
send data - 1000 1200B messages 28.488 ms/op 26.901 ms/op 1.06
send data - 1000 2048B messages 32.000 ms/op 34.104 ms/op 0.94
send data - 1000 4096B messages 38.672 ms/op 27.355 ms/op 1.41
send data - 1000 16384B messages 80.525 ms/op 83.014 ms/op 0.97
send data - 1000 65536B messages 281.50 ms/op 331.19 ms/op 0.85
enrSubnets - fastDeserialize 64 bits 1.2470 us/op 1.3380 us/op 0.93
enrSubnets - ssz BitVector 64 bits 407.00 ns/op 458.00 ns/op 0.89
enrSubnets - fastDeserialize 4 bits 160.00 ns/op 178.00 ns/op 0.90
enrSubnets - ssz BitVector 4 bits 403.00 ns/op 419.00 ns/op 0.96
prioritizePeers score -10:0 att 32-0.1 sync 2-0 102.70 us/op 117.02 us/op 0.88
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 133.40 us/op 132.06 us/op 1.01
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 175.78 us/op 177.68 us/op 0.99
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 296.63 us/op 320.45 us/op 0.93
prioritizePeers score 0:0 att 64-1 sync 4-1 338.02 us/op 376.75 us/op 0.90
array of 16000 items push then shift 1.6072 us/op 1.7322 us/op 0.93
LinkedList of 16000 items push then shift 8.8490 ns/op 9.7540 ns/op 0.91
array of 16000 items push then pop 75.418 ns/op 99.412 ns/op 0.76
LinkedList of 16000 items push then pop 8.6690 ns/op 9.3310 ns/op 0.93
array of 24000 items push then shift 2.3629 us/op 2.5993 us/op 0.91
LinkedList of 24000 items push then shift 9.0030 ns/op 9.9740 ns/op 0.90
array of 24000 items push then pop 109.86 ns/op 119.84 ns/op 0.92
LinkedList of 24000 items push then pop 8.7260 ns/op 10.095 ns/op 0.86
intersect bitArray bitLen 8 6.8380 ns/op 7.5030 ns/op 0.91
intersect array and set length 8 54.900 ns/op 58.844 ns/op 0.93
intersect bitArray bitLen 128 32.326 ns/op 34.053 ns/op 0.95
intersect array and set length 128 751.95 ns/op 775.17 ns/op 0.97
bitArray.getTrueBitIndexes() bitLen 128 1.4860 us/op 1.5790 us/op 0.94
bitArray.getTrueBitIndexes() bitLen 248 2.4600 us/op 2.4500 us/op 1.00
bitArray.getTrueBitIndexes() bitLen 512 4.6440 us/op 4.6990 us/op 0.99
Buffer.concat 32 items 941.00 ns/op 964.00 ns/op 0.98
Uint8Array.set 32 items 1.5190 us/op 1.8340 us/op 0.83
Set add up to 64 items then delete first 4.3420 us/op 4.3875 us/op 0.99
OrderedSet add up to 64 items then delete first 5.9677 us/op 5.5693 us/op 1.07
Set add up to 64 items then delete last 4.8918 us/op 4.7947 us/op 1.02
OrderedSet add up to 64 items then delete last 5.9390 us/op 5.9961 us/op 0.99
Set add up to 64 items then delete middle 4.7452 us/op 4.6329 us/op 1.02
OrderedSet add up to 64 items then delete middle 7.3973 us/op 7.9608 us/op 0.93
Set add up to 128 items then delete first 9.5266 us/op 9.7027 us/op 0.98
OrderedSet add up to 128 items then delete first 12.488 us/op 11.919 us/op 1.05
Set add up to 128 items then delete last 9.2702 us/op 9.7310 us/op 0.95
OrderedSet add up to 128 items then delete last 11.773 us/op 13.121 us/op 0.90
Set add up to 128 items then delete middle 9.5801 us/op 9.8248 us/op 0.98
OrderedSet add up to 128 items then delete middle 17.374 us/op 19.424 us/op 0.89
Set add up to 256 items then delete first 19.545 us/op 20.246 us/op 0.97
OrderedSet add up to 256 items then delete first 24.924 us/op 26.352 us/op 0.95
Set add up to 256 items then delete last 18.625 us/op 20.085 us/op 0.93
OrderedSet add up to 256 items then delete last 24.101 us/op 25.225 us/op 0.96
Set add up to 256 items then delete middle 18.956 us/op 19.119 us/op 0.99
OrderedSet add up to 256 items then delete middle 45.123 us/op 49.440 us/op 0.91
transfer serialized Status (84 B) 1.7960 us/op 1.9900 us/op 0.90
copy serialized Status (84 B) 1.5320 us/op 1.7950 us/op 0.85
transfer serialized SignedVoluntaryExit (112 B) 1.8700 us/op 2.3140 us/op 0.81
copy serialized SignedVoluntaryExit (112 B) 1.5980 us/op 1.8900 us/op 0.85
transfer serialized ProposerSlashing (416 B) 2.0280 us/op 3.2200 us/op 0.63
copy serialized ProposerSlashing (416 B) 2.9380 us/op 2.8170 us/op 1.04
transfer serialized Attestation (485 B) 3.2030 us/op 3.1200 us/op 1.03
copy serialized Attestation (485 B) 2.4110 us/op 2.7990 us/op 0.86
transfer serialized AttesterSlashing (33232 B) 2.2550 us/op 3.2030 us/op 0.70
copy serialized AttesterSlashing (33232 B) 6.7980 us/op 7.7170 us/op 0.88
transfer serialized Small SignedBeaconBlock (128000 B) 2.6810 us/op 3.1960 us/op 0.84
copy serialized Small SignedBeaconBlock (128000 B) 15.750 us/op 23.446 us/op 0.67
transfer serialized Avg SignedBeaconBlock (200000 B) 3.3110 us/op 3.3850 us/op 0.98
copy serialized Avg SignedBeaconBlock (200000 B) 24.181 us/op 29.793 us/op 0.81
transfer serialized BlobsSidecar (524380 B) 3.2400 us/op 3.2100 us/op 1.01
copy serialized BlobsSidecar (524380 B) 91.118 us/op 109.86 us/op 0.83
transfer serialized Big SignedBeaconBlock (1000000 B) 3.2400 us/op 3.7270 us/op 0.87
copy serialized Big SignedBeaconBlock (1000000 B) 156.87 us/op 222.61 us/op 0.70
pass gossip attestations to forkchoice per slot 3.8249 ms/op 3.9663 ms/op 0.96
forkChoice updateHead vc 100000 bc 64 eq 0 744.93 us/op 693.93 us/op 1.07
forkChoice updateHead vc 600000 bc 64 eq 0 5.0166 ms/op 6.2981 ms/op 0.80
forkChoice updateHead vc 1000000 bc 64 eq 0 7.4441 ms/op 7.6762 ms/op 0.97
forkChoice updateHead vc 600000 bc 320 eq 0 4.2809 ms/op 4.6130 ms/op 0.93
forkChoice updateHead vc 600000 bc 1200 eq 0 4.3230 ms/op 4.6000 ms/op 0.94
forkChoice updateHead vc 600000 bc 7200 eq 0 5.1883 ms/op 5.9517 ms/op 0.87
forkChoice updateHead vc 600000 bc 64 eq 1000 11.779 ms/op 11.863 ms/op 0.99
forkChoice updateHead vc 600000 bc 64 eq 10000 12.728 ms/op 12.754 ms/op 1.00
forkChoice updateHead vc 600000 bc 64 eq 300000 18.990 ms/op 17.416 ms/op 1.09
computeDeltas 500000 validators 300 proto nodes 6.4026 ms/op 6.7642 ms/op 0.95
computeDeltas 500000 validators 1200 proto nodes 6.5337 ms/op 6.5389 ms/op 1.00
computeDeltas 500000 validators 7200 proto nodes 6.6182 ms/op 6.6061 ms/op 1.00
computeDeltas 750000 validators 300 proto nodes 10.139 ms/op 9.8253 ms/op 1.03
computeDeltas 750000 validators 1200 proto nodes 10.057 ms/op 9.7924 ms/op 1.03
computeDeltas 750000 validators 7200 proto nodes 10.201 ms/op 10.060 ms/op 1.01
computeDeltas 1400000 validators 300 proto nodes 19.789 ms/op 18.505 ms/op 1.07
computeDeltas 1400000 validators 1200 proto nodes 18.654 ms/op 18.923 ms/op 0.99
computeDeltas 1400000 validators 7200 proto nodes 18.124 ms/op 19.400 ms/op 0.93
computeDeltas 2100000 validators 300 proto nodes 28.986 ms/op 28.444 ms/op 1.02
computeDeltas 2100000 validators 1200 proto nodes 31.209 ms/op 29.025 ms/op 1.08
computeDeltas 2100000 validators 7200 proto nodes 30.780 ms/op 27.687 ms/op 1.11
computeProposerBoostScoreFromBalances 500000 validators 3.6856 ms/op 3.4006 ms/op 1.08
computeProposerBoostScoreFromBalances 750000 validators 3.6134 ms/op 3.3609 ms/op 1.08
computeProposerBoostScoreFromBalances 1400000 validators 3.5054 ms/op 3.4391 ms/op 1.02
computeProposerBoostScoreFromBalances 2100000 validators 3.5099 ms/op 3.3981 ms/op 1.03
altair processAttestation - 250000 vs - 7PWei normalcase 3.7592 ms/op 2.2904 ms/op 1.64
altair processAttestation - 250000 vs - 7PWei worstcase 4.8960 ms/op 3.2645 ms/op 1.50
altair processAttestation - setStatus - 1/6 committees join 185.30 us/op 150.75 us/op 1.23
altair processAttestation - setStatus - 1/3 committees join 355.50 us/op 276.10 us/op 1.29
altair processAttestation - setStatus - 1/2 committees join 482.06 us/op 370.47 us/op 1.30
altair processAttestation - setStatus - 2/3 committees join 642.58 us/op 476.37 us/op 1.35
altair processAttestation - setStatus - 4/5 committees join 830.17 us/op 682.81 us/op 1.22
altair processAttestation - setStatus - 100% committees join 969.71 us/op 789.45 us/op 1.23
altair processBlock - 250000 vs - 7PWei normalcase 10.561 ms/op 9.9743 ms/op 1.06
altair processBlock - 250000 vs - 7PWei normalcase hashState 29.809 ms/op 36.196 ms/op 0.82
altair processBlock - 250000 vs - 7PWei worstcase 40.826 ms/op 41.560 ms/op 0.98
altair processBlock - 250000 vs - 7PWei worstcase hashState 83.711 ms/op 95.635 ms/op 0.88
phase0 processBlock - 250000 vs - 7PWei normalcase 2.2401 ms/op 2.4135 ms/op 0.93
phase0 processBlock - 250000 vs - 7PWei worstcase 30.376 ms/op 32.953 ms/op 0.92
altair processEth1Data - 250000 vs - 7PWei normalcase 482.26 us/op 525.86 us/op 0.92
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 15.069 us/op 17.687 us/op 0.85
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 63.931 us/op 64.179 us/op 1.00
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 16.669 us/op 22.732 us/op 0.73
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 12.279 us/op 21.175 us/op 0.58
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 137.17 us/op 197.74 us/op 0.69
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 982.60 us/op 1.2549 ms/op 0.78
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 1.6964 ms/op 1.7963 ms/op 0.94
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 1.3923 ms/op 2.1217 ms/op 0.66
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 3.0525 ms/op 3.6445 ms/op 0.84
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 2.3648 ms/op 2.5367 ms/op 0.93
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 5.2225 ms/op 6.4163 ms/op 0.81
Tree 40 250000 create 335.58 ms/op 371.99 ms/op 0.90
Tree 40 250000 get(125000) 196.07 ns/op 212.24 ns/op 0.92
Tree 40 250000 set(125000) 860.10 ns/op 1.1038 us/op 0.78
Tree 40 250000 toArray() 17.656 ms/op 22.754 ms/op 0.78
Tree 40 250000 iterate all - toArray() + loop 17.703 ms/op 23.172 ms/op 0.76
Tree 40 250000 iterate all - get(i) 64.939 ms/op 77.966 ms/op 0.83
MutableVector 250000 create 11.357 ms/op 14.965 ms/op 0.76
MutableVector 250000 get(125000) 6.4250 ns/op 6.8470 ns/op 0.94
MutableVector 250000 set(125000) 237.87 ns/op 300.51 ns/op 0.79
MutableVector 250000 toArray() 2.9112 ms/op 4.2304 ms/op 0.69
MutableVector 250000 iterate all - toArray() + loop 3.0037 ms/op 4.4365 ms/op 0.68
MutableVector 250000 iterate all - get(i) 1.5242 ms/op 1.6389 ms/op 0.93
Array 250000 create 2.5693 ms/op 3.6572 ms/op 0.70
Array 250000 clone - spread 1.0258 ms/op 1.0277 ms/op 1.00
Array 250000 get(125000) 0.52300 ns/op 0.50200 ns/op 1.04
Array 250000 set(125000) 0.59500 ns/op 0.58800 ns/op 1.01
Array 250000 iterate all - loop 81.127 us/op 118.30 us/op 0.69
effectiveBalanceIncrements clone Uint8Array 300000 22.381 us/op 32.422 us/op 0.69
effectiveBalanceIncrements clone MutableVector 300000 301.00 ns/op 257.00 ns/op 1.17
effectiveBalanceIncrements rw all Uint8Array 300000 176.75 us/op 188.03 us/op 0.94
effectiveBalanceIncrements rw all MutableVector 300000 76.758 ms/op 86.262 ms/op 0.89
phase0 afterProcessEpoch - 250000 vs - 7PWei 116.89 ms/op 119.28 ms/op 0.98
phase0 beforeProcessEpoch - 250000 vs - 7PWei 32.842 ms/op 38.377 ms/op 0.86
altair processEpoch - mainnet_e81889 428.58 ms/op 449.25 ms/op 0.95
mainnet_e81889 - altair beforeProcessEpoch 60.520 ms/op 71.867 ms/op 0.84
mainnet_e81889 - altair processJustificationAndFinalization 15.032 us/op 25.772 us/op 0.58
mainnet_e81889 - altair processInactivityUpdates 5.2867 ms/op 6.2955 ms/op 0.84
mainnet_e81889 - altair processRewardsAndPenalties 63.074 ms/op 54.178 ms/op 1.16
mainnet_e81889 - altair processRegistryUpdates 2.7400 us/op 2.6440 us/op 1.04
mainnet_e81889 - altair processSlashings 502.00 ns/op 654.00 ns/op 0.77
mainnet_e81889 - altair processEth1DataReset 540.00 ns/op 508.00 ns/op 1.06
mainnet_e81889 - altair processEffectiveBalanceUpdates 1.2552 ms/op 1.3067 ms/op 0.96
mainnet_e81889 - altair processSlashingsReset 2.7640 us/op 3.2990 us/op 0.84
mainnet_e81889 - altair processRandaoMixesReset 5.3400 us/op 6.1110 us/op 0.87
mainnet_e81889 - altair processHistoricalRootsUpdate 846.00 ns/op 1.1070 us/op 0.76
mainnet_e81889 - altair processParticipationFlagUpdates 2.0380 us/op 1.9920 us/op 1.02
mainnet_e81889 - altair processSyncCommitteeUpdates 617.00 ns/op 1.3560 us/op 0.46
mainnet_e81889 - altair afterProcessEpoch 125.02 ms/op 134.24 ms/op 0.93
capella processEpoch - mainnet_e217614 1.4182 s/op 1.6808 s/op 0.84
mainnet_e217614 - capella beforeProcessEpoch 248.48 ms/op 294.01 ms/op 0.85
mainnet_e217614 - capella processJustificationAndFinalization 13.488 us/op 24.714 us/op 0.55
mainnet_e217614 - capella processInactivityUpdates 15.951 ms/op 21.020 ms/op 0.76
mainnet_e217614 - capella processRewardsAndPenalties 279.75 ms/op 313.78 ms/op 0.89
mainnet_e217614 - capella processRegistryUpdates 17.572 us/op 20.656 us/op 0.85
mainnet_e217614 - capella processSlashings 561.00 ns/op 563.00 ns/op 1.00
mainnet_e217614 - capella processEth1DataReset 470.00 ns/op 747.00 ns/op 0.63
mainnet_e217614 - capella processEffectiveBalanceUpdates 4.1159 ms/op 4.2322 ms/op 0.97
mainnet_e217614 - capella processSlashingsReset 2.1530 us/op 2.7130 us/op 0.79
mainnet_e217614 - capella processRandaoMixesReset 5.3360 us/op 5.2090 us/op 1.02
mainnet_e217614 - capella processHistoricalRootsUpdate 626.00 ns/op 516.00 ns/op 1.21
mainnet_e217614 - capella processParticipationFlagUpdates 2.4150 us/op 2.5890 us/op 0.93
mainnet_e217614 - capella afterProcessEpoch 304.66 ms/op 312.05 ms/op 0.98
phase0 processEpoch - mainnet_e58758 475.88 ms/op 433.30 ms/op 1.10
mainnet_e58758 - phase0 beforeProcessEpoch 157.45 ms/op 107.28 ms/op 1.47
mainnet_e58758 - phase0 processJustificationAndFinalization 24.728 us/op 14.337 us/op 1.72
mainnet_e58758 - phase0 processRewardsAndPenalties 52.096 ms/op 40.461 ms/op 1.29
mainnet_e58758 - phase0 processRegistryUpdates 14.251 us/op 10.034 us/op 1.42
mainnet_e58758 - phase0 processSlashings 913.00 ns/op 442.00 ns/op 2.07
mainnet_e58758 - phase0 processEth1DataReset 745.00 ns/op 413.00 ns/op 1.80
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 1.6654 ms/op 1.0378 ms/op 1.60
mainnet_e58758 - phase0 processSlashingsReset 5.2210 us/op 2.2980 us/op 2.27
mainnet_e58758 - phase0 processRandaoMixesReset 6.3330 us/op 3.7780 us/op 1.68
mainnet_e58758 - phase0 processHistoricalRootsUpdate 837.00 ns/op 524.00 ns/op 1.60
mainnet_e58758 - phase0 processParticipationRecordUpdates 4.3530 us/op 6.7920 us/op 0.64
mainnet_e58758 - phase0 afterProcessEpoch 110.35 ms/op 102.05 ms/op 1.08
phase0 processEffectiveBalanceUpdates - 250000 normalcase 1.9100 ms/op 1.2181 ms/op 1.57
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 1.9172 ms/op 1.4375 ms/op 1.33
altair processInactivityUpdates - 250000 normalcase 31.914 ms/op 18.570 ms/op 1.72
altair processInactivityUpdates - 250000 worstcase 33.104 ms/op 18.437 ms/op 1.80
phase0 processRegistryUpdates - 250000 normalcase 11.582 us/op 8.9170 us/op 1.30
phase0 processRegistryUpdates - 250000 badcase_full_deposits 410.57 us/op 301.88 us/op 1.36
phase0 processRegistryUpdates - 250000 worstcase 0.5 312.27 ms/op 115.95 ms/op 2.69
altair processRewardsAndPenalties - 250000 normalcase 117.71 ms/op 53.370 ms/op 2.21
altair processRewardsAndPenalties - 250000 worstcase 106.54 ms/op 54.503 ms/op 1.95
phase0 getAttestationDeltas - 250000 normalcase 11.270 ms/op 8.7572 ms/op 1.29
phase0 getAttestationDeltas - 250000 worstcase 11.886 ms/op 8.7866 ms/op 1.35
phase0 processSlashings - 250000 worstcase 2.9688 ms/op 2.3690 ms/op 1.25
altair processSyncCommitteeUpdates - 250000 169.91 ms/op 155.39 ms/op 1.09
BeaconState.hashTreeRoot - No change 325.00 ns/op 262.00 ns/op 1.24
BeaconState.hashTreeRoot - 1 full validator 144.45 us/op 134.68 us/op 1.07
BeaconState.hashTreeRoot - 32 full validator 1.6581 ms/op 1.6530 ms/op 1.00
BeaconState.hashTreeRoot - 512 full validator 18.843 ms/op 16.027 ms/op 1.18
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 223.15 us/op 177.58 us/op 1.26
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 2.6571 ms/op 2.2973 ms/op 1.16
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 35.505 ms/op 25.476 ms/op 1.39
BeaconState.hashTreeRoot - 1 balances 261.26 us/op 140.50 us/op 1.86
BeaconState.hashTreeRoot - 32 balances 2.0752 ms/op 1.2644 ms/op 1.64
BeaconState.hashTreeRoot - 512 balances 27.044 ms/op 11.341 ms/op 2.38
BeaconState.hashTreeRoot - 250000 balances 431.07 ms/op 179.10 ms/op 2.41
aggregationBits - 2048 els - zipIndexesInBitList 38.024 us/op 16.071 us/op 2.37
regular array get 100000 times 37.377 us/op 42.557 us/op 0.88
wrappedArray get 100000 times 55.488 us/op 44.067 us/op 1.26
arrayWithProxy get 100000 times 23.110 ms/op 14.508 ms/op 1.59
ssz.Root.equals 539.00 ns/op 231.00 ns/op 2.33
byteArrayEquals 392.00 ns/op 203.00 ns/op 1.93
shuffle list - 16384 els 8.9745 ms/op 7.2523 ms/op 1.24
shuffle list - 250000 els 132.13 ms/op 106.93 ms/op 1.24
processSlot - 1 slots 28.461 us/op 16.562 us/op 1.72
processSlot - 32 slots 6.0228 ms/op 4.1189 ms/op 1.46
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 68.342 ms/op 48.302 ms/op 1.41
getCommitteeAssignments - req 1 vs - 250000 vc 2.9429 ms/op 2.5543 ms/op 1.15
getCommitteeAssignments - req 100 vs - 250000 vc 4.0772 ms/op 3.7846 ms/op 1.08
getCommitteeAssignments - req 1000 vs - 250000 vc 4.5044 ms/op 4.1509 ms/op 1.09
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 5.7200 ns/op 5.2200 ns/op 1.10
state getBlockRootAtSlot - 250000 vs - 7PWei 705.73 ns/op 646.99 ns/op 1.09
computeProposers - vc 250000 9.6637 ms/op 9.8478 ms/op 0.98
computeEpochShuffling - vc 250000 109.28 ms/op 108.83 ms/op 1.00
getNextSyncCommittee - vc 250000 174.03 ms/op 158.92 ms/op 1.10
computeSigningRoot for AttestationData 31.590 us/op 22.400 us/op 1.41
hash AttestationData serialized data then Buffer.toString(base64) 2.7095 us/op 2.4322 us/op 1.11
toHexString serialized data 2.0845 us/op 1.3465 us/op 1.55
Buffer.toString(base64) 291.15 ns/op 233.37 ns/op 1.25

by benchmarkbot/action

@g11tech g11tech marked this pull request as draft October 20, 2023 11:50
@wemeetagain
Copy link
Member

what's the status of this PR?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants