Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

test: allow to pass extra args everywhere #6249

Merged
merged 1 commit into from
Jan 8, 2024
Merged

test: allow to pass extra args everywhere #6249

merged 1 commit into from
Jan 8, 2024

Conversation

jeluard
Copy link
Contributor

@jeluard jeluard commented Jan 3, 2024 •
edited
Loading

Motivation

Fix an issue than prevents some test:unit script to receive extra arguments passed via the command line.
e.g. yarn test:unit -t someTest will not propagate -t someTest

@jeluard jeluard requested a review from a team as a code owner January 3, 2024 19:37
@codecov Codecov
Copy link

codecov bot commented Jan 3, 2024

Codecov Report

Merging #6249 (deb86e1) into unstable (9262064) will not change coverage.
The diff coverage is n/a.

Additional details and impacted files 
@@            Coverage Diff            @@
##           unstable    #6249   +/-   ##
=========================================
  Coverage     80.31%   80.31%           
=========================================
  Files           202      202           
  Lines         19543    19543           
  Branches       1169     1169           
=========================================
  Hits          15695    15695           
  Misses         3820     3820           
  Partials         28       28

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jan 3, 2024

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: 8df2072 Previous: 9262064 Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 560.38 us/op 882.71 us/op 0.63
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 101.78 us/op 149.53 us/op 0.68
BLS verify - blst-native 1.3300 ms/op 1.3454 ms/op 0.99
BLS verifyMultipleSignatures 3 - blst-native 2.7984 ms/op 2.8231 ms/op 0.99
BLS verifyMultipleSignatures 8 - blst-native 6.1468 ms/op 6.2146 ms/op 0.99
BLS verifyMultipleSignatures 32 - blst-native 22.411 ms/op 22.741 ms/op 0.99
BLS verifyMultipleSignatures 64 - blst-native 43.820 ms/op 44.776 ms/op 0.98
BLS verifyMultipleSignatures 128 - blst-native 86.935 ms/op 88.656 ms/op 0.98
BLS deserializing 10000 signatures 927.10 ms/op 961.65 ms/op 0.96
BLS deserializing 100000 signatures 9.7761 s/op 9.4560 s/op 1.03
BLS verifyMultipleSignatures - same message - 3 - blst-native 2.2720 ms/op 1.3400 ms/op 1.70
BLS verifyMultipleSignatures - same message - 8 - blst-native 2.3131 ms/op 1.5244 ms/op 1.52
BLS verifyMultipleSignatures - same message - 32 - blst-native 3.5417 ms/op 2.3705 ms/op 1.49
BLS verifyMultipleSignatures - same message - 64 - blst-native 5.7975 ms/op 3.5105 ms/op 1.65
BLS verifyMultipleSignatures - same message - 128 - blst-native 5.7750 ms/op 5.7658 ms/op 1.00
BLS aggregatePubkeys 32 - blst-native 32.175 us/op 26.778 us/op 1.20
BLS aggregatePubkeys 128 - blst-native 147.29 us/op 101.49 us/op 1.45
getAttestationsForBlock 106.33 ms/op 54.998 ms/op 1.93
getSlashingsAndExits - default max 224.71 us/op 161.13 us/op 1.39
getSlashingsAndExits - 2k 624.17 us/op 486.03 us/op 1.28
proposeBlockBody type=full, size=empty 9.8549 ms/op 6.3448 ms/op 1.55
isKnown best case - 1 super set check 783.00 ns/op 540.00 ns/op 1.45
isKnown normal case - 2 super set checks 969.00 ns/op 504.00 ns/op 1.92
isKnown worse case - 16 super set checks 913.00 ns/op 451.00 ns/op 2.02
CheckpointStateCache - add get delete 10.018 us/op 6.3430 us/op 1.58
validate api signedAggregateAndProof - struct 4.2830 ms/op 2.8111 ms/op 1.52
validate gossip signedAggregateAndProof - struct 4.1968 ms/op 2.8176 ms/op 1.49
validate gossip attestation - vc 640000 1.7239 ms/op 1.4212 ms/op 1.21
batch validate gossip attestation - vc 640000 - chunk 32 184.92 us/op 197.46 us/op 0.94
batch validate gossip attestation - vc 640000 - chunk 64 202.71 us/op 168.42 us/op 1.20
batch validate gossip attestation - vc 640000 - chunk 128 189.01 us/op 164.02 us/op 1.15
batch validate gossip attestation - vc 640000 - chunk 256 156.57 us/op 149.08 us/op 1.05
pickEth1Vote - no votes 1.4136 ms/op 1.5348 ms/op 0.92
pickEth1Vote - max votes 12.443 ms/op 14.343 ms/op 0.87
pickEth1Vote - Eth1Data hashTreeRoot value x2048 21.542 ms/op 21.368 ms/op 1.01
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 28.107 ms/op 30.253 ms/op 0.93
pickEth1Vote - Eth1Data fastSerialize value x2048 724.14 us/op 681.19 us/op 1.06
pickEth1Vote - Eth1Data fastSerialize tree x2048 5.7849 ms/op 5.1212 ms/op 1.13
bytes32 toHexString 655.00 ns/op 578.00 ns/op 1.13
bytes32 Buffer.toString(hex) 321.00 ns/op 296.00 ns/op 1.08
bytes32 Buffer.toString(hex) from Uint8Array 559.00 ns/op 483.00 ns/op 1.16
bytes32 Buffer.toString(hex) + 0x 321.00 ns/op 313.00 ns/op 1.03
Object access 1 prop 0.16900 ns/op 0.18500 ns/op 0.91
Map access 1 prop 0.15700 ns/op 0.16800 ns/op 0.93
Object get x1000 7.7770 ns/op 8.6350 ns/op 0.90
Map get x1000 0.89000 ns/op 0.88300 ns/op 1.01
Object set x1000 57.950 ns/op 65.629 ns/op 0.88
Map set x1000 45.190 ns/op 48.444 ns/op 0.93
Return object 10000 times 0.25990 ns/op 0.26040 ns/op 1.00
Throw Error 10000 times 5.3432 us/op 4.0554 us/op 1.32
fastMsgIdFn sha256 / 200 bytes 4.4060 us/op 3.4970 us/op 1.26
fastMsgIdFn h32 xxhash / 200 bytes 459.00 ns/op 346.00 ns/op 1.33
fastMsgIdFn h64 xxhash / 200 bytes 466.00 ns/op 470.00 ns/op 0.99
fastMsgIdFn sha256 / 1000 bytes 15.488 us/op 12.209 us/op 1.27
fastMsgIdFn h32 xxhash / 1000 bytes 749.00 ns/op 449.00 ns/op 1.67
fastMsgIdFn h64 xxhash / 1000 bytes 765.00 ns/op 459.00 ns/op 1.67
fastMsgIdFn sha256 / 10000 bytes 123.88 us/op 104.20 us/op 1.19
fastMsgIdFn h32 xxhash / 10000 bytes 2.6550 us/op 2.0180 us/op 1.32
fastMsgIdFn h64 xxhash / 10000 bytes 1.9050 us/op 1.4190 us/op 1.34
send data - 1000 256B messages 38.547 ms/op 21.000 ms/op 1.84
send data - 1000 512B messages 38.346 ms/op 29.037 ms/op 1.32
send data - 1000 1024B messages 58.491 ms/op 44.416 ms/op 1.32
send data - 1000 1200B messages 60.126 ms/op 46.676 ms/op 1.29
send data - 1000 2048B messages 61.956 ms/op 54.125 ms/op 1.14
send data - 1000 4096B messages 58.640 ms/op 51.022 ms/op 1.15
send data - 1000 16384B messages 156.03 ms/op 118.95 ms/op 1.31
send data - 1000 65536B messages 595.10 ms/op 547.98 ms/op 1.09
enrSubnets - fastDeserialize 64 bits 2.0560 us/op 1.6050 us/op 1.28
enrSubnets - ssz BitVector 64 bits 677.00 ns/op 558.00 ns/op 1.21
enrSubnets - fastDeserialize 4 bits 279.00 ns/op 243.00 ns/op 1.15
enrSubnets - ssz BitVector 4 bits 673.00 ns/op 586.00 ns/op 1.15
prioritizePeers score -10:0 att 32-0.1 sync 2-0 156.81 us/op 123.16 us/op 1.27
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 182.35 us/op 159.85 us/op 1.14
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 274.54 us/op 247.06 us/op 1.11
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 448.79 us/op 444.49 us/op 1.01
prioritizePeers score 0:0 att 64-1 sync 4-1 513.27 us/op 417.03 us/op 1.23
array of 16000 items push then shift 2.2014 us/op 1.9046 us/op 1.16
LinkedList of 16000 items push then shift 14.622 ns/op 10.741 ns/op 1.36
array of 16000 items push then pop 187.39 ns/op 129.40 ns/op 1.45
LinkedList of 16000 items push then pop 14.626 ns/op 11.343 ns/op 1.29
array of 24000 items push then shift 3.1108 us/op 2.7617 us/op 1.13
LinkedList of 24000 items push then shift 16.436 ns/op 11.282 ns/op 1.46
array of 24000 items push then pop 240.82 ns/op 180.98 ns/op 1.33
LinkedList of 24000 items push then pop 13.433 ns/op 9.2140 ns/op 1.46
intersect bitArray bitLen 8 8.5310 ns/op 6.8840 ns/op 1.24
intersect array and set length 8 135.66 ns/op 75.118 ns/op 1.81
intersect bitArray bitLen 128 49.076 ns/op 36.847 ns/op 1.33
intersect array and set length 128 1.6306 us/op 1.1540 us/op 1.41
bitArray.getTrueBitIndexes() bitLen 128 2.3590 us/op 1.9740 us/op 1.20
bitArray.getTrueBitIndexes() bitLen 248 4.3700 us/op 3.2610 us/op 1.34
bitArray.getTrueBitIndexes() bitLen 512 8.1700 us/op 6.5730 us/op 1.24
Buffer.concat 32 items 1.3000 us/op 1.1350 us/op 1.15
Uint8Array.set 32 items 3.1530 us/op 2.0590 us/op 1.53
Set add up to 64 items then delete first 6.3891 us/op 5.2636 us/op 1.21
OrderedSet add up to 64 items then delete first 8.5134 us/op 7.2579 us/op 1.17
Set add up to 64 items then delete last 6.1751 us/op 5.5425 us/op 1.11
OrderedSet add up to 64 items then delete last 8.8176 us/op 7.1603 us/op 1.23
Set add up to 64 items then delete middle 6.2926 us/op 5.9254 us/op 1.06
OrderedSet add up to 64 items then delete middle 13.140 us/op 9.2349 us/op 1.42
Set add up to 128 items then delete first 11.721 us/op 11.552 us/op 1.01
OrderedSet add up to 128 items then delete first 16.004 us/op 16.282 us/op 0.98
Set add up to 128 items then delete last 12.354 us/op 11.355 us/op 1.09
OrderedSet add up to 128 items then delete last 17.208 us/op 16.011 us/op 1.07
Set add up to 128 items then delete middle 11.874 us/op 11.594 us/op 1.02
OrderedSet add up to 128 items then delete middle 27.739 us/op 21.409 us/op 1.30
Set add up to 256 items then delete first 25.553 us/op 22.884 us/op 1.12
OrderedSet add up to 256 items then delete first 29.680 us/op 33.132 us/op 0.90
Set add up to 256 items then delete last 21.506 us/op 22.303 us/op 0.96
OrderedSet add up to 256 items then delete last 30.966 us/op 30.356 us/op 1.02
Set add up to 256 items then delete middle 19.760 us/op 21.790 us/op 0.91
OrderedSet add up to 256 items then delete middle 51.404 us/op 52.723 us/op 0.97
transfer serialized Status (84 B) 2.0250 us/op 1.9290 us/op 1.05
copy serialized Status (84 B) 1.8460 us/op 1.7050 us/op 1.08
transfer serialized SignedVoluntaryExit (112 B) 2.2990 us/op 2.0280 us/op 1.13
copy serialized SignedVoluntaryExit (112 B) 2.0090 us/op 1.6550 us/op 1.21
transfer serialized ProposerSlashing (416 B) 3.2100 us/op 2.2130 us/op 1.45
copy serialized ProposerSlashing (416 B) 3.2360 us/op 2.2760 us/op 1.42
transfer serialized Attestation (485 B) 3.3920 us/op 2.3600 us/op 1.44
copy serialized Attestation (485 B) 3.1920 us/op 2.5650 us/op 1.24
transfer serialized AttesterSlashing (33232 B) 2.6520 us/op 2.3200 us/op 1.14
copy serialized AttesterSlashing (33232 B) 7.7100 us/op 9.4840 us/op 0.81
transfer serialized Small SignedBeaconBlock (128000 B) 3.8800 us/op 2.3830 us/op 1.63
copy serialized Small SignedBeaconBlock (128000 B) 17.619 us/op 31.971 us/op 0.55
transfer serialized Avg SignedBeaconBlock (200000 B) 3.4590 us/op 3.1790 us/op 1.09
copy serialized Avg SignedBeaconBlock (200000 B) 27.959 us/op 42.983 us/op 0.65
transfer serialized BlobsSidecar (524380 B) 3.6350 us/op 4.2070 us/op 0.86
copy serialized BlobsSidecar (524380 B) 111.89 us/op 146.24 us/op 0.77
transfer serialized Big SignedBeaconBlock (1000000 B) 4.9260 us/op 4.4800 us/op 1.10
copy serialized Big SignedBeaconBlock (1000000 B) 173.05 us/op 311.52 us/op 0.56
pass gossip attestations to forkchoice per slot 4.6273 ms/op 4.2049 ms/op 1.10
forkChoice updateHead vc 100000 bc 64 eq 0 758.31 us/op 840.39 us/op 0.90
forkChoice updateHead vc 600000 bc 64 eq 0 4.3963 ms/op 5.3986 ms/op 0.81
forkChoice updateHead vc 1000000 bc 64 eq 0 7.6349 ms/op 7.7944 ms/op 0.98
forkChoice updateHead vc 600000 bc 320 eq 0 4.3258 ms/op 4.4591 ms/op 0.97
forkChoice updateHead vc 600000 bc 1200 eq 0 4.4870 ms/op 4.6558 ms/op 0.96
forkChoice updateHead vc 600000 bc 7200 eq 0 5.5732 ms/op 5.5907 ms/op 1.00
forkChoice updateHead vc 600000 bc 64 eq 1000 11.598 ms/op 11.803 ms/op 0.98
forkChoice updateHead vc 600000 bc 64 eq 10000 12.983 ms/op 12.833 ms/op 1.01
forkChoice updateHead vc 600000 bc 64 eq 300000 16.148 ms/op 20.630 ms/op 0.78
computeDeltas 500000 validators 300 proto nodes 6.7895 ms/op 7.0996 ms/op 0.96
computeDeltas 500000 validators 1200 proto nodes 6.6745 ms/op 8.0692 ms/op 0.83
computeDeltas 500000 validators 7200 proto nodes 6.6363 ms/op 7.1806 ms/op 0.92
computeDeltas 750000 validators 300 proto nodes 9.6151 ms/op 12.290 ms/op 0.78
computeDeltas 750000 validators 1200 proto nodes 9.8756 ms/op 10.497 ms/op 0.94
computeDeltas 750000 validators 7200 proto nodes 10.564 ms/op 10.130 ms/op 1.04
computeDeltas 1400000 validators 300 proto nodes 22.473 ms/op 19.360 ms/op 1.16
computeDeltas 1400000 validators 1200 proto nodes 23.293 ms/op 19.653 ms/op 1.19
computeDeltas 1400000 validators 7200 proto nodes 21.244 ms/op 18.852 ms/op 1.13
computeDeltas 2100000 validators 300 proto nodes 33.174 ms/op 28.083 ms/op 1.18
computeDeltas 2100000 validators 1200 proto nodes 33.209 ms/op 28.561 ms/op 1.16
computeDeltas 2100000 validators 7200 proto nodes 34.037 ms/op 28.396 ms/op 1.20
computeProposerBoostScoreFromBalances 500000 validators 4.7365 ms/op 3.7650 ms/op 1.26
computeProposerBoostScoreFromBalances 750000 validators 4.4522 ms/op 3.7182 ms/op 1.20
computeProposerBoostScoreFromBalances 1400000 validators 4.3358 ms/op 3.7535 ms/op 1.16
computeProposerBoostScoreFromBalances 2100000 validators 3.8017 ms/op 3.7797 ms/op 1.01
altair processAttestation - 250000 vs - 7PWei normalcase 2.2296 ms/op 2.1257 ms/op 1.05
altair processAttestation - 250000 vs - 7PWei worstcase 3.2209 ms/op 3.3369 ms/op 0.97
altair processAttestation - setStatus - 1/6 committees join 146.71 us/op 144.82 us/op 1.01
altair processAttestation - setStatus - 1/3 committees join 290.39 us/op 281.59 us/op 1.03
altair processAttestation - setStatus - 1/2 committees join 408.67 us/op 397.16 us/op 1.03
altair processAttestation - setStatus - 2/3 committees join 494.58 us/op 485.87 us/op 1.02
altair processAttestation - setStatus - 4/5 committees join 687.59 us/op 757.45 us/op 0.91
altair processAttestation - setStatus - 100% committees join 809.28 us/op 834.65 us/op 0.97
altair processBlock - 250000 vs - 7PWei normalcase 9.3299 ms/op 10.956 ms/op 0.85
altair processBlock - 250000 vs - 7PWei normalcase hashState 35.388 ms/op 45.221 ms/op 0.78
altair processBlock - 250000 vs - 7PWei worstcase 40.696 ms/op 46.567 ms/op 0.87
altair processBlock - 250000 vs - 7PWei worstcase hashState 95.932 ms/op 105.47 ms/op 0.91
phase0 processBlock - 250000 vs - 7PWei normalcase 3.6779 ms/op 3.2240 ms/op 1.14
phase0 processBlock - 250000 vs - 7PWei worstcase 33.950 ms/op 34.198 ms/op 0.99
altair processEth1Data - 250000 vs - 7PWei normalcase 539.19 us/op 742.25 us/op 0.73
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 13.661 us/op 15.749 us/op 0.87
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 71.409 us/op 51.783 us/op 1.38
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 16.855 us/op 22.794 us/op 0.74
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 9.7210 us/op 16.387 us/op 0.59
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 197.16 us/op 227.22 us/op 0.87
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 1.5593 ms/op 1.3113 ms/op 1.19
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 1.5617 ms/op 1.9155 ms/op 0.82
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 1.6159 ms/op 1.9125 ms/op 0.84
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 3.9441 ms/op 4.0709 ms/op 0.97
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 2.5137 ms/op 2.5882 ms/op 0.97
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 4.8873 ms/op 5.8697 ms/op 0.83
Tree 40 250000 create 375.38 ms/op 379.43 ms/op 0.99
Tree 40 250000 get(125000) 210.09 ns/op 202.34 ns/op 1.04
Tree 40 250000 set(125000) 1.1119 us/op 1.1111 us/op 1.00
Tree 40 250000 toArray() 23.133 ms/op 31.983 ms/op 0.72
Tree 40 250000 iterate all - toArray() + loop 24.266 ms/op 34.035 ms/op 0.71
Tree 40 250000 iterate all - get(i) 75.983 ms/op 89.751 ms/op 0.85
MutableVector 250000 create 12.411 ms/op 16.386 ms/op 0.76
MutableVector 250000 get(125000) 6.7150 ns/op 7.2590 ns/op 0.93
MutableVector 250000 set(125000) 301.42 ns/op 322.25 ns/op 0.94
MutableVector 250000 toArray() 4.1628 ms/op 3.4435 ms/op 1.21
MutableVector 250000 iterate all - toArray() + loop 4.3467 ms/op 3.4827 ms/op 1.25
MutableVector 250000 iterate all - get(i) 1.5816 ms/op 1.5840 ms/op 1.00
Array 250000 create 3.5596 ms/op 3.5082 ms/op 1.01
Array 250000 clone - spread 1.2328 ms/op 1.3954 ms/op 0.88
Array 250000 get(125000) 1.0870 ns/op 1.0830 ns/op 1.00
Array 250000 set(125000) 4.3460 ns/op 4.9800 ns/op 0.87
Array 250000 iterate all - loop 169.52 us/op 187.86 us/op 0.90
effectiveBalanceIncrements clone Uint8Array 300000 39.615 us/op 56.013 us/op 0.71
effectiveBalanceIncrements clone MutableVector 300000 373.00 ns/op 418.00 ns/op 0.89
effectiveBalanceIncrements rw all Uint8Array 300000 217.52 us/op 201.83 us/op 1.08
effectiveBalanceIncrements rw all MutableVector 300000 87.844 ms/op 101.21 ms/op 0.87
phase0 afterProcessEpoch - 250000 vs - 7PWei 117.08 ms/op 116.75 ms/op 1.00
phase0 beforeProcessEpoch - 250000 vs - 7PWei 55.298 ms/op 40.528 ms/op 1.36
altair processEpoch - mainnet_e81889 533.18 ms/op 556.45 ms/op 0.96
mainnet_e81889 - altair beforeProcessEpoch 89.388 ms/op 91.079 ms/op 0.98
mainnet_e81889 - altair processJustificationAndFinalization 17.938 us/op 22.896 us/op 0.78
mainnet_e81889 - altair processInactivityUpdates 6.8369 ms/op 6.6289 ms/op 1.03
mainnet_e81889 - altair processRewardsAndPenalties 61.354 ms/op 61.476 ms/op 1.00
mainnet_e81889 - altair processRegistryUpdates 2.7420 us/op 3.8570 us/op 0.71
mainnet_e81889 - altair processSlashings 455.00 ns/op 641.00 ns/op 0.71
mainnet_e81889 - altair processEth1DataReset 790.00 ns/op 682.00 ns/op 1.16
mainnet_e81889 - altair processEffectiveBalanceUpdates 1.4433 ms/op 1.5945 ms/op 0.91
mainnet_e81889 - altair processSlashingsReset 3.2670 us/op 6.4540 us/op 0.51
mainnet_e81889 - altair processRandaoMixesReset 4.6900 us/op 6.8830 us/op 0.68
mainnet_e81889 - altair processHistoricalRootsUpdate 721.00 ns/op 839.00 ns/op 0.86
mainnet_e81889 - altair processParticipationFlagUpdates 1.8790 us/op 3.0300 us/op 0.62
mainnet_e81889 - altair processSyncCommitteeUpdates 607.00 ns/op 637.00 ns/op 0.95
mainnet_e81889 - altair afterProcessEpoch 121.63 ms/op 122.96 ms/op 0.99
capella processEpoch - mainnet_e217614 2.2759 s/op 2.2126 s/op 1.03
mainnet_e217614 - capella beforeProcessEpoch 504.94 ms/op 495.64 ms/op 1.02
mainnet_e217614 - capella processJustificationAndFinalization 23.011 us/op 21.954 us/op 1.05
mainnet_e217614 - capella processInactivityUpdates 25.807 ms/op 25.644 ms/op 1.01
mainnet_e217614 - capella processRewardsAndPenalties 420.51 ms/op 411.04 ms/op 1.02
mainnet_e217614 - capella processRegistryUpdates 25.669 us/op 19.721 us/op 1.30
mainnet_e217614 - capella processSlashings 503.00 ns/op 590.00 ns/op 0.85
mainnet_e217614 - capella processEth1DataReset 438.00 ns/op 540.00 ns/op 0.81
mainnet_e217614 - capella processEffectiveBalanceUpdates 4.7101 ms/op 5.5959 ms/op 0.84
mainnet_e217614 - capella processSlashingsReset 4.7070 us/op 3.7090 us/op 1.27
mainnet_e217614 - capella processRandaoMixesReset 12.012 us/op 4.3460 us/op 2.76
mainnet_e217614 - capella processHistoricalRootsUpdate 699.00 ns/op 532.00 ns/op 1.31
mainnet_e217614 - capella processParticipationFlagUpdates 1.6410 us/op 1.5360 us/op 1.07
mainnet_e217614 - capella afterProcessEpoch 319.81 ms/op 312.39 ms/op 1.02
phase0 processEpoch - mainnet_e58758 438.96 ms/op 423.82 ms/op 1.04
mainnet_e58758 - phase0 beforeProcessEpoch 138.15 ms/op 133.62 ms/op 1.03
mainnet_e58758 - phase0 processJustificationAndFinalization 16.618 us/op 17.355 us/op 0.96
mainnet_e58758 - phase0 processRewardsAndPenalties 52.117 ms/op 54.094 ms/op 0.96
mainnet_e58758 - phase0 processRegistryUpdates 11.647 us/op 11.156 us/op 1.04
mainnet_e58758 - phase0 processSlashings 400.00 ns/op 592.00 ns/op 0.68
mainnet_e58758 - phase0 processEth1DataReset 433.00 ns/op 411.00 ns/op 1.05
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 1.1901 ms/op 1.1634 ms/op 1.02
mainnet_e58758 - phase0 processSlashingsReset 3.2960 us/op 3.0130 us/op 1.09
mainnet_e58758 - phase0 processRandaoMixesReset 3.9490 us/op 4.1640 us/op 0.95
mainnet_e58758 - phase0 processHistoricalRootsUpdate 701.00 ns/op 416.00 ns/op 1.69
mainnet_e58758 - phase0 processParticipationRecordUpdates 3.8060 us/op 3.6230 us/op 1.05
mainnet_e58758 - phase0 afterProcessEpoch 99.125 ms/op 96.221 ms/op 1.03
phase0 processEffectiveBalanceUpdates - 250000 normalcase 1.5301 ms/op 1.4032 ms/op 1.09
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 1.5365 ms/op 1.5249 ms/op 1.01
altair processInactivityUpdates - 250000 normalcase 30.546 ms/op 26.829 ms/op 1.14
altair processInactivityUpdates - 250000 worstcase 24.112 ms/op 29.982 ms/op 0.80
phase0 processRegistryUpdates - 250000 normalcase 8.5810 us/op 10.567 us/op 0.81
phase0 processRegistryUpdates - 250000 badcase_full_deposits 423.28 us/op 378.95 us/op 1.12
phase0 processRegistryUpdates - 250000 worstcase 0.5 144.81 ms/op 124.51 ms/op 1.16
altair processRewardsAndPenalties - 250000 normalcase 59.345 ms/op 56.703 ms/op 1.05
altair processRewardsAndPenalties - 250000 worstcase 46.970 ms/op 60.772 ms/op 0.77
phase0 getAttestationDeltas - 250000 normalcase 11.360 ms/op 9.2207 ms/op 1.23
phase0 getAttestationDeltas - 250000 worstcase 10.580 ms/op 9.2164 ms/op 1.15
phase0 processSlashings - 250000 worstcase 91.277 us/op 113.57 us/op 0.80
altair processSyncCommitteeUpdates - 250000 161.92 ms/op 162.17 ms/op 1.00
BeaconState.hashTreeRoot - No change 253.00 ns/op 255.00 ns/op 0.99
BeaconState.hashTreeRoot - 1 full validator 178.49 us/op 165.66 us/op 1.08
BeaconState.hashTreeRoot - 32 full validator 1.8738 ms/op 1.6256 ms/op 1.15
BeaconState.hashTreeRoot - 512 full validator 19.162 ms/op 17.786 ms/op 1.08
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 188.23 us/op 179.14 us/op 1.05
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 2.8047 ms/op 2.0429 ms/op 1.37
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 30.909 ms/op 25.428 ms/op 1.22
BeaconState.hashTreeRoot - 1 balances 137.50 us/op 122.26 us/op 1.12
BeaconState.hashTreeRoot - 32 balances 1.2834 ms/op 1.1313 ms/op 1.13
BeaconState.hashTreeRoot - 512 balances 13.996 ms/op 10.243 ms/op 1.37
BeaconState.hashTreeRoot - 250000 balances 228.39 ms/op 188.88 ms/op 1.21
aggregationBits - 2048 els - zipIndexesInBitList 20.670 us/op 17.872 us/op 1.16
byteArrayEquals 32 76.992 ns/op 75.469 ns/op 1.02
Buffer.compare 32 59.546 ns/op 55.987 ns/op 1.06
byteArrayEquals 1024 2.1038 us/op 2.0439 us/op 1.03
Buffer.compare 1024 74.407 ns/op 72.205 ns/op 1.03
byteArrayEquals 16384 33.518 us/op 32.549 us/op 1.03
Buffer.compare 16384 260.39 ns/op 233.59 ns/op 1.11
byteArrayEquals 123687377 248.07 ms/op 248.99 ms/op 1.00
Buffer.compare 123687377 7.4377 ms/op 7.0646 ms/op 1.05
byteArrayEquals 32 - diff last byte 79.727 ns/op 71.904 ns/op 1.11
Buffer.compare 32 - diff last byte 58.896 ns/op 56.804 ns/op 1.04
byteArrayEquals 1024 - diff last byte 2.1052 us/op 2.0405 us/op 1.03
Buffer.compare 1024 - diff last byte 73.954 ns/op 70.852 ns/op 1.04
byteArrayEquals 16384 - diff last byte 33.544 us/op 32.606 us/op 1.03
Buffer.compare 16384 - diff last byte 277.12 ns/op 273.00 ns/op 1.02
byteArrayEquals 123687377 - diff last byte 251.74 ms/op 257.49 ms/op 0.98
Buffer.compare 123687377 - diff last byte 8.1193 ms/op 8.1481 ms/op 1.00
byteArrayEquals 32 - random bytes 5.8710 ns/op 6.5270 ns/op 0.90
Buffer.compare 32 - random bytes 62.046 ns/op 67.899 ns/op 0.91
byteArrayEquals 1024 - random bytes 6.2900 ns/op 5.7570 ns/op 1.09
Buffer.compare 1024 - random bytes 62.019 ns/op 61.377 ns/op 1.01
byteArrayEquals 16384 - random bytes 6.1200 ns/op 6.3520 ns/op 0.96
Buffer.compare 16384 - random bytes 62.358 ns/op 61.439 ns/op 1.01
byteArrayEquals 123687377 - random bytes 9.2100 ns/op 9.1100 ns/op 1.01
Buffer.compare 123687377 - random bytes 71.220 ns/op 65.760 ns/op 1.08
regular array get 100000 times 45.665 us/op 46.174 us/op 0.99
wrappedArray get 100000 times 46.079 us/op 45.747 us/op 1.01
arrayWithProxy get 100000 times 14.517 ms/op 15.150 ms/op 0.96
ssz.Root.equals 54.915 ns/op 55.321 ns/op 0.99
byteArrayEquals 54.170 ns/op 54.790 ns/op 0.99
Buffer.compare 11.938 ns/op 11.567 ns/op 1.03
shuffle list - 16384 els 7.1115 ms/op 7.1310 ms/op 1.00
shuffle list - 250000 els 103.39 ms/op 105.18 ms/op 0.98
processSlot - 1 slots 16.574 us/op 19.253 us/op 0.86
processSlot - 32 slots 2.8324 ms/op 3.0217 ms/op 0.94
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 58.218 ms/op 56.795 ms/op 1.03
getCommitteeAssignments - req 1 vs - 250000 vc 2.5379 ms/op 2.7294 ms/op 0.93
getCommitteeAssignments - req 100 vs - 250000 vc 3.7364 ms/op 4.0091 ms/op 0.93
getCommitteeAssignments - req 1000 vs - 250000 vc 4.0787 ms/op 4.4669 ms/op 0.91
findModifiedValidators - 10000 modified validators 548.64 ms/op 700.01 ms/op 0.78
findModifiedValidators - 1000 modified validators 433.43 ms/op 497.08 ms/op 0.87
findModifiedValidators - 100 modified validators 435.39 ms/op 480.32 ms/op 0.91
findModifiedValidators - 10 modified validators 401.94 ms/op 465.75 ms/op 0.86
findModifiedValidators - 1 modified validators 450.21 ms/op 461.62 ms/op 0.98
findModifiedValidators - no difference 447.00 ms/op 440.49 ms/op 1.01
compare ViewDUs 4.7566 s/op 4.8560 s/op 0.98
compare each validator Uint8Array 1.5571 s/op 2.0666 s/op 0.75
compare ViewDU to Uint8Array 1.3936 s/op 1.4453 s/op 0.96
migrate state 1000000 validators, 24 modified, 0 new 989.25 ms/op 851.64 ms/op 1.16
migrate state 1000000 validators, 1700 modified, 1000 new 1.2770 s/op 1.1629 s/op 1.10
migrate state 1000000 validators, 3400 modified, 2000 new 1.6788 s/op 1.3371 s/op 1.26
migrate state 1500000 validators, 24 modified, 0 new 924.59 ms/op 807.20 ms/op 1.15
migrate state 1500000 validators, 1700 modified, 1000 new 1.2828 s/op 1.1087 s/op 1.16
migrate state 1500000 validators, 3400 modified, 2000 new 1.5176 s/op 1.4444 s/op 1.05
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 5.0400 ns/op 5.0600 ns/op 1.00
state getBlockRootAtSlot - 250000 vs - 7PWei 753.55 ns/op 587.79 ns/op 1.28
computeProposers - vc 250000 9.9494 ms/op 9.7256 ms/op 1.02
computeEpochShuffling - vc 250000 112.44 ms/op 108.34 ms/op 1.04
getNextSyncCommittee - vc 250000 171.33 ms/op 160.46 ms/op 1.07
computeSigningRoot for AttestationData 32.021 us/op 31.363 us/op 1.02
hash AttestationData serialized data then Buffer.toString(base64) 2.4434 us/op 2.4276 us/op 1.01
toHexString serialized data 1.2895 us/op 1.1199 us/op 1.15
Buffer.toString(base64) 266.73 ns/op 248.44 ns/op 1.07

by benchmarkbot/action

@dapplion
Copy link
Contributor

dapplion commented Jan 4, 2024

Fix an issue

What issue?

@jeluard
Copy link
Contributor Author

jeluard commented Jan 4, 2024

Extra args provided to yarn test:unit will be ignored.
e.g. yarn test:unit -t someTest will not propagate -t someTest properly for some more advanced test:unit scripts as yarn simply propagates extra args at the end of the line.

wemeetagain
wemeetagain approved these changes Jan 8, 2024
View reviewed changes
Copy link
Member

@wemeetagain wemeetagain left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@wemeetagain wemeetagain merged commit e6e6a97 into unstable Jan 8, 2024
15 of 16 checks passed
@wemeetagain wemeetagain deleted the jeluard/wrap-test-unit branch January 8, 2024 20:53
@wemeetagain
Copy link
Member

🎉 This PR is included in v1.14.0 🎉

ensi321 pushed a commit to ensi321/lodestar that referenced this pull request Jan 22, 2024
@jeluard @ensi321
test: allow to pass extra args everywhere (ChainSafe#6249)
fcc4831
@nflaig nflaig mentioned this pull request Feb 8, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@wemeetagain wemeetagain wemeetagain approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@jeluard @dapplion @wemeetagain