Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[EXPERIMENT] [Builtins] 10x more builtins #6502

Draft
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

effectfully
Copy link
Contributor

@effectfully effectfully commented Sep 19, 2024

This replicates the existing builtins so that there are 10x of them now. This is just to check whether it results in any evaluation slowdown.

@effectfully effectfully added Do not merge Builtins EXPERIMENT Experiments that we probably don't want to merge No Changelog Required Add this to skip the Changelog Check labels Sep 19, 2024
@effectfully effectfully self-assigned this Sep 19, 2024
@effectfully
Copy link
Contributor Author

/benchmark validation

@effectfully
Copy link
Contributor Author

/benchmark nofib

@effectfully
Copy link
Contributor Author

/benchmark lists

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
auction_1-1 251.1 μs 307.2 μs +22.3%
auction_1-2 893.9 μs 703.2 μs -21.3%
auction_1-3 886.5 μs 683.4 μs -22.9%
auction_1-4 321.7 μs 302.7 μs -5.9%
auction_2-1 251.4 μs 307.3 μs +22.2%
auction_2-2 893.5 μs 1.014 ms +13.5%
auction_2-3 1.168 ms 1.325 ms +13.4%
auction_2-4 887.1 μs 968.6 μs +9.2%
auction_2-5 322.1 μs 411.7 μs +27.8%
crowdfunding-success-1 293.7 μs 372.6 μs +26.9%
crowdfunding-success-2 292.8 μs 373.7 μs +27.6%
crowdfunding-success-3 294.0 μs 277.2 μs -5.7%
currency-1 344.5 μs 354.6 μs +2.9%
escrow-redeem_1-1 485.4 μs 582.6 μs +20.0%
escrow-redeem_1-2 485.8 μs 416.5 μs -14.3%
escrow-redeem_2-1 568.6 μs 471.7 μs -17.0%
escrow-redeem_2-2 568.3 μs 682.3 μs +20.1%
escrow-redeem_2-3 569.0 μs 677.9 μs +19.1%
escrow-refund-1 217.0 μs 273.4 μs +26.0%
future-increase-margin-1 345.8 μs 407.5 μs +17.8%
future-increase-margin-2 755.6 μs 881.8 μs +16.7%
future-increase-margin-3 755.0 μs 876.8 μs +16.1%
future-increase-margin-4 679.6 μs 785.9 μs +15.6%
future-increase-margin-5 1.141 ms 1.267 ms +11.0%
future-pay-out-1 345.6 μs 406.3 μs +17.6%
future-pay-out-2 754.6 μs 883.1 μs +17.0%
future-pay-out-3 751.7 μs 610.5 μs -18.8%
future-pay-out-4 1.136 ms 884.2 μs -22.2%
future-settle-early-1 345.7 μs 281.7 μs -18.5%
future-settle-early-2 515.7 μs 613.9 μs +19.0%
future-settle-early-3 529.1 μs 619.6 μs +17.1%
future-settle-early-4 599.6 μs 671.9 μs +12.1%
game-sm-success_1-1 486.4 μs 503.2 μs +3.5%
game-sm-success_1-2 278.5 μs 357.5 μs +28.4%
game-sm-success_1-3 897.6 μs 1.032 ms +15.0%
game-sm-success_1-4 315.9 μs 307.0 μs -2.8%
game-sm-success_2-1 410.1 μs 638.7 μs +55.7%
game-sm-success_2-2 194.6 μs 357.2 μs +83.6%
game-sm-success_2-3 638.0 μs 1.024 ms +60.5%
game-sm-success_2-4 275.1 μs 407.6 μs +48.2%
game-sm-success_2-5 631.2 μs 1.024 ms +62.2%
game-sm-success_2-6 291.1 μs 407.2 μs +39.9%
multisig-sm-1 557.6 μs 646.1 μs +15.9%
multisig-sm-2 377.9 μs 630.3 μs +66.8%
multisig-sm-3 509.5 μs 637.5 μs +25.1%
multisig-sm-4 551.7 μs 644.3 μs +16.8%
multisig-sm-5 783.0 μs 894.8 μs +14.3%
multisig-sm-6 555.5 μs 647.2 μs +16.5%
multisig-sm-7 542.4 μs 631.0 μs +16.3%
multisig-sm-8 547.7 μs 636.6 μs +16.2%
multisig-sm-9 553.9 μs 526.8 μs -4.9%
multisig-sm-10 782.6 μs 891.4 μs +13.9%
ping-pong-1 313.6 μs 368.0 μs +17.3%
ping-pong-2 319.8 μs 373.8 μs +16.9%
ping-pong_2-1 194.9 μs 237.9 μs +22.1%
prism-1 164.5 μs 210.8 μs +28.1%
prism-2 402.5 μs 479.3 μs +19.1%
prism-3 357.2 μs 432.6 μs +21.1%
pubkey-1 196.7 μs 181.0 μs -8.0%
stablecoin_1-1 1.002 ms 1.018 ms +1.6%
stablecoin_1-2 236.8 μs 244.9 μs +3.4%
stablecoin_1-3 1.017 ms 1.180 ms +16.0%
stablecoin_1-4 254.5 μs 319.2 μs +25.4%
stablecoin_1-5 1.863 ms 2.164 ms +16.2%
stablecoin_1-6 354.1 μs 457.6 μs +29.2%
stablecoin_2-1 1.266 ms 1.456 ms +15.0%
stablecoin_2-2 271.7 μs 351.3 μs +29.3%
stablecoin_2-3 1.451 ms 1.674 ms +15.4%
stablecoin_2-4 287.0 μs 369.3 μs +28.7%
token-account-1 264.6 μs 250.6 μs -5.3%
token-account-2 470.3 μs 395.4 μs -15.9%
uniswap-1 573.0 μs 464.2 μs -19.0%
uniswap-2 307.3 μs 263.0 μs -14.4%
uniswap-3 2.461 ms 1.966 ms -20.1%
uniswap-4 465.2 μs 417.7 μs -10.2%
uniswap-5 1.619 ms 1.324 ms -18.2%
uniswap-6 447.3 μs 400.4 μs -10.5%
vesting-1 485.7 μs 398.0 μs -18.1%
4b372ec 9fbb994 Change
TOTAL 45.88 ms 49.94 ms +8.9%

Copy link
Contributor

Click here to check the status of your benchmark.

@effectfully
Copy link
Contributor Author

That doesn't make any sense:

image

@effectfully
Copy link
Contributor Author

/benchmark validation

Copy link
Contributor

Comparing benchmark results of 'nofib' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
clausify/formula1 4.003 ms -100.0%
clausify/formula2 5.809 ms -100.0%
clausify/formula3 15.92 ms -100.0%
clausify/formula4 36.51 ms -100.0%
clausify/formula5 76.93 ms -100.0%
knights/4x4 24.86 ms -100.0%
knights/6x6 65.24 ms -100.0%
knights/8x8 73.26 ms -100.0%
primetest/05digits 10.36 ms -100.0%
primetest/10digits 20.20 ms -100.0%
primetest/30digits 82.37 ms -100.0%
primetest/50digits 144.6 ms -100.0%
queens4x4/bt 7.506 ms -100.0%
queens4x4/bm 9.578 ms -100.0%
queens4x4/bjbt1 9.159 ms -100.0%
queens4x4/bjbt2 8.084 ms -100.0%
queens4x4/fc 13.67 ms -100.0%
queens5x5/bt 72.64 ms -100.0%
queens5x5/bm 110.6 ms -100.0%
queens5x5/bjbt1 119.8 ms -100.0%
queens5x5/bjbt2 91.60 ms -100.0%
queens5x5/fc 173.3 ms -100.0%
4b372ec 9fbb994 Change
TOTAL 1.176 s 0.000 ps -100.0%

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'lists' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
sort/ghcSort/50 229.0 μs -100.0%
sort/ghcSort/100 538.3 μs -100.0%
sort/ghcSort/150 932.8 μs -100.0%
sort/ghcSort/200 1.252 ms -100.0%
sort/ghcSort/250 1.628 ms -100.0%
sort/ghcSort/300 2.134 ms -100.0%
sort/insertionSort/50 780.2 μs -100.0%
sort/insertionSort/100 3.096 ms -100.0%
sort/insertionSort/150 7.008 ms -100.0%
sort/insertionSort/200 13.64 ms -100.0%
sort/insertionSort/250 19.61 ms -100.0%
sort/insertionSort/300 28.35 ms -100.0%
sort/mergeSort/50 674.5 μs -100.0%
sort/mergeSort/100 1.556 ms -100.0%
sort/mergeSort/150 2.502 ms -100.0%
sort/mergeSort/200 3.513 ms -100.0%
sort/mergeSort/250 4.602 ms -100.0%
sort/mergeSort/300 5.623 ms -100.0%
sort/quickSort/50 1.905 ms -100.0%
sort/quickSort/100 7.687 ms -100.0%
sort/quickSort/150 24.64 ms -100.0%
sort/quickSort/200 43.42 ms -100.0%
sort/quickSort/250 68.23 ms -100.0%
sort/quickSort/300 98.67 ms -100.0%
sum/compiled-from-Haskell/sum-right-builtin/100 129.3 μs -100.0%
sum/compiled-from-Haskell/sum-right-builtin/500 680.3 μs -100.0%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.479 ms -100.0%
sum/compiled-from-Haskell/sum-right-builtin/2500 4.533 ms -100.0%
sum/compiled-from-Haskell/sum-right-builtin/5000 9.706 ms -100.0%
sum/compiled-from-Haskell/sum-right-Scott/100 87.70 μs -100.0%
sum/compiled-from-Haskell/sum-right-Scott/500 459.2 μs -100.0%
sum/compiled-from-Haskell/sum-right-Scott/1000 921.6 μs -100.0%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.341 ms -100.0%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.351 ms -100.0%
sum/compiled-from-Haskell/sum-right-data/100 243.7 μs -100.0%
sum/compiled-from-Haskell/sum-right-data/500 1.334 ms -100.0%
sum/compiled-from-Haskell/sum-right-data/1000 3.029 ms -100.0%
sum/compiled-from-Haskell/sum-right-data/2500 11.63 ms -100.0%
sum/compiled-from-Haskell/sum-right-data/5000 24.19 ms -100.0%
sum/compiled-from-Haskell/sum-left-builtin/100 126.2 μs -100.0%
sum/compiled-from-Haskell/sum-left-builtin/500 658.5 μs -100.0%
sum/compiled-from-Haskell/sum-left-builtin/1000 985.3 μs -100.0%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.084 ms -100.0%
sum/compiled-from-Haskell/sum-left-builtin/5000 6.773 ms -100.0%
sum/compiled-from-Haskell/sum-left-Scott/100 59.30 μs -100.0%
sum/compiled-from-Haskell/sum-left-Scott/500 311.5 μs -100.0%
sum/compiled-from-Haskell/sum-left-Scott/1000 673.9 μs -100.0%
sum/compiled-from-Haskell/sum-left-Scott/2500 2.188 ms -100.0%
sum/compiled-from-Haskell/sum-left-Scott/5000 4.998 ms -100.0%
sum/compiled-from-Haskell/sum-left-data/100 245.0 μs -100.0%
sum/compiled-from-Haskell/sum-left-data/500 1.341 ms -100.0%
sum/compiled-from-Haskell/sum-left-data/1000 3.021 ms -100.0%
sum/compiled-from-Haskell/sum-left-data/2500 8.256 ms -100.0%
sum/compiled-from-Haskell/sum-left-data/5000 17.09 ms -100.0%
sum/hand-written-PLC/sum-right-builtin/100 89.29 μs -100.0%
sum/hand-written-PLC/sum-right-builtin/500 451.9 μs -100.0%
sum/hand-written-PLC/sum-right-builtin/1000 935.0 μs -100.0%
sum/hand-written-PLC/sum-right-builtin/2500 2.621 ms -100.0%
sum/hand-written-PLC/sum-right-builtin/5000 5.509 ms -100.0%
sum/hand-written-PLC/sum-right-Scott/100 49.67 μs -100.0%
sum/hand-written-PLC/sum-right-Scott/500 253.6 μs -100.0%
sum/hand-written-PLC/sum-right-Scott/1000 530.1 μs -100.0%
sum/hand-written-PLC/sum-right-Scott/2500 1.619 ms -100.0%
sum/hand-written-PLC/sum-right-Scott/5000 3.802 ms -100.0%
sum/hand-written-PLC/sum-left-builtin/100 94.13 μs -100.0%
sum/hand-written-PLC/sum-left-builtin/500 464.0 μs -100.0%
sum/hand-written-PLC/sum-left-builtin/1000 921.2 μs -100.0%
sum/hand-written-PLC/sum-left-builtin/2500 2.290 ms -100.0%
sum/hand-written-PLC/sum-left-builtin/5000 6.756 ms -100.0%
sum/hand-written-PLC/sum-left-Scott/100 80.85 μs -100.0%
sum/hand-written-PLC/sum-left-Scott/500 402.7 μs -100.0%
sum/hand-written-PLC/sum-left-Scott/1000 818.9 μs -100.0%
sum/hand-written-PLC/sum-left-Scott/2500 2.268 ms -100.0%
sum/hand-written-PLC/sum-left-Scott/5000 4.786 ms -100.0%
4b372ec 9fbb994 Change
TOTAL 492.9 ms 0.000 ps -100.0%

@effectfully
Copy link
Contributor Author

/benchmark validation

2 similar comments
@effectfully
Copy link
Contributor Author

/benchmark validation

@effectfully
Copy link
Contributor Author

/benchmark validation

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
auction_1-1 251.3 μs 314.1 μs +25.0%
auction_1-2 895.0 μs 1.006 ms +12.4%
auction_1-3 885.9 μs 999.2 μs +12.8%
auction_1-4 320.4 μs 320.1 μs -0.1%
auction_2-1 251.2 μs 313.9 μs +25.0%
auction_2-2 894.3 μs 1.003 ms +12.2%
auction_2-3 1.169 ms 1.155 ms -1.2%
auction_2-4 886.2 μs 705.6 μs -20.4%
auction_2-5 320.3 μs 282.7 μs -11.7%
crowdfunding-success-1 293.5 μs 263.9 μs -10.1%
crowdfunding-success-2 293.5 μs 261.0 μs -11.1%
crowdfunding-success-3 210.4 μs 338.0 μs +60.6%
currency-1 241.9 μs 282.0 μs +16.6%
escrow-redeem_1-1 341.9 μs 404.8 μs +18.4%
escrow-redeem_1-2 341.4 μs 404.5 μs +18.5%
escrow-redeem_2-1 401.4 μs 470.3 μs +17.2%
escrow-redeem_2-2 402.0 μs 471.7 μs +17.3%
escrow-redeem_2-3 402.1 μs 471.0 μs +17.1%
escrow-refund-1 153.2 μs 188.0 μs +22.7%
future-increase-margin-1 243.4 μs 282.3 μs +16.0%
future-increase-margin-2 531.6 μs 614.1 μs +15.5%
future-increase-margin-3 531.3 μs 833.2 μs +56.8%
future-increase-margin-4 483.8 μs 777.2 μs +60.6%
future-increase-margin-5 802.8 μs 869.5 μs +8.3%
future-pay-out-1 243.4 μs 405.0 μs +66.4%
future-pay-out-2 532.1 μs 865.9 μs +62.7%
future-pay-out-3 533.1 μs 866.0 μs +62.4%
future-pay-out-4 804.5 μs 1.256 ms +56.1%
future-settle-early-1 243.5 μs 401.8 μs +65.0%
future-settle-early-2 532.0 μs 870.1 μs +63.6%
future-settle-early-3 532.6 μs 865.6 μs +62.5%
future-settle-early-4 733.1 μs 949.8 μs +29.6%
game-sm-success_1-1 543.4 μs 634.4 μs +16.7%
game-sm-success_1-2 278.0 μs 350.0 μs +25.9%
game-sm-success_1-3 896.4 μs 1.016 ms +13.3%
game-sm-success_1-4 315.4 μs 399.0 μs +26.5%
game-sm-success_2-1 491.4 μs 633.1 μs +28.8%
game-sm-success_2-2 276.9 μs 350.5 μs +26.6%
game-sm-success_2-3 628.8 μs 766.6 μs +21.9%
game-sm-success_2-4 222.5 μs 278.9 μs +25.3%
game-sm-success_2-5 632.2 μs 1.037 ms +64.0%
game-sm-success_2-6 223.1 μs 399.7 μs +79.2%
multisig-sm-1 393.4 μs 640.0 μs +62.7%
multisig-sm-2 381.7 μs 625.1 μs +63.8%
multisig-sm-3 387.2 μs 631.1 μs +63.0%
multisig-sm-4 425.8 μs 647.9 μs +52.2%
multisig-sm-5 781.5 μs 884.5 μs +13.2%
multisig-sm-6 553.5 μs 639.4 μs +15.5%
multisig-sm-7 543.2 μs 625.1 μs +15.1%
multisig-sm-8 546.9 μs 639.9 μs +17.0%
multisig-sm-9 553.9 μs 638.8 μs +15.3%
multisig-sm-10 782.8 μs 891.1 μs +13.8%
ping-pong-1 455.1 μs 529.8 μs +16.4%
ping-pong-2 454.8 μs 473.9 μs +4.2%
ping-pong_2-1 277.5 μs 335.5 μs +20.9%
prism-1 233.2 μs 296.5 μs +27.1%
prism-2 572.1 μs 675.2 μs +18.0%
prism-3 511.6 μs 415.4 μs -18.8%
pubkey-1 197.8 μs 194.0 μs -1.9%
stablecoin_1-1 1.263 ms 1.363 ms +7.9%
stablecoin_1-2 271.7 μs 344.2 μs +26.7%
stablecoin_1-3 1.450 ms 1.658 ms +14.3%
stablecoin_1-4 286.9 μs 363.9 μs +26.8%
stablecoin_1-5 1.867 ms 2.112 ms +13.1%
stablecoin_1-6 353.7 μs 449.7 μs +27.1%
stablecoin_2-1 1.264 ms 1.435 ms +13.5%
stablecoin_2-2 272.2 μs 344.7 μs +26.6%
stablecoin_2-3 1.448 ms 1.665 ms +15.0%
stablecoin_2-4 286.1 μs 364.8 μs +27.5%
token-account-1 264.7 μs 314.5 μs +18.8%
token-account-2 469.1 μs 383.6 μs -18.2%
uniswap-1 572.7 μs 452.2 μs -21.0%
uniswap-2 308.1 μs 257.9 μs -16.3%
uniswap-3 2.455 ms 1.920 ms -21.8%
uniswap-4 464.8 μs 584.6 μs +25.8%
uniswap-5 1.615 ms 1.682 ms +4.1%
uniswap-6 447.7 μs 389.8 μs -12.9%
vesting-1 483.9 μs 391.2 μs -19.2%
4b372ec 9fbb994 Change
TOTAL 44.11 ms 51.64 ms +17.1%

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
auction_1-1 250.7 μs 217.5 μs -13.2%
auction_1-2 893.4 μs 1.003 ms +12.3%
auction_1-3 886.8 μs 997.5 μs +12.5%
auction_1-4 321.0 μs 404.9 μs +26.1%
auction_2-1 251.3 μs 313.9 μs +24.9%
auction_2-2 895.0 μs 1.000 ms +11.7%
auction_2-3 1.170 ms 1.304 ms +11.5%
auction_2-4 886.8 μs 999.8 μs +12.7%
auction_2-5 320.7 μs 404.9 μs +26.3%
crowdfunding-success-1 293.1 μs 263.2 μs -10.2%
crowdfunding-success-2 293.6 μs 368.4 μs +25.5%
crowdfunding-success-3 293.1 μs 258.0 μs -12.0%
currency-1 344.3 μs 281.4 μs -18.3%
escrow-redeem_1-1 486.4 μs 406.6 μs -16.4%
escrow-redeem_1-2 485.3 μs 584.4 μs +20.4%
escrow-redeem_2-1 567.3 μs 669.4 μs +18.0%
escrow-redeem_2-2 568.7 μs 667.1 μs +17.3%
escrow-redeem_2-3 568.0 μs 668.7 μs +17.7%
escrow-refund-1 215.8 μs 268.1 μs +24.2%
future-increase-margin-1 345.6 μs 279.8 μs -19.0%
future-increase-margin-2 754.4 μs 884.4 μs +17.2%
future-increase-margin-3 754.7 μs 868.6 μs +15.1%
future-increase-margin-4 474.4 μs 777.4 μs +63.9%
future-increase-margin-5 802.6 μs 1.076 ms +34.1%
future-pay-out-1 340.6 μs 298.1 μs -12.5%
future-pay-out-2 751.9 μs 612.4 μs -18.6%
future-pay-out-3 753.5 μs 610.4 μs -19.0%
future-pay-out-4 1.134 ms 882.6 μs -22.2%
future-settle-early-1 346.1 μs 281.8 μs -18.6%
future-settle-early-2 754.1 μs 613.5 μs -18.6%
future-settle-early-3 754.0 μs 610.6 μs -19.0%
future-settle-early-4 848.0 μs 669.3 μs -21.1%
game-sm-success_1-1 523.4 μs 503.9 μs -3.7%
game-sm-success_1-2 277.8 μs 351.0 μs +26.3%
game-sm-success_1-3 894.9 μs 1.015 ms +13.4%
game-sm-success_1-4 316.4 μs 400.0 μs +26.4%
game-sm-success_2-1 456.9 μs 633.6 μs +38.7%
game-sm-success_2-2 194.4 μs 351.4 μs +80.8%
game-sm-success_2-3 627.8 μs 1.017 ms +62.0%
game-sm-success_2-4 221.7 μs 401.4 μs +81.1%
game-sm-success_2-5 628.3 μs 1.013 ms +61.2%
game-sm-success_2-6 222.7 μs 388.3 μs +74.4%
multisig-sm-1 392.0 μs 459.0 μs +17.1%
multisig-sm-2 381.6 μs 600.5 μs +57.4%
multisig-sm-3 387.1 μs 630.8 μs +63.0%
multisig-sm-4 387.9 μs 636.2 μs +64.0%
multisig-sm-5 555.5 μs 893.2 μs +60.8%
multisig-sm-6 555.2 μs 638.4 μs +15.0%
multisig-sm-7 543.3 μs 625.3 μs +15.1%
multisig-sm-8 548.2 μs 628.2 μs +14.6%
multisig-sm-9 554.4 μs 635.8 μs +14.7%
multisig-sm-10 542.6 μs 884.7 μs +63.0%
ping-pong-1 321.2 μs 531.2 μs +65.4%
ping-pong-2 320.9 μs 530.3 μs +65.3%
ping-pong_2-1 278.0 μs 335.4 μs +20.6%
prism-1 234.1 μs 296.0 μs +26.4%
prism-2 572.2 μs 673.8 μs +17.8%
prism-3 512.6 μs 606.8 μs +18.4%
pubkey-1 198.5 μs 252.3 μs +27.1%
stablecoin_1-1 1.267 ms 1.423 ms +12.3%
stablecoin_1-2 271.4 μs 343.8 μs +26.7%
stablecoin_1-3 1.450 ms 1.660 ms +14.5%
stablecoin_1-4 286.8 μs 363.1 μs +26.6%
stablecoin_1-5 1.864 ms 1.787 ms -4.1%
stablecoin_1-6 354.3 μs 313.5 μs -11.5%
stablecoin_2-1 1.265 ms 1.444 ms +14.2%
stablecoin_2-2 271.6 μs 342.6 μs +26.1%
stablecoin_2-3 1.452 ms 1.191 ms -18.0%
stablecoin_2-4 286.4 μs 254.5 μs -11.1%
token-account-1 264.6 μs 219.6 μs -17.0%
token-account-2 471.4 μs 556.2 μs +18.0%
uniswap-1 572.5 μs 647.9 μs +13.2%
uniswap-2 307.5 μs 369.3 μs +20.1%
uniswap-3 2.452 ms 2.740 ms +11.7%
uniswap-4 465.2 μs 560.7 μs +20.5%
uniswap-5 1.613 ms 1.842 ms +14.2%
uniswap-6 447.2 μs 558.8 μs +25.0%
vesting-1 483.6 μs 559.2 μs +15.6%
4b372ec 9fbb994 Change
TOTAL 46.30 ms 52.65 ms +13.7%

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
auction_1-1 176.7 μs 314.4 μs +77.9%
auction_1-2 630.5 μs 1.008 ms +59.9%
auction_1-3 626.7 μs 1.001 ms +59.7%
auction_1-4 226.4 μs 281.0 μs +24.1%
auction_2-1 177.1 μs 220.6 μs +24.6%
auction_2-2 628.5 μs 921.3 μs +46.6%
auction_2-3 1.172 ms 1.134 ms -3.2%
auction_2-4 884.4 μs 706.0 μs -20.2%
auction_2-5 320.6 μs 285.2 μs -11.0%
crowdfunding-success-1 204.9 μs 258.5 μs +26.2%
crowdfunding-success-2 207.0 μs 295.8 μs +42.9%
crowdfunding-success-3 207.0 μs 366.4 μs +77.0%
currency-1 243.5 μs 401.6 μs +64.9%
escrow-redeem_1-1 343.6 μs 576.3 μs +67.7%
escrow-redeem_1-2 342.2 μs 572.7 μs +67.4%
escrow-redeem_2-1 575.5 μs 668.7 μs +16.2%
escrow-redeem_2-2 398.6 μs 483.1 μs +21.2%
escrow-redeem_2-3 492.5 μs 471.0 μs -4.4%
escrow-refund-1 216.5 μs 189.2 μs -12.6%
future-increase-margin-1 243.3 μs 283.6 μs +16.6%
future-increase-margin-2 532.5 μs 614.3 μs +15.4%
future-increase-margin-3 529.9 μs 610.1 μs +15.1%
future-increase-margin-4 481.6 μs 547.2 μs +13.6%
future-increase-margin-5 802.5 μs 1.284 ms +60.0%
future-pay-out-1 243.2 μs 401.8 μs +65.2%
future-pay-out-2 530.5 μs 870.5 μs +64.1%
future-pay-out-3 530.9 μs 866.7 μs +63.3%
future-pay-out-4 802.4 μs 1.253 ms +56.2%
future-settle-early-1 244.0 μs 402.4 μs +64.9%
future-settle-early-2 530.3 μs 869.9 μs +64.0%
future-settle-early-3 531.1 μs 869.6 μs +63.7%
future-settle-early-4 601.9 μs 952.8 μs +58.3%
game-sm-success_1-1 384.1 μs 631.4 μs +64.4%
game-sm-success_1-2 224.7 μs 352.4 μs +56.8%
game-sm-success_1-3 894.8 μs 1.021 ms +14.1%
game-sm-success_1-4 316.0 μs 281.8 μs -10.8%
game-sm-success_2-1 543.8 μs 446.8 μs -17.8%
game-sm-success_2-2 277.0 μs 305.6 μs +10.3%
game-sm-success_2-3 893.9 μs 1.014 ms +13.4%
game-sm-success_2-4 221.0 μs 401.8 μs +81.8%
game-sm-success_2-5 909.9 μs 1.014 ms +11.4%
game-sm-success_2-6 313.2 μs 401.8 μs +28.3%
multisig-sm-1 556.4 μs 475.6 μs -14.5%
multisig-sm-2 542.8 μs 624.3 μs +15.0%
multisig-sm-3 549.1 μs 629.9 μs +14.7%
multisig-sm-4 552.7 μs 639.3 μs +15.7%
multisig-sm-5 784.2 μs 882.9 μs +12.6%
multisig-sm-6 554.8 μs 637.4 μs +14.9%
multisig-sm-7 543.8 μs 622.6 μs +14.5%
multisig-sm-8 547.7 μs 628.4 μs +14.7%
multisig-sm-9 554.6 μs 637.5 μs +14.9%
multisig-sm-10 783.5 μs 798.5 μs +1.9%
ping-pong-1 455.6 μs 374.2 μs -17.9%
ping-pong-2 455.1 μs 374.0 μs -17.8%
ping-pong_2-1 277.1 μs 236.5 μs -14.7%
prism-1 233.4 μs 208.6 μs -10.6%
prism-2 573.5 μs 476.5 μs -16.9%
prism-3 513.1 μs 426.2 μs -16.9%
pubkey-1 198.4 μs 178.1 μs -10.2%
stablecoin_1-1 1.267 ms 1.005 ms -20.7%
stablecoin_1-2 271.7 μs 244.2 μs -10.1%
stablecoin_1-3 1.455 ms 1.160 ms -20.3%
stablecoin_1-4 286.5 μs 257.1 μs -10.3%
stablecoin_1-5 1.867 ms 1.512 ms -19.0%
stablecoin_1-6 354.9 μs 316.5 μs -10.8%
stablecoin_2-1 883.3 μs 1.334 ms +51.0%
stablecoin_2-2 189.1 μs 244.7 μs +29.4%
stablecoin_2-3 1.454 ms 1.156 ms -20.5%
stablecoin_2-4 269.9 μs 257.0 μs -4.8%
token-account-1 264.2 μs 316.0 μs +19.6%
token-account-2 470.6 μs 557.2 μs +18.4%
uniswap-1 572.7 μs 450.7 μs -21.3%
uniswap-2 308.1 μs 260.7 μs -15.4%
uniswap-3 2.452 ms 2.264 ms -7.7%
uniswap-4 465.5 μs 587.0 μs +26.1%
uniswap-5 1.612 ms 1.847 ms +14.6%
uniswap-6 446.8 μs 397.1 μs -11.1%
vesting-1 483.5 μs 394.8 μs -18.3%
4b372ec 9fbb994 Change
TOTAL 43.71 ms 49.26 ms +12.7%

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
auction_1-1 251.3 μs 312.8 μs +24.5%
auction_1-2 894.0 μs 1.000 ms +11.9%
auction_1-3 887.7 μs 998.8 μs +12.5%
auction_1-4 321.1 μs 403.7 μs +25.7%
auction_2-1 251.6 μs 312.3 μs +24.1%
auction_2-2 893.9 μs 999.1 μs +11.8%
auction_2-3 1.165 ms 1.312 ms +12.6%
auction_2-4 888.1 μs 1.002 ms +12.8%
auction_2-5 321.2 μs 405.3 μs +26.2%
crowdfunding-success-1 293.8 μs 264.8 μs -9.9%
crowdfunding-success-2 293.9 μs 342.3 μs +16.5%
crowdfunding-success-3 294.3 μs 257.5 μs -12.5%
currency-1 345.4 μs 283.8 μs -17.8%
escrow-redeem_1-1 487.8 μs 405.7 μs -16.8%
escrow-redeem_1-2 488.4 μs 405.9 μs -16.9%
escrow-redeem_2-1 568.5 μs 471.2 μs -17.1%
escrow-redeem_2-2 569.3 μs 674.9 μs +18.5%
escrow-redeem_2-3 569.4 μs 476.5 μs -16.3%
escrow-refund-1 152.5 μs 251.3 μs +64.8%
future-increase-margin-1 243.4 μs 399.5 μs +64.1%
future-increase-margin-2 727.0 μs 867.5 μs +19.3%
future-increase-margin-3 751.9 μs 864.8 μs +15.0%
future-increase-margin-4 681.4 μs 774.8 μs +13.7%
future-increase-margin-5 1.144 ms 1.269 ms +10.9%
future-pay-out-1 345.4 μs 401.6 μs +16.3%
future-pay-out-2 754.9 μs 869.6 μs +15.2%
future-pay-out-3 754.3 μs 865.8 μs +14.8%
future-pay-out-4 1.135 ms 1.262 ms +11.2%
future-settle-early-1 240.7 μs 400.7 μs +66.5%
future-settle-early-2 760.6 μs 865.8 μs +13.8%
future-settle-early-3 756.0 μs 871.8 μs +15.3%
future-settle-early-4 848.4 μs 946.3 μs +11.5%
game-sm-success_1-1 397.4 μs 631.2 μs +58.8%
game-sm-success_1-2 195.7 μs 349.6 μs +78.6%
game-sm-success_1-3 633.6 μs 1.010 ms +59.4%
game-sm-success_1-4 255.6 μs 397.6 μs +55.6%
game-sm-success_2-1 383.2 μs 630.7 μs +64.6%
game-sm-success_2-2 277.2 μs 348.4 μs +25.7%
game-sm-success_2-3 893.7 μs 921.1 μs +3.1%
game-sm-success_2-4 316.8 μs 399.2 μs +26.0%
game-sm-success_2-5 894.9 μs 693.7 μs -22.5%
game-sm-success_2-6 316.6 μs 279.4 μs -11.7%
multisig-sm-1 392.4 μs 629.4 μs +60.4%
multisig-sm-2 382.6 μs 437.8 μs +14.4%
multisig-sm-3 385.4 μs 442.9 μs +14.9%
multisig-sm-4 390.4 μs 447.8 μs +14.7%
multisig-sm-5 550.9 μs 619.7 μs +12.5%
multisig-sm-6 391.9 μs 450.7 μs +15.0%
multisig-sm-7 381.5 μs 568.7 μs +49.1%
multisig-sm-8 385.5 μs 637.1 μs +65.3%
multisig-sm-9 391.9 μs 640.1 μs +63.3%
multisig-sm-10 550.9 μs 877.1 μs +59.2%
ping-pong-1 320.9 μs 528.6 μs +64.7%
ping-pong-2 321.3 μs 528.0 μs +64.3%
ping-pong_2-1 195.7 μs 335.4 μs +71.4%
prism-1 165.1 μs 304.2 μs +84.3%
prism-2 404.8 μs 668.8 μs +65.2%
prism-3 360.8 μs 604.6 μs +67.6%
pubkey-1 139.5 μs 253.4 μs +81.6%
stablecoin_1-1 939.9 μs 1.418 ms +50.9%
stablecoin_1-2 272.1 μs 342.3 μs +25.8%
stablecoin_1-3 1.015 ms 1.656 ms +63.2%
stablecoin_1-4 202.6 μs 361.5 μs +78.4%
stablecoin_1-5 1.905 ms 2.137 ms +12.2%
stablecoin_1-6 272.4 μs 450.2 μs +65.3%
stablecoin_2-1 894.0 μs 1.416 ms +58.4%
stablecoin_2-2 191.8 μs 343.0 μs +78.8%
stablecoin_2-3 1.028 ms 1.132 ms +10.1%
stablecoin_2-4 202.3 μs 260.8 μs +28.9%
token-account-1 186.5 μs 281.8 μs +51.1%
token-account-2 471.7 μs 554.2 μs +17.5%
uniswap-1 572.7 μs 649.6 μs +13.4%
uniswap-2 307.5 μs 368.9 μs +20.0%
uniswap-3 2.454 ms 2.742 ms +11.7%
uniswap-4 465.8 μs 583.3 μs +25.2%
uniswap-5 1.540 ms 1.842 ms +19.6%
uniswap-6 452.3 μs 386.2 μs -14.6%
vesting-1 485.9 μs 391.6 μs -19.4%
4b372ec 9fbb994 Change
TOTAL 43.62 ms 53.19 ms +22.0%

@effectfully
Copy link
Contributor Author

That doesn't make any sense:

Yup, the benchmarking machine is cooked as it turns out (confirmed elsewhere). Well, gotta wait for it to recover.

@effectfully
Copy link
Contributor Author

/benchmark validation

@effectfully
Copy link
Contributor Author

/benchmark nofib

Copy link
Contributor

Click here to check the status of your benchmark.

@effectfully
Copy link
Contributor Author

/benchmark lists

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Click here to check the status of your benchmark.

…to effectfully/experiment/builtins/10x-more-builtins
@effectfully
Copy link
Contributor Author

/benchmark validation

@effectfully
Copy link
Contributor Author

/benchmark nofib

@effectfully
Copy link
Contributor Author

/benchmark lists

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'validation' on '24e3cfc0f' (base) and '160c7ff74' (PR)

Results table
Script 24e3cfc 160c7ff Change
auction_1-1 263.8 μs 214.2 μs -18.8%
auction_1-2 918.7 μs 691.3 μs -24.8%
auction_1-3 899.1 μs 690.3 μs -23.2%
auction_1-4 344.7 μs 279.6 μs -18.9%
auction_2-1 259.6 μs 266.9 μs +2.8%
auction_2-2 735.8 μs 694.3 μs -5.6%
auction_2-3 1.192 ms 902.0 μs -24.3%
auction_2-4 902.6 μs 980.5 μs +8.6%
auction_2-5 340.7 μs 399.0 μs +17.1%
crowdfunding-success-1 300.8 μs 359.8 μs +19.6%
crowdfunding-success-2 300.7 μs 360.6 μs +19.9%
crowdfunding-success-3 300.4 μs 360.0 μs +19.8%
currency-1 353.7 μs 392.7 μs +11.0%
escrow-redeem_1-1 494.2 μs 561.2 μs +13.6%
escrow-redeem_1-2 493.5 μs 560.2 μs +13.5%
escrow-redeem_2-1 586.7 μs 658.6 μs +12.3%
escrow-redeem_2-2 585.8 μs 656.8 μs +12.1%
escrow-redeem_2-3 586.6 μs 656.8 μs +12.0%
escrow-refund-1 223.4 μs 265.8 μs +19.0%
future-increase-margin-1 354.5 μs 392.4 μs +10.7%
future-increase-margin-2 769.4 μs 852.4 μs +10.8%
future-increase-margin-3 769.2 μs 850.9 μs +10.6%
future-increase-margin-4 699.2 μs 761.8 μs +9.0%
future-increase-margin-5 1.160 ms 1.237 ms +6.6%
future-pay-out-1 354.3 μs 270.5 μs -23.7%
future-pay-out-2 769.8 μs 599.6 μs -22.1%
future-pay-out-3 767.4 μs 700.8 μs -8.7%
future-pay-out-4 1.152 ms 1.233 ms +7.0%
future-settle-early-1 354.7 μs 391.1 μs +10.3%
future-settle-early-2 770.1 μs 851.2 μs +10.5%
future-settle-early-3 738.7 μs 849.6 μs +15.0%
future-settle-early-4 606.5 μs 933.6 μs +53.9%
game-sm-success_1-1 390.6 μs 618.4 μs +58.3%
game-sm-success_1-2 202.9 μs 327.2 μs +61.3%
game-sm-success_1-3 649.4 μs 990.0 μs +52.4%
game-sm-success_1-4 235.3 μs 405.2 μs +72.2%
game-sm-success_2-1 391.4 μs 618.7 μs +58.1%
game-sm-success_2-2 203.0 μs 348.7 μs +71.8%
game-sm-success_2-3 642.6 μs 987.3 μs +53.6%
game-sm-success_2-4 235.7 μs 403.7 μs +71.3%
game-sm-success_2-5 922.5 μs 987.4 μs +7.0%
game-sm-success_2-6 336.2 μs 403.2 μs +19.9%
multisig-sm-1 574.5 μs 624.0 μs +8.6%
multisig-sm-2 547.9 μs 605.5 μs +10.5%
multisig-sm-3 560.2 μs 617.2 μs +10.2%
multisig-sm-4 560.8 μs 620.2 μs +10.6%
multisig-sm-5 791.1 μs 858.0 μs +8.5%
multisig-sm-6 565.0 μs 623.6 μs +10.4%
multisig-sm-7 547.7 μs 606.7 μs +10.8%
multisig-sm-8 562.2 μs 614.7 μs +9.3%
multisig-sm-9 562.6 μs 619.8 μs +10.2%
multisig-sm-10 793.0 μs 857.9 μs +8.2%
ping-pong-1 472.2 μs 525.5 μs +11.3%
ping-pong-2 473.1 μs 523.5 μs +10.7%
ping-pong_2-1 287.7 μs 329.1 μs +14.4%
prism-1 241.5 μs 294.9 μs +22.1%
prism-2 593.0 μs 664.9 μs +12.1%
prism-3 525.6 μs 594.2 μs +13.1%
pubkey-1 204.2 μs 247.9 μs +21.4%
stablecoin_1-1 1.288 ms 952.2 μs -26.1%
stablecoin_1-2 282.4 μs 342.4 μs +21.2%
stablecoin_1-3 1.491 ms 1.522 ms +2.1%
stablecoin_1-4 276.7 μs 257.4 μs -7.0%
stablecoin_1-5 1.922 ms 1.460 ms -24.0%
stablecoin_1-6 367.3 μs 311.6 μs -15.2%
stablecoin_2-1 1.299 ms 981.3 μs -24.5%
stablecoin_2-2 282.2 μs 238.6 μs -15.5%
stablecoin_2-3 1.480 ms 1.138 ms -23.1%
stablecoin_2-4 298.1 μs 253.2 μs -15.1%
token-account-1 273.7 μs 218.7 μs -20.1%
token-account-2 483.8 μs 382.7 μs -20.9%
uniswap-1 591.1 μs 448.7 μs -24.1%
uniswap-2 316.6 μs 256.1 μs -19.1%
uniswap-3 2.505 ms 1.898 ms -24.2%
uniswap-4 481.0 μs 407.1 μs -15.4%
uniswap-5 1.647 ms 1.278 ms -22.4%
uniswap-6 459.9 μs 458.2 μs -0.4%
vesting-1 498.2 μs 551.0 μs +10.6%
24e3cfc 160c7ff Change
TOTAL 48.66 ms 49.15 ms +1.0%

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'nofib' on '24e3cfc0f' (base) and '160c7ff74' (PR)

Results table
Script 24e3cfc 160c7ff Change
clausify/formula1 4.315 ms -100.0%
clausify/formula2 5.764 ms -100.0%
clausify/formula3 11.14 ms -100.0%
clausify/formula4 25.45 ms -100.0%
clausify/formula5 79.70 ms -100.0%
knights/4x4 17.28 ms -100.0%
knights/6x6 45.81 ms -100.0%
knights/8x8 113.4 ms -100.0%
primetest/05digits 14.31 ms -100.0%
primetest/10digits 27.98 ms -100.0%
primetest/30digits 85.57 ms -100.0%
primetest/50digits 142.0 ms -100.0%
queens4x4/bt 7.518 ms -100.0%
queens4x4/bm 9.440 ms -100.0%
queens4x4/bjbt1 9.139 ms -100.0%
queens4x4/bjbt2 8.556 ms -100.0%
queens4x4/fc 19.20 ms -100.0%
queens5x5/bt 102.3 ms -100.0%
queens5x5/bm 106.4 ms -100.0%
queens5x5/bjbt1 119.4 ms -100.0%
queens5x5/bjbt2 81.81 ms -100.0%
queens5x5/fc 172.0 ms -100.0%
24e3cfc 160c7ff Change
TOTAL 1.208 s 0.000 ps -100.0%

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'lists' on '24e3cfc0f' (base) and '160c7ff74' (PR)

Results table
Script 24e3cfc 160c7ff Change
sort/ghcSort/50 332.9 μs -100.0%
sort/ghcSort/100 773.2 μs -100.0%
sort/ghcSort/150 1.339 ms -100.0%
sort/ghcSort/200 1.802 ms -100.0%
sort/ghcSort/250 2.333 ms -100.0%
sort/ghcSort/300 2.130 ms -100.0%
sort/insertionSort/50 965.9 μs -100.0%
sort/insertionSort/100 4.419 ms -100.0%
sort/insertionSort/150 9.960 ms -100.0%
sort/insertionSort/200 17.79 ms -100.0%
sort/insertionSort/250 27.92 ms -100.0%
sort/insertionSort/300 40.32 ms -100.0%
sort/mergeSort/50 966.9 μs -100.0%
sort/mergeSort/100 2.234 ms -100.0%
sort/mergeSort/150 3.586 ms -100.0%
sort/mergeSort/200 5.057 ms -100.0%
sort/mergeSort/250 6.663 ms -100.0%
sort/mergeSort/300 8.046 ms -100.0%
sort/quickSort/50 2.737 ms -100.0%
sort/quickSort/100 11.03 ms -100.0%
sort/quickSort/150 24.79 ms -100.0%
sort/quickSort/200 44.25 ms -100.0%
sort/quickSort/250 68.77 ms -100.0%
sort/quickSort/300 99.69 ms -100.0%
sum/compiled-from-Haskell/sum-right-builtin/100 133.4 μs -100.0%
sum/compiled-from-Haskell/sum-right-builtin/500 700.5 μs -100.0%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.523 ms -100.0%
sum/compiled-from-Haskell/sum-right-builtin/2500 4.646 ms -100.0%
sum/compiled-from-Haskell/sum-right-builtin/5000 9.877 ms -100.0%
sum/compiled-from-Haskell/sum-right-Scott/100 89.61 μs -100.0%
sum/compiled-from-Haskell/sum-right-Scott/500 472.9 μs -100.0%
sum/compiled-from-Haskell/sum-right-Scott/1000 786.0 μs -100.0%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.404 ms -100.0%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.362 ms -100.0%
sum/compiled-from-Haskell/sum-right-data/100 339.6 μs -100.0%
sum/compiled-from-Haskell/sum-right-data/500 1.340 ms -100.0%
sum/compiled-from-Haskell/sum-right-data/1000 3.060 ms -100.0%
sum/compiled-from-Haskell/sum-right-data/2500 11.34 ms -100.0%
sum/compiled-from-Haskell/sum-right-data/5000 17.23 ms -100.0%
sum/compiled-from-Haskell/sum-left-builtin/100 91.45 μs -100.0%
sum/compiled-from-Haskell/sum-left-builtin/500 483.0 μs -100.0%
sum/compiled-from-Haskell/sum-left-builtin/1000 1.030 ms -100.0%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.138 ms -100.0%
sum/compiled-from-Haskell/sum-left-builtin/5000 6.837 ms -100.0%
sum/compiled-from-Haskell/sum-left-Scott/100 60.87 μs -100.0%
sum/compiled-from-Haskell/sum-left-Scott/500 318.2 μs -100.0%
sum/compiled-from-Haskell/sum-left-Scott/1000 687.5 μs -100.0%
sum/compiled-from-Haskell/sum-left-Scott/2500 2.209 ms -100.0%
sum/compiled-from-Haskell/sum-left-Scott/5000 5.090 ms -100.0%
sum/compiled-from-Haskell/sum-left-data/100 247.5 μs -100.0%
sum/compiled-from-Haskell/sum-left-data/500 1.354 ms -100.0%
sum/compiled-from-Haskell/sum-left-data/1000 3.043 ms -100.0%
sum/compiled-from-Haskell/sum-left-data/2500 8.193 ms -100.0%
sum/compiled-from-Haskell/sum-left-data/5000 17.23 ms -100.0%
sum/hand-written-PLC/sum-right-builtin/100 127.9 μs -100.0%
sum/hand-written-PLC/sum-right-builtin/500 658.2 μs -100.0%
sum/hand-written-PLC/sum-right-builtin/1000 1.356 ms -100.0%
sum/hand-written-PLC/sum-right-builtin/2500 3.061 ms -100.0%
sum/hand-written-PLC/sum-right-builtin/5000 8.250 ms -100.0%
sum/hand-written-PLC/sum-right-Scott/100 74.32 μs -100.0%
sum/hand-written-PLC/sum-right-Scott/500 373.2 μs -100.0%
sum/hand-written-PLC/sum-right-Scott/1000 790.1 μs -100.0%
sum/hand-written-PLC/sum-right-Scott/2500 2.396 ms -100.0%
sum/hand-written-PLC/sum-right-Scott/5000 5.695 ms -100.0%
sum/hand-written-PLC/sum-left-builtin/100 132.3 μs -100.0%
sum/hand-written-PLC/sum-left-builtin/500 641.8 μs -100.0%
sum/hand-written-PLC/sum-left-builtin/1000 1.275 ms -100.0%
sum/hand-written-PLC/sum-left-builtin/2500 3.167 ms -100.0%
sum/hand-written-PLC/sum-left-builtin/5000 6.296 ms -100.0%
sum/hand-written-PLC/sum-left-Scott/100 80.17 μs -100.0%
sum/hand-written-PLC/sum-left-Scott/500 399.9 μs -100.0%
sum/hand-written-PLC/sum-left-Scott/1000 804.0 μs -100.0%
sum/hand-written-PLC/sum-left-Scott/2500 2.271 ms -100.0%
sum/hand-written-PLC/sum-left-Scott/5000 4.980 ms -100.0%
24e3cfc 160c7ff Change
TOTAL 540.1 ms 0.000 ps -100.0%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Builtins Do not merge EXPERIMENT Experiments that we probably don't want to merge No Changelog Required Add this to skip the Changelog Check
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant