Skip to content

Commit

Permalink
updated bench results
Browse files Browse the repository at this point in the history
  • Loading branch information
onionpancakes committed Feb 22, 2024
1 parent c47f98f commit b849fb7
Show file tree
Hide file tree
Showing 15 changed files with 425 additions and 419 deletions.
93 changes: 46 additions & 47 deletions resources/bench/chassis_10.txt
Original file line number Diff line number Diff line change
@@ -1,81 +1,80 @@
Chassis
-------------------------------------
Evaluation count : 881460 in 60 samples of 14691 calls.
Execution time mean : 68.400420 µs
Execution time std-deviation : 231.222292 ns
Execution time lower quantile : 68.144567 µs ( 2.5%)
Execution time upper quantile : 68.657634 µs (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 885240 in 60 samples of 14754 calls.
Execution time mean : 68.056262 µs
Execution time std-deviation : 260.039600 ns
Execution time lower quantile : 67.736004 µs ( 2.5%)
Execution time upper quantile : 68.405753 µs (97.5%)
Overhead used : 11.736096 ns

Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Compiled
-------------------------------------
Evaluation count : 1562100 in 60 samples of 26035 calls.
Execution time mean : 38.878264 µs
Execution time std-deviation : 96.780292 ns
Execution time lower quantile : 38.763112 µs ( 2.5%)
Execution time upper quantile : 39.041801 µs (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 1573560 in 60 samples of 26226 calls.
Execution time mean : 37.996274 µs
Execution time std-deviation : 197.997485 ns
Execution time lower quantile : 37.795748 µs ( 2.5%)
Execution time upper quantile : 38.420016 µs (97.5%)
Overhead used : 11.736096 ns

Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
Found 3 outliers in 60 samples (5.0000 %)
low-severe 2 (3.3333 %)
low-mild 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Compiled Unambig
-------------------------------------
Evaluation count : 1982040 in 60 samples of 33034 calls.
Execution time mean : 30.418004 µs
Execution time std-deviation : 86.004203 ns
Execution time lower quantile : 30.335823 µs ( 2.5%)
Execution time upper quantile : 30.554885 µs (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 2028660 in 60 samples of 33811 calls.
Execution time mean : 29.669457 µs
Execution time std-deviation : 78.410523 ns
Execution time lower quantile : 29.579800 µs ( 2.5%)
Execution time upper quantile : 29.792475 µs (97.5%)
Overhead used : 11.736096 ns

Found 2 outliers in 60 samples (3.3333 %)
Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
low-mild 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias
-------------------------------------
Evaluation count : 702120 in 60 samples of 11702 calls.
Execution time mean : 85.901563 µs
Execution time std-deviation : 237.122792 ns
Execution time lower quantile : 85.610745 µs ( 2.5%)
Execution time upper quantile : 86.255970 µs (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 681900 in 60 samples of 11365 calls.
Execution time mean : 88.403360 µs
Execution time std-deviation : 292.067627 ns
Execution time lower quantile : 88.053555 µs ( 2.5%)
Execution time upper quantile : 88.928607 µs (97.5%)
Overhead used : 11.736096 ns

Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
Found 4 outliers in 60 samples (6.6667 %)
low-severe 3 (5.0000 %)
low-mild 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias Compiled
-------------------------------------
Evaluation count : 1303560 in 60 samples of 21726 calls.
Execution time mean : 46.228373 µs
Execution time std-deviation : 196.039361 ns
Execution time lower quantile : 46.067193 µs ( 2.5%)
Execution time upper quantile : 46.491824 µs (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 1259460 in 60 samples of 20991 calls.
Execution time mean : 47.838020 µs
Execution time std-deviation : 159.492674 ns
Execution time lower quantile : 47.645186 µs ( 2.5%)
Execution time upper quantile : 48.068621 µs (97.5%)
Overhead used : 11.736096 ns

Found 3 outliers in 60 samples (5.0000 %)
low-severe 2 (3.3333 %)
low-mild 1 (1.6667 %)
Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias Compiled Unambig
-------------------------------------
Evaluation count : 1619340 in 60 samples of 26989 calls.
Execution time mean : 37.186486 µs
Execution time std-deviation : 104.027574 ns
Execution time lower quantile : 37.044957 µs ( 2.5%)
Execution time upper quantile : 37.382404 µs (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 1570560 in 60 samples of 26176 calls.
Execution time mean : 38.328536 µs
Execution time std-deviation : 109.698650 ns
Execution time lower quantile : 38.154973 µs ( 2.5%)
Execution time upper quantile : 38.466144 µs (97.5%)
Overhead used : 11.736096 ns

Found 2 outliers in 60 samples (3.3333 %)
Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
low-mild 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

84 changes: 42 additions & 42 deletions resources/bench/chassis_160.txt
Original file line number Diff line number Diff line change
@@ -1,80 +1,80 @@
Chassis
-------------------------------------
Evaluation count : 73140 in 60 samples of 1219 calls.
Execution time mean : 822.136276 µs
Execution time std-deviation : 3.417656 µs
Execution time lower quantile : 818.740165 µs ( 2.5%)
Execution time upper quantile : 826.902487 µs (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 76860 in 60 samples of 1281 calls.
Execution time mean : 776.577675 µs
Execution time std-deviation : 3.256948 µs
Execution time lower quantile : 772.766794 µs ( 2.5%)
Execution time upper quantile : 781.360757 µs (97.5%)
Overhead used : 11.736096 ns

Found 2 outliers in 60 samples (3.3333 %)
Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
low-mild 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Compiled
-------------------------------------
Evaluation count : 123900 in 60 samples of 2065 calls.
Execution time mean : 484.764779 µs
Execution time std-deviation : 1.797341 µs
Execution time lower quantile : 482.583139 µs ( 2.5%)
Execution time upper quantile : 488.201436 µs (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 125700 in 60 samples of 2095 calls.
Execution time mean : 477.658631 µs
Execution time std-deviation : 1.606660 µs
Execution time lower quantile : 475.926369 µs ( 2.5%)
Execution time upper quantile : 480.565975 µs (97.5%)
Overhead used : 11.736096 ns

Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Compiled Unambig
-------------------------------------
Evaluation count : 149400 in 60 samples of 2490 calls.
Execution time mean : 402.948471 µs
Execution time std-deviation : 1.201694 µs
Execution time lower quantile : 401.533315 µs ( 2.5%)
Execution time upper quantile : 404.630629 µs (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 150540 in 60 samples of 2509 calls.
Execution time mean : 397.327142 µs
Execution time std-deviation : 1.533050 µs
Execution time lower quantile : 395.255275 µs ( 2.5%)
Execution time upper quantile : 399.929499 µs (97.5%)
Overhead used : 11.736096 ns

Found 1 outliers in 60 samples (1.6667 %)
Found 2 outliers in 60 samples (3.3333 %)
low-severe 1 (1.6667 %)
low-mild 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias
-------------------------------------
Evaluation count : 50460 in 60 samples of 841 calls.
Execution time mean : 1.190353 ms
Execution time std-deviation : 4.024695 µs
Execution time lower quantile : 1.185282 ms ( 2.5%)
Execution time upper quantile : 1.197097 ms (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 49500 in 60 samples of 825 calls.
Execution time mean : 1.210601 ms
Execution time std-deviation : 3.721270 µs
Execution time lower quantile : 1.205412 ms ( 2.5%)
Execution time upper quantile : 1.217793 ms (97.5%)
Overhead used : 11.736096 ns

Found 1 outliers in 60 samples (1.6667 %)
Found 2 outliers in 60 samples (3.3333 %)
low-severe 1 (1.6667 %)
low-mild 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias Compiled
-------------------------------------
Evaluation count : 95040 in 60 samples of 1584 calls.
Execution time mean : 636.321955 µs
Execution time std-deviation : 2.030654 µs
Execution time lower quantile : 633.403757 µs ( 2.5%)
Execution time upper quantile : 638.960198 µs (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 91320 in 60 samples of 1522 calls.
Execution time mean : 660.037381 µs
Execution time std-deviation : 2.446509 µs
Execution time lower quantile : 655.660447 µs ( 2.5%)
Execution time upper quantile : 665.074720 µs (97.5%)
Overhead used : 11.736096 ns

Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias Compiled Unambig
-------------------------------------
Evaluation count : 118380 in 60 samples of 1973 calls.
Execution time mean : 508.370051 µs
Execution time std-deviation : 1.486844 µs
Execution time lower quantile : 505.835576 µs ( 2.5%)
Execution time upper quantile : 511.084072 µs (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 115440 in 60 samples of 1924 calls.
Execution time mean : 523.221086 µs
Execution time std-deviation : 2.348482 µs
Execution time lower quantile : 520.184163 µs ( 2.5%)
Execution time upper quantile : 527.025584 µs (97.5%)
Overhead used : 11.736096 ns

Found 2 outliers in 60 samples (3.3333 %)
Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
low-mild 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

92 changes: 46 additions & 46 deletions resources/bench/chassis_40.txt
Original file line number Diff line number Diff line change
@@ -1,79 +1,79 @@
Chassis
-------------------------------------
Evaluation count : 247320 in 60 samples of 4122 calls.
Execution time mean : 244.011524 µs
Execution time std-deviation : 1.059559 µs
Execution time lower quantile : 242.767792 µs ( 2.5%)
Execution time upper quantile : 246.258209 µs (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 246660 in 60 samples of 4111 calls.
Execution time mean : 244.144826 µs
Execution time std-deviation : 868.185579 ns
Execution time lower quantile : 242.917445 µs ( 2.5%)
Execution time upper quantile : 245.247961 µs (97.5%)
Overhead used : 11.736096 ns

Found 4 outliers in 60 samples (6.6667 %)
low-severe 3 (5.0000 %)
low-mild 1 (1.6667 %)
Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Compiled
-------------------------------------
Evaluation count : 425460 in 60 samples of 7091 calls.
Execution time mean : 141.890483 µs
Execution time std-deviation : 518.520926 ns
Execution time lower quantile : 141.246950 µs ( 2.5%)
Execution time upper quantile : 143.091432 µs (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 424080 in 60 samples of 7068 calls.
Execution time mean : 142.064800 µs
Execution time std-deviation : 436.422493 ns
Execution time lower quantile : 141.351988 µs ( 2.5%)
Execution time upper quantile : 142.674186 µs (97.5%)
Overhead used : 11.736096 ns

Found 2 outliers in 60 samples (3.3333 %)
low-severe 2 (3.3333 %)
Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Compiled Unambig
-------------------------------------
Evaluation count : 546720 in 60 samples of 9112 calls.
Execution time mean : 109.798251 µs
Execution time std-deviation : 461.623493 ns
Execution time lower quantile : 109.165262 µs ( 2.5%)
Execution time upper quantile : 110.644042 µs (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 549420 in 60 samples of 9157 calls.
Execution time mean : 109.710883 µs
Execution time std-deviation : 325.206891 ns
Execution time lower quantile : 109.072121 µs ( 2.5%)
Execution time upper quantile : 110.329193 µs (97.5%)
Overhead used : 11.736096 ns

Found 2 outliers in 60 samples (3.3333 %)
low-severe 1 (1.6667 %)
Found 5 outliers in 60 samples (8.3333 %)
low-severe 3 (5.0000 %)
low-mild 1 (1.6667 %)
high-mild 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias
-------------------------------------
Evaluation count : 191220 in 60 samples of 3187 calls.
Execution time mean : 314.379700 µs
Execution time std-deviation : 1.154461 µs
Execution time lower quantile : 313.081132 µs ( 2.5%)
Execution time upper quantile : 316.892383 µs (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 185760 in 60 samples of 3096 calls.
Execution time mean : 322.833008 µs
Execution time std-deviation : 937.786234 ns
Execution time lower quantile : 321.664457 µs ( 2.5%)
Execution time upper quantile : 324.181803 µs (97.5%)
Overhead used : 11.736096 ns

Found 2 outliers in 60 samples (3.3333 %)
Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
low-mild 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias Compiled
-------------------------------------
Evaluation count : 361080 in 60 samples of 6018 calls.
Execution time mean : 168.191202 µs
Execution time std-deviation : 511.459641 ns
Execution time lower quantile : 167.447526 µs ( 2.5%)
Execution time upper quantile : 169.113950 µs (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 341760 in 60 samples of 5696 calls.
Execution time mean : 176.149648 µs
Execution time std-deviation : 647.220818 ns
Execution time lower quantile : 175.411987 µs ( 2.5%)
Execution time upper quantile : 177.402579 µs (97.5%)
Overhead used : 11.736096 ns

Found 1 outliers in 60 samples (1.6667 %)
Found 2 outliers in 60 samples (3.3333 %)
low-severe 1 (1.6667 %)
low-mild 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias Compiled Unambig
-------------------------------------
Evaluation count : 444960 in 60 samples of 7416 calls.
Execution time mean : 135.279014 µs
Execution time std-deviation : 405.126219 ns
Execution time lower quantile : 134.763524 µs ( 2.5%)
Execution time upper quantile : 135.893285 µs (97.5%)
Overhead used : 8.799403 ns
Evaluation count : 426780 in 60 samples of 7113 calls.
Execution time mean : 140.494776 µs
Execution time std-deviation : 523.248012 ns
Execution time lower quantile : 139.947837 µs ( 2.5%)
Execution time upper quantile : 141.090895 µs (97.5%)
Overhead used : 11.736096 ns

Found 2 outliers in 60 samples (3.3333 %)
low-severe 1 (1.6667 %)
Expand Down
Loading

0 comments on commit b849fb7

Please sign in to comment.