diff --git a/criterion/day 1/index.html b/criterion/day 1/index.html new file mode 100644 index 0000000..b6b7f8f --- /dev/null +++ b/criterion/day 1/index.html @@ -0,0 +1,113 @@ + + + + + + day 1 Summary - Criterion.rs + + + + +
+

day 1

+

Violin Plot

+ + Violin Plot + +

This chart shows the relationship between function/parameter and iteration time. The thickness of the shaded + region indicates the probability that a measurement of the given function/parameter would take a particular + length of time.

+
+ +

day 1/part 1

+ + + + + + + + +
+ + PDF of Slope + + + + Regression + +
+
+
+ +

day 1/part 2

+ + + + + + + + +
+ + PDF of Slope + + + + Regression + +
+
+
+ + + + \ No newline at end of file diff --git a/criterion/day 1/part 1/MAD.svg b/criterion/day 1/part 1/MAD.svg new file mode 100644 index 0000000..4a14c10 --- /dev/null +++ b/criterion/day 1/part 1/MAD.svg @@ -0,0 +1,108 @@ + + +day 1/part 1:MAD + + +Density (a.u.) + + +Average time (ns) + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + +0.014 + + + +0.016 + + + +0.018 + + + +0.02 + + + + +140 + + + +150 + + + +160 + + + +170 + + + +180 + + + +190 + + + +200 + + + +210 + + + +220 + + + +230 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/day 1/part 1/SD.svg b/criterion/day 1/part 1/SD.svg new file mode 100644 index 0000000..a6138fe --- /dev/null +++ b/criterion/day 1/part 1/SD.svg @@ -0,0 +1,104 @@ + + +day 1/part 1:SD + + +Density (a.u.) + + +Average time (µs) + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + +4 + + + +4.5 + + + +5 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/day 1/part 1/index.html b/criterion/day 1/part 1/index.html new file mode 100644 index 0000000..5b0898b --- /dev/null +++ b/criterion/day 1/part 1/index.html @@ -0,0 +1,200 @@ + + + + + + day 1/part 1 - Criterion.rs + + + + +
+

day 1/part 1 (History)

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Regression + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
Slope54.470 µs54.880 µs55.651 µs
R²0.70073840.70468820.6908748
Mean54.524 µs54.939 µs55.611 µs
Std. Dev.481.96 ns2.8950 µs4.8059 µs
Median54.399 µs54.468 µs54.507 µs
MAD140.64 ns177.85 ns222.92 ns
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probabilty of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the linear regression calculated from the measurements. Each point + represents a sample, though here it shows the total time for the sample rather than time per + iteration. The line is the line of best fit for these measurements.

+

See the + documentation for more details on the additional statistics.

+
+
+
+ + + + \ No newline at end of file diff --git a/criterion/day 1/part 1/mean.svg b/criterion/day 1/part 1/mean.svg new file mode 100644 index 0000000..257ae6f --- /dev/null +++ b/criterion/day 1/part 1/mean.svg @@ -0,0 +1,80 @@ + + +day 1/part 1:mean + + +Density (a.u.) + + +Average time (µs) + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + + +54.6 + + + +54.8 + + + +55 + + + +55.2 + + + +55.4 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/day 1/part 1/median.svg b/criterion/day 1/part 1/median.svg new file mode 100644 index 0000000..6b446dc --- /dev/null +++ b/criterion/day 1/part 1/median.svg @@ -0,0 +1,68 @@ + + +day 1/part 1:median + + +Density (a.u.) + + +Average time (µs) + + + +5 + + + +10 + + + +15 + + + +20 + + + +25 + + + + +54.4 + + + +54.42 + + + +54.44 + + + +54.46 + + + +54.48 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/day 1/part 1/pdf.svg b/criterion/day 1/part 1/pdf.svg new file mode 100644 index 0000000..4f2df7c --- /dev/null +++ b/criterion/day 1/part 1/pdf.svg @@ -0,0 +1,239 @@ + + +day 1/part 1 + + +Iterations (x 10^3) + + +Average Time (µs) + + + +0 + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + + +55 + + + +60 + + + +65 + + + +70 + + + +75 + + + +80 + + + +85 + + + +Density (a.u.) + + + +0 + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/criterion/day 1/part 1/pdf_small.svg b/criterion/day 1/part 1/pdf_small.svg new file mode 100644 index 0000000..ed653cd --- /dev/null +++ b/criterion/day 1/part 1/pdf_small.svg @@ -0,0 +1,52 @@ + + +Density (a.u.) + + +Average Time (µs) + + + +0 + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + + +60 + + + +70 + + + +80 + + + + + diff --git a/criterion/day 1/part 1/regression.svg b/criterion/day 1/part 1/regression.svg new file mode 100644 index 0000000..1f3610d --- /dev/null +++ b/criterion/day 1/part 1/regression.svg @@ -0,0 +1,222 @@ + + +day 1/part 1 + + +Total sample time (ms) + + +Iterations (x 10^3) + + + + + + + + + + + + + + + + + + + + + + +10.0 + + + +20.0 + + + +30.0 + + + +40.0 + + + +50.0 + + + +60.0 + + + +70.0 + + + +80.0 + + + +90.0 + + + +100.0 + + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + +Linear regression + + +Confidence interval + + + + + diff --git a/criterion/day 1/part 1/regression_small.svg b/criterion/day 1/part 1/regression_small.svg new file mode 100644 index 0000000..9adf558 --- /dev/null +++ b/criterion/day 1/part 1/regression_small.svg @@ -0,0 +1,207 @@ + + +Total sample time (ms) + + +Iterations (x 10^3) + + + + + + + + + + + + + + + + + + + + + + +10.0 + + + +20.0 + + + +30.0 + + + +40.0 + + + +50.0 + + + +60.0 + + + +70.0 + + + +80.0 + + + +90.0 + + + +100.0 + + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/criterion/day 1/part 1/slope.svg b/criterion/day 1/part 1/slope.svg new file mode 100644 index 0000000..eb45024 --- /dev/null +++ b/criterion/day 1/part 1/slope.svg @@ -0,0 +1,92 @@ + + +day 1/part 1:slope + + +Density (a.u.) + + +Average time (µs) + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + +2 + + + + +54.4 + + + +54.6 + + + +54.8 + + + +55 + + + +55.2 + + + +55.4 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/day 1/part 1/typical.svg b/criterion/day 1/part 1/typical.svg new file mode 100644 index 0000000..58434cc --- /dev/null +++ b/criterion/day 1/part 1/typical.svg @@ -0,0 +1,92 @@ + + +day 1/part 1:typical + + +Density (a.u.) + + +Average time (µs) + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + +2 + + + + +54.4 + + + +54.6 + + + +54.8 + + + +55 + + + +55.2 + + + +55.4 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/day 1/part 2/MAD.svg b/criterion/day 1/part 2/MAD.svg new file mode 100644 index 0000000..45afa71 --- /dev/null +++ b/criterion/day 1/part 2/MAD.svg @@ -0,0 +1,88 @@ + + +day 1/part 2:MAD + + +Density (a.u.) + + +Average time (ns) + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + +0.014 + + + +0.016 + + + + +200 + + + +220 + + + +240 + + + +260 + + + +280 + + + +300 + + + +320 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/day 1/part 2/SD.svg b/criterion/day 1/part 2/SD.svg new file mode 100644 index 0000000..eb91f51 --- /dev/null +++ b/criterion/day 1/part 2/SD.svg @@ -0,0 +1,104 @@ + + +day 1/part 2:SD + + +Density (a.u.) + + +Average time (µs) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + +4 + + + +4.5 + + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + +1 + + + +1.1 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/day 1/part 2/index.html b/criterion/day 1/part 2/index.html new file mode 100644 index 0000000..9d8a775 --- /dev/null +++ b/criterion/day 1/part 2/index.html @@ -0,0 +1,200 @@ + + + + + + day 1/part 2 - Criterion.rs + + + + +
+

day 1/part 2 (History)

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Regression + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
Slope70.509 µs70.572 µs70.637 µs
R²0.99771240.99782150.9977046
Mean70.448 µs70.552 µs70.700 µs
Std. Dev.243.81 ns657.05 ns1.0519 µs
Median70.383 µs70.446 µs70.556 µs
MAD209.30 ns259.33 ns313.66 ns
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probabilty of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the linear regression calculated from the measurements. Each point + represents a sample, though here it shows the total time for the sample rather than time per + iteration. The line is the line of best fit for these measurements.

+

See the + documentation for more details on the additional statistics.

+
+
+
+ + + + \ No newline at end of file diff --git a/criterion/day 1/part 2/mean.svg b/criterion/day 1/part 2/mean.svg new file mode 100644 index 0000000..db34482 --- /dev/null +++ b/criterion/day 1/part 2/mean.svg @@ -0,0 +1,76 @@ + + +day 1/part 2:mean + + +Density (a.u.) + + +Average time (µs) + + + +1 + + + +2 + + + +3 + + + +4 + + + +5 + + + +6 + + + + +70.45 + + + +70.5 + + + +70.55 + + + +70.6 + + + +70.65 + + + +70.7 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/day 1/part 2/median.svg b/criterion/day 1/part 2/median.svg new file mode 100644 index 0000000..97717b2 --- /dev/null +++ b/criterion/day 1/part 2/median.svg @@ -0,0 +1,104 @@ + + +day 1/part 2:median + + +Density (a.u.) + + +Average time (µs) + + + +2 + + + +4 + + + +6 + + + +8 + + + +10 + + + +12 + + + +14 + + + +16 + + + +18 + + + + +70.38 + + + +70.4 + + + +70.42 + + + +70.44 + + + +70.46 + + + +70.48 + + + +70.5 + + + +70.52 + + + +70.54 + + + +70.56 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/day 1/part 2/pdf.svg b/criterion/day 1/part 2/pdf.svg new file mode 100644 index 0000000..d692cb8 --- /dev/null +++ b/criterion/day 1/part 2/pdf.svg @@ -0,0 +1,255 @@ + + +day 1/part 2 + + +Iterations (x 10^3) + + +Average Time (µs) + + + +0 + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + + +69 + + + +70 + + + +71 + + + +72 + + + +73 + + + +74 + + + +75 + + + +76 + + + +77 + + + +Density (a.u.) + + + +0 + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + +1 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/criterion/day 1/part 2/pdf_small.svg b/criterion/day 1/part 2/pdf_small.svg new file mode 100644 index 0000000..2480424 --- /dev/null +++ b/criterion/day 1/part 2/pdf_small.svg @@ -0,0 +1,52 @@ + + +Density (a.u.) + + +Average Time (µs) + + + +0 + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + + +70 + + + +72 + + + +74 + + + +76 + + + + + diff --git a/criterion/day 1/part 2/regression.svg b/criterion/day 1/part 2/regression.svg new file mode 100644 index 0000000..1262eaf --- /dev/null +++ b/criterion/day 1/part 2/regression.svg @@ -0,0 +1,212 @@ + + +day 1/part 2 + + +Total sample time (ms) + + +Iterations (x 10^3) + + + + + + + + + + + + + + + + + + + + +10.0 + + + +20.0 + + + +30.0 + + + +40.0 + + + +50.0 + + + +60.0 + + + +70.0 + + + +80.0 + + + +90.0 + + + +100.0 + + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + +Linear regression + + +Confidence interval + + + + + diff --git a/criterion/day 1/part 2/regression_small.svg b/criterion/day 1/part 2/regression_small.svg new file mode 100644 index 0000000..b83d8c8 --- /dev/null +++ b/criterion/day 1/part 2/regression_small.svg @@ -0,0 +1,197 @@ + + +Total sample time (ms) + + +Iterations (x 10^3) + + + + + + + + + + + + + + + + + + + + +10.0 + + + +20.0 + + + +30.0 + + + +40.0 + + + +50.0 + + + +60.0 + + + +70.0 + + + +80.0 + + + +90.0 + + + +100.0 + + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/criterion/day 1/part 2/slope.svg b/criterion/day 1/part 2/slope.svg new file mode 100644 index 0000000..33460bc --- /dev/null +++ b/criterion/day 1/part 2/slope.svg @@ -0,0 +1,84 @@ + + +day 1/part 2:slope + + +Density (a.u.) + + +Average time (µs) + + + +2 + + + +4 + + + +6 + + + +8 + + + +10 + + + +12 + + + + +70.5 + + + +70.52 + + + +70.54 + + + +70.56 + + + +70.58 + + + +70.6 + + + +70.62 + + + +70.64 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/day 1/part 2/typical.svg b/criterion/day 1/part 2/typical.svg new file mode 100644 index 0000000..f9c029c --- /dev/null +++ b/criterion/day 1/part 2/typical.svg @@ -0,0 +1,84 @@ + + +day 1/part 2:typical + + +Density (a.u.) + + +Average time (µs) + + + +2 + + + +4 + + + +6 + + + +8 + + + +10 + + + +12 + + + + +70.5 + + + +70.52 + + + +70.54 + + + +70.56 + + + +70.58 + + + +70.6 + + + +70.62 + + + +70.64 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/day 1/violin.svg b/criterion/day 1/violin.svg new file mode 100644 index 0000000..2b14614 --- /dev/null +++ b/criterion/day 1/violin.svg @@ -0,0 +1,61 @@ + + +day 1: Violin plot + + +Input + + +Average time (µs) + + + +day 1/part 2 + + + +day 1/part 1 + + + + +0.0 + + + +10.0 + + + +20.0 + + + +30.0 + + + +40.0 + + + +50.0 + + + +60.0 + + + +70.0 + + + +80.0 + + + + + + + diff --git a/criterion/index.html b/criterion/index.html new file mode 100644 index 0000000..078f6f0 --- /dev/null +++ b/criterion/index.html @@ -0,0 +1,99 @@ + + + + + + Index - Criterion.rs + + + + +
+

Criterion.rs Benchmark Index

+ See individual benchmark pages below for more details. + +
+ + +