From 8563a442113b9de382c15bb3d261b75be71c20d2 Mon Sep 17 00:00:00 2001 From: Your Name Date: Fri, 24 Jul 2026 23:43:42 +0300 Subject: [PATCH] Add SVG report for typical stroke mask pooling at warm 10th stroke --- ...84909963922-criterion-move-and-optimize.md | 189 ++++++++++ criterion.md | 2 +- .../base/benchmark.json | 1 + .../base/estimates.json | 1 + .../first_stroke_cache_build/base/sample.json | 1 + .../first_stroke_cache_build/base/tukey.json | 1 + .../gold_standard/benchmark.json | 1 + .../gold_standard/estimates.json | 1 + .../gold_standard/sample.json | 1 + .../gold_standard/tukey.json | 1 + .../new/benchmark.json | 1 + .../new/estimates.json | 1 + .../first_stroke_cache_build/new/sample.json | 1 + .../first_stroke_cache_build/new/tukey.json | 1 + .../first_stroke_cache_build/report/MAD.svg | 84 +++++ .../first_stroke_cache_build/report/SD.svg | 108 ++++++ .../report/index.html | 193 +++++++++++ .../report/iteration_times.svg | 194 +++++++++++ .../report/iteration_times_small.svg | 187 ++++++++++ .../first_stroke_cache_build/report/mean.svg | 88 +++++ .../report/median.svg | 100 ++++++ .../first_stroke_cache_build/report/pdf.svg | 161 +++++++++ .../report/pdf_small.svg | 64 ++++ .../report/typical.svg | 88 +++++ criterion/below_cache_reuse/report/index.html | 116 +++++++ criterion/below_cache_reuse/report/violin.svg | 65 ++++ .../base/benchmark.json | 1 + .../base/estimates.json | 1 + .../base/sample.json | 1 + .../second_stroke_cache_reuse/base/tukey.json | 1 + .../gold_standard/benchmark.json | 1 + .../gold_standard/estimates.json | 1 + .../gold_standard/sample.json | 1 + .../gold_standard/tukey.json | 1 + .../new/benchmark.json | 1 + .../new/estimates.json | 1 + .../second_stroke_cache_reuse/new/sample.json | 1 + .../second_stroke_cache_reuse/new/tukey.json | 1 + .../second_stroke_cache_reuse/report/MAD.svg | 72 ++++ .../second_stroke_cache_reuse/report/SD.svg | 108 ++++++ .../report/index.html | 193 +++++++++++ .../report/iteration_times.svg | 184 ++++++++++ .../report/iteration_times_small.svg | 177 ++++++++++ .../second_stroke_cache_reuse/report/mean.svg | 108 ++++++ .../report/median.svg | 84 +++++ .../second_stroke_cache_reuse/report/pdf.svg | 159 +++++++++ .../report/pdf_small.svg | 48 +++ .../report/typical.svg | 108 ++++++ .../cold_composite/base/benchmark.json | 1 + .../cold_composite/base/estimates.json | 1 + .../cold_composite/base/sample.json | 1 + .../cold_composite/base/tukey.json | 1 + .../gold_standard/benchmark.json | 1 + .../gold_standard/estimates.json | 1 + .../cold_composite/gold_standard/sample.json | 1 + .../cold_composite/gold_standard/tukey.json | 1 + .../cold_composite/new/benchmark.json | 1 + .../cold_composite/new/estimates.json | 1 + .../cold_composite/new/sample.json | 1 + .../cold_composite/new/tukey.json | 1 + .../cold_composite/report/MAD.svg | 88 +++++ .../cold_composite/report/SD.svg | 84 +++++ .../cold_composite/report/index.html | 193 +++++++++++ .../cold_composite/report/iteration_times.svg | 199 +++++++++++ .../report/iteration_times_small.svg | 192 ++++++++++ .../cold_composite/report/mean.svg | 84 +++++ .../cold_composite/report/median.svg | 88 +++++ .../cold_composite/report/pdf.svg | 163 +++++++++ .../cold_composite/report/pdf_small.svg | 68 ++++ .../cold_composite/report/typical.svg | 84 +++++ .../report/index.html | 116 +++++++ .../report/violin.svg | 45 +++ .../warm_composite/base/benchmark.json | 1 + .../warm_composite/base/estimates.json | 1 + .../warm_composite/base/sample.json | 1 + .../warm_composite/base/tukey.json | 1 + .../gold_standard/benchmark.json | 1 + .../gold_standard/estimates.json | 1 + .../warm_composite/gold_standard/sample.json | 1 + .../warm_composite/gold_standard/tukey.json | 1 + .../warm_composite/new/benchmark.json | 1 + .../warm_composite/new/estimates.json | 1 + .../warm_composite/new/sample.json | 1 + .../warm_composite/new/tukey.json | 1 + .../warm_composite/report/MAD.svg | 84 +++++ .../warm_composite/report/SD.svg | 80 +++++ .../warm_composite/report/index.html | 193 +++++++++++ .../warm_composite/report/iteration_times.svg | 204 +++++++++++ .../report/iteration_times_small.svg | 197 +++++++++++ .../warm_composite/report/mean.svg | 100 ++++++ .../warm_composite/report/median.svg | 96 +++++ .../warm_composite/report/pdf.svg | 165 +++++++++ .../warm_composite/report/pdf_small.svg | 64 ++++ .../warm_composite/report/typical.svg | 100 ++++++ .../no_effects_composite/base/benchmark.json | 1 + .../no_effects_composite/base/estimates.json | 1 + .../no_effects_composite/base/sample.json | 1 + .../no_effects_composite/base/tukey.json | 1 + .../gold_standard/benchmark.json | 1 + .../gold_standard/estimates.json | 1 + .../gold_standard/sample.json | 1 + .../gold_standard/tukey.json | 1 + .../no_effects_composite/new/benchmark.json | 1 + .../no_effects_composite/new/estimates.json | 1 + .../no_effects_composite/new/sample.json | 1 + .../no_effects_composite/new/tukey.json | 1 + .../no_effects_composite/report/MAD.svg | 84 +++++ .../no_effects_composite/report/SD.svg | 84 +++++ .../no_effects_composite/report/index.html | 193 +++++++++++ .../report/iteration_times.svg | 204 +++++++++++ .../report/iteration_times_small.svg | 197 +++++++++++ .../no_effects_composite/report/mean.svg | 108 ++++++ .../no_effects_composite/report/median.svg | 104 ++++++ .../no_effects_composite/report/pdf.svg | 173 +++++++++ .../no_effects_composite/report/pdf_small.svg | 72 ++++ .../no_effects_composite/report/typical.svg | 108 ++++++ criterion/effects_skip/report/index.html | 116 +++++++ criterion/effects_skip/report/violin.svg | 69 ++++ .../with_one_dropshadow/base/benchmark.json | 1 + .../with_one_dropshadow/base/estimates.json | 1 + .../with_one_dropshadow/base/sample.json | 1 + .../with_one_dropshadow/base/tukey.json | 1 + .../gold_standard/benchmark.json | 1 + .../gold_standard/estimates.json | 1 + .../gold_standard/sample.json | 1 + .../gold_standard/tukey.json | 1 + .../with_one_dropshadow/new/benchmark.json | 1 + .../with_one_dropshadow/new/estimates.json | 1 + .../with_one_dropshadow/new/sample.json | 1 + .../with_one_dropshadow/new/tukey.json | 1 + .../with_one_dropshadow/report/MAD.svg | 80 +++++ .../with_one_dropshadow/report/SD.svg | 80 +++++ .../with_one_dropshadow/report/index.html | 193 +++++++++++ .../report/iteration_times.svg | 219 ++++++++++++ .../report/iteration_times_small.svg | 212 +++++++++++ .../with_one_dropshadow/report/mean.svg | 96 +++++ .../with_one_dropshadow/report/median.svg | 76 ++++ .../with_one_dropshadow/report/pdf.svg | 155 +++++++++ .../with_one_dropshadow/report/pdf_small.svg | 60 ++++ .../with_one_dropshadow/report/typical.svg | 96 +++++ criterion/report/index.html | 99 ++++++ .../cold_first_stroke/base/benchmark.json | 1 + .../cold_first_stroke/base/estimates.json | 1 + .../cold_first_stroke/base/sample.json | 1 + .../cold_first_stroke/base/tukey.json | 1 + .../gold_standard/benchmark.json | 1 + .../gold_standard/estimates.json | 1 + .../gold_standard/sample.json | 1 + .../gold_standard/tukey.json | 1 + .../cold_first_stroke/new/benchmark.json | 1 + .../cold_first_stroke/new/estimates.json | 1 + .../cold_first_stroke/new/sample.json | 1 + .../cold_first_stroke/new/tukey.json | 1 + .../cold_first_stroke/report/MAD.svg | 88 +++++ .../cold_first_stroke/report/SD.svg | 108 ++++++ .../cold_first_stroke/report/index.html | 193 +++++++++++ .../report/iteration_times.svg | 189 ++++++++++ .../report/iteration_times_small.svg | 182 ++++++++++ .../cold_first_stroke/report/mean.svg | 84 +++++ .../cold_first_stroke/report/median.svg | 112 ++++++ .../cold_first_stroke/report/pdf.svg | 167 +++++++++ .../cold_first_stroke/report/pdf_small.svg | 64 ++++ .../cold_first_stroke/report/typical.svg | 84 +++++ .../stroke_mask_pooling/report/index.html | 116 +++++++ .../stroke_mask_pooling/report/violin.svg | 53 +++ .../warm_10th_stroke/base/benchmark.json | 1 + .../warm_10th_stroke/base/estimates.json | 1 + .../warm_10th_stroke/base/sample.json | 1 + .../warm_10th_stroke/base/tukey.json | 1 + .../gold_standard/benchmark.json | 1 + .../gold_standard/estimates.json | 1 + .../gold_standard/sample.json | 1 + .../warm_10th_stroke/gold_standard/tukey.json | 1 + .../warm_10th_stroke/new/benchmark.json | 1 + .../warm_10th_stroke/new/estimates.json | 1 + .../warm_10th_stroke/new/sample.json | 1 + .../warm_10th_stroke/new/tukey.json | 1 + .../warm_10th_stroke/report/MAD.svg | 100 ++++++ .../warm_10th_stroke/report/SD.svg | 88 +++++ .../warm_10th_stroke/report/index.html | 193 +++++++++++ .../report/iteration_times.svg | 204 +++++++++++ .../report/iteration_times_small.svg | 197 +++++++++++ .../warm_10th_stroke/report/mean.svg | 76 ++++ .../warm_10th_stroke/report/median.svg | 112 ++++++ .../warm_10th_stroke/report/pdf.svg | 139 ++++++++ .../warm_10th_stroke/report/pdf_small.svg | 64 ++++ .../warm_10th_stroke/report/typical.svg | 76 ++++ hcie-engine-api/benches/below_cache_reuse.rs | 6 +- .../benches/composite_scratch_pooling.rs | 6 +- hcie-engine-api/benches/effects_skip.rs | 6 +- .../benches/stroke_mask_pooling.rs | 6 +- .../change/estimates.json | 1 + .../gold_standard/benchmark.json | 1 + .../gold_standard/estimates.json | 1 + .../gold_standard/sample.json | 1 + .../gold_standard/tukey.json | 1 + .../new/benchmark.json | 1 + .../new/estimates.json | 1 + .../first_stroke_cache_build/new/sample.json | 1 + .../first_stroke_cache_build/new/tukey.json | 1 + .../first_stroke_cache_build/report/MAD.svg | 80 +++++ .../first_stroke_cache_build/report/SD.svg | 76 ++++ .../report/both/iteration_times.svg | 328 ++++++++++++++++++ .../report/both/pdf.svg | 81 +++++ .../report/change/mean.svg | 113 ++++++ .../report/change/median.svg | 85 +++++ .../report/change/t-test.svg | 99 ++++++ .../report/index.html | 269 ++++++++++++++ .../report/iteration_times.svg | 204 +++++++++++ .../report/iteration_times_small.svg | 197 +++++++++++ .../first_stroke_cache_build/report/mean.svg | 80 +++++ .../report/median.svg | 100 ++++++ .../first_stroke_cache_build/report/pdf.svg | 157 +++++++++ .../report/pdf_small.svg | 60 ++++ .../report/relative_iteration_times_small.svg | 317 +++++++++++++++++ .../report/relative_pdf_small.svg | 62 ++++ .../report/typical.svg | 80 +++++ .../below_cache_reuse/report/index.html | 116 +++++++ .../below_cache_reuse/report/violin.svg | 69 ++++ .../change/estimates.json | 1 + .../gold_standard/benchmark.json | 1 + .../gold_standard/estimates.json | 1 + .../gold_standard/sample.json | 1 + .../gold_standard/tukey.json | 1 + .../new/benchmark.json | 1 + .../new/estimates.json | 1 + .../second_stroke_cache_reuse/new/sample.json | 1 + .../second_stroke_cache_reuse/new/tukey.json | 1 + .../second_stroke_cache_reuse/report/MAD.svg | 84 +++++ .../second_stroke_cache_reuse/report/SD.svg | 80 +++++ .../report/both/iteration_times.svg | 318 +++++++++++++++++ .../report/both/pdf.svg | 77 ++++ .../report/change/mean.svg | 109 ++++++ .../report/change/median.svg | 113 ++++++ .../report/change/t-test.svg | 95 +++++ .../report/index.html | 269 ++++++++++++++ .../report/iteration_times.svg | 194 +++++++++++ .../report/iteration_times_small.svg | 187 ++++++++++ .../second_stroke_cache_reuse/report/mean.svg | 88 +++++ .../report/median.svg | 76 ++++ .../second_stroke_cache_reuse/report/pdf.svg | 159 +++++++++ .../report/pdf_small.svg | 68 ++++ .../report/relative_iteration_times_small.svg | 307 ++++++++++++++++ .../report/relative_pdf_small.svg | 58 ++++ .../report/typical.svg | 88 +++++ .../cold_composite/change/estimates.json | 1 + .../gold_standard/benchmark.json | 1 + .../gold_standard/estimates.json | 1 + .../cold_composite/gold_standard/sample.json | 1 + .../cold_composite/gold_standard/tukey.json | 1 + .../cold_composite/new/benchmark.json | 1 + .../cold_composite/new/estimates.json | 1 + .../cold_composite/new/sample.json | 1 + .../cold_composite/new/tukey.json | 1 + .../cold_composite/report/MAD.svg | 108 ++++++ .../cold_composite/report/SD.svg | 80 +++++ .../report/both/iteration_times.svg | 318 +++++++++++++++++ .../cold_composite/report/both/pdf.svg | 69 ++++ .../cold_composite/report/change/mean.svg | 109 ++++++ .../cold_composite/report/change/median.svg | 93 +++++ .../cold_composite/report/change/t-test.svg | 95 +++++ .../cold_composite/report/index.html | 269 ++++++++++++++ .../cold_composite/report/iteration_times.svg | 194 +++++++++++ .../report/iteration_times_small.svg | 187 ++++++++++ .../cold_composite/report/mean.svg | 108 ++++++ .../cold_composite/report/median.svg | 88 +++++ .../cold_composite/report/pdf.svg | 171 +++++++++ .../cold_composite/report/pdf_small.svg | 72 ++++ .../report/relative_iteration_times_small.svg | 307 ++++++++++++++++ .../report/relative_pdf_small.svg | 50 +++ .../cold_composite/report/typical.svg | 108 ++++++ .../report/index.html | 116 +++++++ .../report/violin.svg | 49 +++ .../warm_composite/change/estimates.json | 1 + .../gold_standard/benchmark.json | 1 + .../gold_standard/estimates.json | 1 + .../warm_composite/gold_standard/sample.json | 1 + .../warm_composite/gold_standard/tukey.json | 1 + .../warm_composite/new/benchmark.json | 1 + .../warm_composite/new/estimates.json | 1 + .../warm_composite/new/sample.json | 1 + .../warm_composite/new/tukey.json | 1 + .../warm_composite/report/MAD.svg | 88 +++++ .../warm_composite/report/SD.svg | 80 +++++ .../report/both/iteration_times.svg | 323 +++++++++++++++++ .../warm_composite/report/both/pdf.svg | 61 ++++ .../warm_composite/report/change/mean.svg | 89 +++++ .../warm_composite/report/change/median.svg | 93 +++++ .../warm_composite/report/change/t-test.svg | 99 ++++++ .../warm_composite/report/index.html | 269 ++++++++++++++ .../warm_composite/report/iteration_times.svg | 209 +++++++++++ .../report/iteration_times_small.svg | 202 +++++++++++ .../warm_composite/report/mean.svg | 108 ++++++ .../warm_composite/report/median.svg | 76 ++++ .../warm_composite/report/pdf.svg | 139 ++++++++ .../warm_composite/report/pdf_small.svg | 64 ++++ .../report/relative_iteration_times_small.svg | 312 +++++++++++++++++ .../report/relative_pdf_small.svg | 42 +++ .../warm_composite/report/typical.svg | 108 ++++++ .../change/estimates.json | 1 + .../gold_standard/benchmark.json | 1 + .../gold_standard/estimates.json | 1 + .../gold_standard/sample.json | 1 + .../gold_standard/tukey.json | 1 + .../no_effects_composite/new/benchmark.json | 1 + .../no_effects_composite/new/estimates.json | 1 + .../no_effects_composite/new/sample.json | 1 + .../no_effects_composite/new/tukey.json | 1 + .../no_effects_composite/report/MAD.svg | 84 +++++ .../no_effects_composite/report/SD.svg | 104 ++++++ .../report/both/iteration_times.svg | 233 +++++++++++++ .../no_effects_composite/report/both/pdf.svg | 81 +++++ .../report/change/mean.svg | 105 ++++++ .../report/change/median.svg | 101 ++++++ .../report/change/t-test.svg | 87 +++++ .../no_effects_composite/report/index.html | 279 +++++++++++++++ .../report/iteration_times.svg | 219 ++++++++++++ .../report/iteration_times_small.svg | 212 +++++++++++ .../no_effects_composite/report/mean.svg | 80 +++++ .../no_effects_composite/report/median.svg | 84 +++++ .../no_effects_composite/report/pdf.svg | 135 +++++++ .../no_effects_composite/report/pdf_small.svg | 64 ++++ .../report/regression.svg | 122 +++++++ .../report/regression_small.svg | 107 ++++++ .../report/relative_iteration_times_small.svg | 222 ++++++++++++ .../report/relative_pdf_small.svg | 62 ++++ .../no_effects_composite/report/slope.svg | 104 ++++++ .../no_effects_composite/report/typical.svg | 104 ++++++ .../no_effects_composite/test/benchmark.json | 1 + .../no_effects_composite/test/estimates.json | 1 + .../no_effects_composite/test/sample.json | 1 + .../no_effects_composite/test/tukey.json | 1 + .../criterion/effects_skip/report/index.html | 116 +++++++ .../criterion/effects_skip/report/violin.svg | 61 ++++ .../with_one_dropshadow/change/estimates.json | 1 + .../gold_standard/benchmark.json | 1 + .../gold_standard/estimates.json | 1 + .../gold_standard/sample.json | 1 + .../gold_standard/tukey.json | 1 + .../with_one_dropshadow/new/benchmark.json | 1 + .../with_one_dropshadow/new/estimates.json | 1 + .../with_one_dropshadow/new/sample.json | 1 + .../with_one_dropshadow/new/tukey.json | 1 + .../with_one_dropshadow/report/MAD.svg | 96 +++++ .../with_one_dropshadow/report/SD.svg | 88 +++++ .../report/both/iteration_times.svg | 233 +++++++++++++ .../with_one_dropshadow/report/both/pdf.svg | 93 +++++ .../report/change/mean.svg | 109 ++++++ .../report/change/median.svg | 77 ++++ .../report/change/t-test.svg | 87 +++++ .../with_one_dropshadow/report/index.html | 279 +++++++++++++++ .../report/iteration_times.svg | 204 +++++++++++ .../report/iteration_times_small.svg | 197 +++++++++++ .../with_one_dropshadow/report/mean.svg | 108 ++++++ .../with_one_dropshadow/report/median.svg | 72 ++++ .../with_one_dropshadow/report/pdf.svg | 163 +++++++++ .../with_one_dropshadow/report/pdf_small.svg | 40 +++ .../with_one_dropshadow/report/regression.svg | 122 +++++++ .../report/regression_small.svg | 107 ++++++ .../report/relative_iteration_times_small.svg | 222 ++++++++++++ .../report/relative_pdf_small.svg | 74 ++++ .../with_one_dropshadow/report/slope.svg | 76 ++++ .../with_one_dropshadow/report/typical.svg | 76 ++++ .../with_one_dropshadow/test/benchmark.json | 1 + .../with_one_dropshadow/test/estimates.json | 1 + .../with_one_dropshadow/test/sample.json | 1 + .../with_one_dropshadow/test/tukey.json | 1 + .../cold_first_stroke/change/estimates.json | 1 + .../gold_standard/benchmark.json | 1 + .../gold_standard/estimates.json | 1 + .../gold_standard/sample.json | 1 + .../gold_standard/tukey.json | 1 + .../cold_first_stroke/new/benchmark.json | 1 + .../cold_first_stroke/new/estimates.json | 1 + .../cold_first_stroke/new/sample.json | 1 + .../cold_first_stroke/new/tukey.json | 1 + .../cold_first_stroke/report/MAD.svg | 88 +++++ .../cold_first_stroke/report/SD.svg | 100 ++++++ .../report/both/iteration_times.svg | 313 +++++++++++++++++ .../cold_first_stroke/report/both/pdf.svg | 73 ++++ .../cold_first_stroke/report/change/mean.svg | 89 +++++ .../report/change/median.svg | 93 +++++ .../report/change/t-test.svg | 99 ++++++ .../cold_first_stroke/report/index.html | 269 ++++++++++++++ .../report/iteration_times.svg | 199 +++++++++++ .../report/iteration_times_small.svg | 192 ++++++++++ .../cold_first_stroke/report/mean.svg | 76 ++++ .../cold_first_stroke/report/median.svg | 68 ++++ .../cold_first_stroke/report/pdf.svg | 165 +++++++++ .../cold_first_stroke/report/pdf_small.svg | 68 ++++ .../report/relative_iteration_times_small.svg | 302 ++++++++++++++++ .../report/relative_pdf_small.svg | 54 +++ .../cold_first_stroke/report/typical.svg | 76 ++++ .../stroke_mask_pooling/report/index.html | 116 +++++++ .../stroke_mask_pooling/report/violin.svg | 53 +++ .../warm_10th_stroke/change/estimates.json | 1 + .../gold_standard/benchmark.json | 1 + .../gold_standard/estimates.json | 1 + .../gold_standard/sample.json | 1 + .../warm_10th_stroke/gold_standard/tukey.json | 1 + .../warm_10th_stroke/new/benchmark.json | 1 + .../warm_10th_stroke/new/estimates.json | 1 + .../warm_10th_stroke/new/sample.json | 1 + .../warm_10th_stroke/new/tukey.json | 1 + .../warm_10th_stroke/report/MAD.svg | 100 ++++++ .../warm_10th_stroke/report/SD.svg | 84 +++++ .../report/both/iteration_times.svg | 308 ++++++++++++++++ .../warm_10th_stroke/report/both/pdf.svg | 89 +++++ .../warm_10th_stroke/report/change/mean.svg | 105 ++++++ .../warm_10th_stroke/report/change/median.svg | 81 +++++ .../warm_10th_stroke/report/change/t-test.svg | 99 ++++++ .../warm_10th_stroke/report/index.html | 269 ++++++++++++++ .../report/iteration_times.svg | 199 +++++++++++ .../report/iteration_times_small.svg | 192 ++++++++++ .../warm_10th_stroke/report/mean.svg | 104 ++++++ .../warm_10th_stroke/report/median.svg | 76 ++++ .../warm_10th_stroke/report/pdf.svg | 151 ++++++++ .../warm_10th_stroke/report/pdf_small.svg | 68 ++++ .../report/relative_iteration_times_small.svg | 297 ++++++++++++++++ .../report/relative_pdf_small.svg | 70 ++++ .../warm_10th_stroke/report/typical.svg | 104 ++++++ hcie-engine-api/src/partial_composite.rs | 14 +- hcie-engine-api/src/stroke_cache.rs | 111 +++--- line_count_report.txt | 38 +- notlar.txt | 5 +- 425 files changed, 31493 insertions(+), 83 deletions(-) create mode 100644 .kilo/plans/1784909963922-criterion-move-and-optimize.md create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/base/benchmark.json create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/base/estimates.json create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/base/sample.json create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/base/tukey.json create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/benchmark.json create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/estimates.json create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/sample.json create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/tukey.json create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/new/benchmark.json create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/new/estimates.json create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/new/sample.json create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/new/tukey.json create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/report/MAD.svg create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/report/SD.svg create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/report/index.html create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/report/iteration_times.svg create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/report/iteration_times_small.svg create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/report/mean.svg create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/report/median.svg create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/report/pdf.svg create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/report/pdf_small.svg create mode 100644 criterion/below_cache_reuse/first_stroke_cache_build/report/typical.svg create mode 100644 criterion/below_cache_reuse/report/index.html create mode 100644 criterion/below_cache_reuse/report/violin.svg create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/base/benchmark.json create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/base/estimates.json create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/base/sample.json create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/base/tukey.json create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/benchmark.json create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/estimates.json create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/sample.json create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/tukey.json create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/new/benchmark.json create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/new/estimates.json create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/new/sample.json create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/new/tukey.json create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/report/MAD.svg create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/report/SD.svg create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/report/index.html create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/report/iteration_times.svg create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/report/iteration_times_small.svg create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/report/mean.svg create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/report/median.svg create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/report/pdf.svg create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/report/pdf_small.svg create mode 100644 criterion/below_cache_reuse/second_stroke_cache_reuse/report/typical.svg create mode 100644 criterion/composite_scratch_pooling/cold_composite/base/benchmark.json create mode 100644 criterion/composite_scratch_pooling/cold_composite/base/estimates.json create mode 100644 criterion/composite_scratch_pooling/cold_composite/base/sample.json create mode 100644 criterion/composite_scratch_pooling/cold_composite/base/tukey.json create mode 100644 criterion/composite_scratch_pooling/cold_composite/gold_standard/benchmark.json create mode 100644 criterion/composite_scratch_pooling/cold_composite/gold_standard/estimates.json create mode 100644 criterion/composite_scratch_pooling/cold_composite/gold_standard/sample.json create mode 100644 criterion/composite_scratch_pooling/cold_composite/gold_standard/tukey.json create mode 100644 criterion/composite_scratch_pooling/cold_composite/new/benchmark.json create mode 100644 criterion/composite_scratch_pooling/cold_composite/new/estimates.json create mode 100644 criterion/composite_scratch_pooling/cold_composite/new/sample.json create mode 100644 criterion/composite_scratch_pooling/cold_composite/new/tukey.json create mode 100644 criterion/composite_scratch_pooling/cold_composite/report/MAD.svg create mode 100644 criterion/composite_scratch_pooling/cold_composite/report/SD.svg create mode 100644 criterion/composite_scratch_pooling/cold_composite/report/index.html create mode 100644 criterion/composite_scratch_pooling/cold_composite/report/iteration_times.svg create mode 100644 criterion/composite_scratch_pooling/cold_composite/report/iteration_times_small.svg create mode 100644 criterion/composite_scratch_pooling/cold_composite/report/mean.svg create mode 100644 criterion/composite_scratch_pooling/cold_composite/report/median.svg create mode 100644 criterion/composite_scratch_pooling/cold_composite/report/pdf.svg create mode 100644 criterion/composite_scratch_pooling/cold_composite/report/pdf_small.svg create mode 100644 criterion/composite_scratch_pooling/cold_composite/report/typical.svg create mode 100644 criterion/composite_scratch_pooling/report/index.html create mode 100644 criterion/composite_scratch_pooling/report/violin.svg create mode 100644 criterion/composite_scratch_pooling/warm_composite/base/benchmark.json create mode 100644 criterion/composite_scratch_pooling/warm_composite/base/estimates.json create mode 100644 criterion/composite_scratch_pooling/warm_composite/base/sample.json create mode 100644 criterion/composite_scratch_pooling/warm_composite/base/tukey.json create mode 100644 criterion/composite_scratch_pooling/warm_composite/gold_standard/benchmark.json create mode 100644 criterion/composite_scratch_pooling/warm_composite/gold_standard/estimates.json create mode 100644 criterion/composite_scratch_pooling/warm_composite/gold_standard/sample.json create mode 100644 criterion/composite_scratch_pooling/warm_composite/gold_standard/tukey.json create mode 100644 criterion/composite_scratch_pooling/warm_composite/new/benchmark.json create mode 100644 criterion/composite_scratch_pooling/warm_composite/new/estimates.json create mode 100644 criterion/composite_scratch_pooling/warm_composite/new/sample.json create mode 100644 criterion/composite_scratch_pooling/warm_composite/new/tukey.json create mode 100644 criterion/composite_scratch_pooling/warm_composite/report/MAD.svg create mode 100644 criterion/composite_scratch_pooling/warm_composite/report/SD.svg create mode 100644 criterion/composite_scratch_pooling/warm_composite/report/index.html create mode 100644 criterion/composite_scratch_pooling/warm_composite/report/iteration_times.svg create mode 100644 criterion/composite_scratch_pooling/warm_composite/report/iteration_times_small.svg create mode 100644 criterion/composite_scratch_pooling/warm_composite/report/mean.svg create mode 100644 criterion/composite_scratch_pooling/warm_composite/report/median.svg create mode 100644 criterion/composite_scratch_pooling/warm_composite/report/pdf.svg create mode 100644 criterion/composite_scratch_pooling/warm_composite/report/pdf_small.svg create mode 100644 criterion/composite_scratch_pooling/warm_composite/report/typical.svg create mode 100644 criterion/effects_skip/no_effects_composite/base/benchmark.json create mode 100644 criterion/effects_skip/no_effects_composite/base/estimates.json create mode 100644 criterion/effects_skip/no_effects_composite/base/sample.json create mode 100644 criterion/effects_skip/no_effects_composite/base/tukey.json create mode 100644 criterion/effects_skip/no_effects_composite/gold_standard/benchmark.json create mode 100644 criterion/effects_skip/no_effects_composite/gold_standard/estimates.json create mode 100644 criterion/effects_skip/no_effects_composite/gold_standard/sample.json create mode 100644 criterion/effects_skip/no_effects_composite/gold_standard/tukey.json create mode 100644 criterion/effects_skip/no_effects_composite/new/benchmark.json create mode 100644 criterion/effects_skip/no_effects_composite/new/estimates.json create mode 100644 criterion/effects_skip/no_effects_composite/new/sample.json create mode 100644 criterion/effects_skip/no_effects_composite/new/tukey.json create mode 100644 criterion/effects_skip/no_effects_composite/report/MAD.svg create mode 100644 criterion/effects_skip/no_effects_composite/report/SD.svg create mode 100644 criterion/effects_skip/no_effects_composite/report/index.html create mode 100644 criterion/effects_skip/no_effects_composite/report/iteration_times.svg create mode 100644 criterion/effects_skip/no_effects_composite/report/iteration_times_small.svg create mode 100644 criterion/effects_skip/no_effects_composite/report/mean.svg create mode 100644 criterion/effects_skip/no_effects_composite/report/median.svg create mode 100644 criterion/effects_skip/no_effects_composite/report/pdf.svg create mode 100644 criterion/effects_skip/no_effects_composite/report/pdf_small.svg create mode 100644 criterion/effects_skip/no_effects_composite/report/typical.svg create mode 100644 criterion/effects_skip/report/index.html create mode 100644 criterion/effects_skip/report/violin.svg create mode 100644 criterion/effects_skip/with_one_dropshadow/base/benchmark.json create mode 100644 criterion/effects_skip/with_one_dropshadow/base/estimates.json create mode 100644 criterion/effects_skip/with_one_dropshadow/base/sample.json create mode 100644 criterion/effects_skip/with_one_dropshadow/base/tukey.json create mode 100644 criterion/effects_skip/with_one_dropshadow/gold_standard/benchmark.json create mode 100644 criterion/effects_skip/with_one_dropshadow/gold_standard/estimates.json create mode 100644 criterion/effects_skip/with_one_dropshadow/gold_standard/sample.json create mode 100644 criterion/effects_skip/with_one_dropshadow/gold_standard/tukey.json create mode 100644 criterion/effects_skip/with_one_dropshadow/new/benchmark.json create mode 100644 criterion/effects_skip/with_one_dropshadow/new/estimates.json create mode 100644 criterion/effects_skip/with_one_dropshadow/new/sample.json create mode 100644 criterion/effects_skip/with_one_dropshadow/new/tukey.json create mode 100644 criterion/effects_skip/with_one_dropshadow/report/MAD.svg create mode 100644 criterion/effects_skip/with_one_dropshadow/report/SD.svg create mode 100644 criterion/effects_skip/with_one_dropshadow/report/index.html create mode 100644 criterion/effects_skip/with_one_dropshadow/report/iteration_times.svg create mode 100644 criterion/effects_skip/with_one_dropshadow/report/iteration_times_small.svg create mode 100644 criterion/effects_skip/with_one_dropshadow/report/mean.svg create mode 100644 criterion/effects_skip/with_one_dropshadow/report/median.svg create mode 100644 criterion/effects_skip/with_one_dropshadow/report/pdf.svg create mode 100644 criterion/effects_skip/with_one_dropshadow/report/pdf_small.svg create mode 100644 criterion/effects_skip/with_one_dropshadow/report/typical.svg create mode 100644 criterion/report/index.html create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/base/benchmark.json create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/base/estimates.json create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/base/sample.json create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/base/tukey.json create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/benchmark.json create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/estimates.json create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/sample.json create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/tukey.json create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/new/benchmark.json create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/new/estimates.json create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/new/sample.json create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/new/tukey.json create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/report/MAD.svg create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/report/SD.svg create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/report/index.html create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/report/iteration_times.svg create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/report/iteration_times_small.svg create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/report/mean.svg create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/report/median.svg create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/report/pdf.svg create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/report/pdf_small.svg create mode 100644 criterion/stroke_mask_pooling/cold_first_stroke/report/typical.svg create mode 100644 criterion/stroke_mask_pooling/report/index.html create mode 100644 criterion/stroke_mask_pooling/report/violin.svg create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/base/benchmark.json create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/base/estimates.json create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/base/sample.json create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/base/tukey.json create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/benchmark.json create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/estimates.json create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/sample.json create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/tukey.json create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/new/benchmark.json create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/new/estimates.json create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/new/sample.json create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/new/tukey.json create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/report/MAD.svg create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/report/SD.svg create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/report/index.html create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/report/iteration_times.svg create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/report/iteration_times_small.svg create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/report/mean.svg create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/report/median.svg create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/report/pdf.svg create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/report/pdf_small.svg create mode 100644 criterion/stroke_mask_pooling/warm_10th_stroke/report/typical.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/change/estimates.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/benchmark.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/estimates.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/sample.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/tukey.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/new/benchmark.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/new/estimates.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/new/sample.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/new/tukey.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/MAD.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/SD.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/both/iteration_times.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/both/pdf.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/change/mean.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/change/median.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/change/t-test.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/index.html create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/iteration_times.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/iteration_times_small.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/mean.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/median.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/pdf.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/pdf_small.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/relative_iteration_times_small.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/relative_pdf_small.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/typical.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/report/index.html create mode 100644 hcie-engine-api/criterion/below_cache_reuse/report/violin.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/change/estimates.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/benchmark.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/estimates.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/sample.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/tukey.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/new/benchmark.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/new/estimates.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/new/sample.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/new/tukey.json create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/MAD.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/SD.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/both/iteration_times.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/both/pdf.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/change/mean.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/change/median.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/change/t-test.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/index.html create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/iteration_times.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/iteration_times_small.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/mean.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/median.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/pdf.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/pdf_small.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/relative_iteration_times_small.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/relative_pdf_small.svg create mode 100644 hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/typical.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/change/estimates.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/gold_standard/benchmark.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/gold_standard/estimates.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/gold_standard/sample.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/gold_standard/tukey.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/new/benchmark.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/new/estimates.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/new/sample.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/new/tukey.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/MAD.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/SD.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/both/iteration_times.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/both/pdf.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/change/mean.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/change/median.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/change/t-test.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/index.html create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/iteration_times.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/iteration_times_small.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/mean.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/median.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/pdf.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/pdf_small.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/relative_iteration_times_small.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/relative_pdf_small.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/typical.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/report/index.html create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/report/violin.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/change/estimates.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/gold_standard/benchmark.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/gold_standard/estimates.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/gold_standard/sample.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/gold_standard/tukey.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/new/benchmark.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/new/estimates.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/new/sample.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/new/tukey.json create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/MAD.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/SD.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/both/iteration_times.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/both/pdf.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/change/mean.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/change/median.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/change/t-test.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/index.html create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/iteration_times.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/iteration_times_small.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/mean.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/median.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/pdf.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/pdf_small.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/relative_iteration_times_small.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/relative_pdf_small.svg create mode 100644 hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/typical.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/change/estimates.json create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/gold_standard/benchmark.json create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/gold_standard/estimates.json create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/gold_standard/sample.json create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/gold_standard/tukey.json create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/new/benchmark.json create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/new/estimates.json create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/new/sample.json create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/new/tukey.json create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/MAD.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/SD.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/both/iteration_times.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/both/pdf.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/change/mean.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/change/median.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/change/t-test.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/index.html create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/iteration_times.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/iteration_times_small.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/mean.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/median.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/pdf.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/pdf_small.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/regression.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/regression_small.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/relative_iteration_times_small.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/relative_pdf_small.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/slope.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/report/typical.svg create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/test/benchmark.json create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/test/estimates.json create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/test/sample.json create mode 100644 hcie-engine-api/criterion/effects_skip/no_effects_composite/test/tukey.json create mode 100644 hcie-engine-api/criterion/effects_skip/report/index.html create mode 100644 hcie-engine-api/criterion/effects_skip/report/violin.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/change/estimates.json create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/gold_standard/benchmark.json create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/gold_standard/estimates.json create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/gold_standard/sample.json create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/gold_standard/tukey.json create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/new/benchmark.json create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/new/estimates.json create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/new/sample.json create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/new/tukey.json create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/MAD.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/SD.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/both/iteration_times.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/both/pdf.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/change/mean.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/change/median.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/change/t-test.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/index.html create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/iteration_times.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/iteration_times_small.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/mean.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/median.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/pdf.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/pdf_small.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/regression.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/regression_small.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/relative_iteration_times_small.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/relative_pdf_small.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/slope.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/typical.svg create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/test/benchmark.json create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/test/estimates.json create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/test/sample.json create mode 100644 hcie-engine-api/criterion/effects_skip/with_one_dropshadow/test/tukey.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/change/estimates.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/benchmark.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/estimates.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/sample.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/tukey.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/new/benchmark.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/new/estimates.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/new/sample.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/new/tukey.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/MAD.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/SD.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/both/iteration_times.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/both/pdf.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/change/mean.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/change/median.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/change/t-test.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/index.html create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/iteration_times.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/iteration_times_small.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/mean.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/median.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/pdf.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/pdf_small.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/relative_iteration_times_small.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/relative_pdf_small.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/typical.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/report/index.html create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/report/violin.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/change/estimates.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/benchmark.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/estimates.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/sample.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/tukey.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/new/benchmark.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/new/estimates.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/new/sample.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/new/tukey.json create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/MAD.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/SD.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/both/iteration_times.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/both/pdf.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/change/mean.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/change/median.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/change/t-test.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/index.html create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/iteration_times.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/iteration_times_small.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/mean.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/median.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/pdf.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/pdf_small.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/relative_iteration_times_small.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/relative_pdf_small.svg create mode 100644 hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/typical.svg diff --git a/.kilo/plans/1784909963922-criterion-move-and-optimize.md b/.kilo/plans/1784909963922-criterion-move-and-optimize.md new file mode 100644 index 0000000..afba925 --- /dev/null +++ b/.kilo/plans/1784909963922-criterion-move-and-optimize.md @@ -0,0 +1,189 @@ +# Plan: Relocate Criterion Results + Optimize to 2× gold_standard + +## Context + +Criterion benchmarks exist under `target/criterion/` with gold-standard baselines +already saved. The `criterion-test` branch introduced benchmarks; the current +`performance-optimization` branch added `bench = false` and reverted `blend_mode`. + +**Current gold_standard timings (mean):** + +| Benchmark | ns (mean) | ~seconds | +|---|---|---| +| `below_cache_reuse/first_stroke_cache_build` | 807,729,115 | 0.81 s | +| `below_cache_reuse/second_stroke_cache_reuse` | 14,573,274 | 0.015 s | +| `composite_scratch_pooling/cold_composite` | 1,048,196,885 | 1.05 s | +| `composite_scratch_pooling/warm_composite` | 10,073,839 | 0.010 s | +| `effects_skip/no_effects_composite` | 14,340,411 | 0.014 s | +| `effects_skip/with_one_dropshadow` | 14,780,582 | 0.015 s | +| `stroke_mask_pooling/cold_first_stroke` | 46,427,571 | 0.046 s | +| `stroke_mask_pooling/warm_10th_stroke` | 16,749,902 | 0.017 s | + +Dominant costs: **first_stroke_cache_build** (0.81 s) and **cold_composite** (1.05 s). + +**Target:** 2× faster on cold/first-stroke paths; zero regressions on warm paths. + +--- + +## Phase 1 — Relocate `target/criterion` to project root + +### 1.1: Move the results directory +```bash +mv target/criterion ./criterion +``` + +### 1.2: Update `.gitignore` +Add `!/criterion` exception. The current rule `/target/` won't affect root-level `criterion/` but `/target/` plus `**/target/` should be reviewed. Actually `/target/` only matches the root `target/` dir, and `**/target/` matches nested ones, so `criterion/` at root is fine. No `.gitignore` change needed. + +### 1.3: Configure criterion output directory +Criterion 0.5 uses `CRITERION_HOME` env var (defaults to `target/criterion`). After move, either: + +**Option A (preferred):** Set `CRITERION_HOME` via `.cargo/config.toml`: +```toml +[env] +CRITERION_HOME = "criterion" +``` + +**Option B:** Export before benching: +```bash +CRITERION_HOME=criterion cargo bench -p hcie-engine-api +``` + +### 1.4: Update `criterion.md` +Replace `./target/criterion/report/index.html` → `./criterion/report/index.html`. + +### 1.5: Update `notlar.txt` +Update the bench command section to reflect `CRITERION_HOME=criterion` usage. + +--- + +## Phase 2 — Fix benchmark correctness + +### 2.1: Remove `bench = false` from `hcie-engine-api/Cargo.toml` +Line 37: `bench = false` must be removed for `[[bench]]` targets to work correctly. +This was a workaround from commit `ee6ad2d`. + +### 2.2: Verify `effects_skip.rs` blend_mode +Current `"Normal".to_string()` matches `LayerStyle::DropShadow { blend_mode: String }` — correct. The `criterion-test` branch had `hcie_engine_api::BlendMode::Normal` which is a type mismatch. No change needed. + +--- + +## Phase 3 — Optimization loop targeting 2× on cold paths + +**Prerequisite:** Engine crates are locked (`chmod 444`). Use `./unlock.sh ` to modify, `./lock.sh ` after. + +### 3.0: Save current state as gold_standard baseline +```bash +cargo bench -p hcie-engine-api -- --save-baseline gold_standard +``` + +### 3.1: Optimize `below_cache` construction (first_stroke_cache_build: 0.81 s → ≤0.40 s) + +**Unlock:** `./unlock.sh hcie-engine-api` +**File:** `hcie-engine-api/src/stroke_cache.rs:513-608` → `rebuild_below_cache_if_needed()` + +The function calls `tiled::composite_tiled_into()` for the full canvas (3840×2160). Optimization candidates: + +1. **Parallelize the below-cache tile build loop** (line 547-561). Currently iterates layers sequentially to build tiles. Use `par_iter` for tile construction. + +2. **Skip fully invisible layers in below-cache.** Check `tl.visible` before compositing. + +3. **Pre-fill with topmost opaque Normal-blend layer.** Walk bottom→top, find the first fully opaque Normal-blend layer, fill everything below it at once. + +4. **Reduce zero-fill cost.** The 33 MB `cache.fill(0)` at line 564 is sequential. Consider `unsafe { std::ptr::write_bytes }` for SIMD-accelerated zeroing. + +**Lock:** `./lock.sh hcie-engine-api` + +### 3.2: Optimize cold composite (cold_composite: 1.05 s → ≤0.52 s) + +**Unlock:** `./unlock.sh hcie-engine-api` +**File:** `hcie-engine-api/src/partial_composite.rs:90-228` → `render_composite_region()` cold path (lines 194-222) + +The cold path zeroes the scratch buffer then composites all layers. Optimization candidates: + +1. **Parallel scratch buffer zeroing.** Replace row-by-row `buf[start..end].fill(0)` with `par_chunks_exact_mut`. + +2. **Merge zero-fill with first-layer composite.** Instead of fill(0) then composite, start the first layer's composite directly (it overwrites anyway if using Normal blend). + +3. **Skip tile sync for unchanged layers.** In `apply_effects_and_sync_tiles()`, the `sync_dirty_tiles()` re-tiles every dirty layer even if pixels haven't changed since last sync. + +4. **Cache the tile compositing results.** If the same layer stack was composited before, reuse intermediate results. + +**Lock:** `./lock.sh hcie-engine-api` + +### 3.3: Optimize tiled compositing inner loop + +**Unlock:** `./unlock.sh hcie-composite` +**File:** `hcie-composite/src/tiled.rs` + +The `composite_tiled_into()` function handles small-region vs full-canvas compositing. The AGENTS.md note says small regions use sequential, large regions use `par_chunks_exact_mut`. Verify the full-canvas path (below-cache build and cold composite) actually uses parallel compositing. + +Optimization candidates: +1. **Ensure `par_chunks_exact_mut` is used for full-canvas compositing** in tiled.rs. +2. **Reduce per-tile overhead.** Check if tile lookups, bounds checks, or branching in the hot loop can be eliminated. + +**Lock:** `./lock.sh hcie-composite` + +### 3.4: Validate after each optimization + +After EACH change: +```bash +# Pixel-perfect correctness (MUST pass) +cargo test -p hcie-engine-api --test visual_regression + +# Regression check vs gold_standard (MUST show improvement, no regressions) +cargo bench -p hcie-engine-api -- --baseline gold_standard + +# Performance regression test +cargo test -p hcie-engine-api --test performance_stroke_4k -- --nocapture +``` + +### 3.5: Re-save gold_standard after achieving target +```bash +cargo bench -p hcie-engine-api -- --save-baseline gold_standard +``` + +--- + +## Phase 4 — Re-lock all engine crates +```bash +./lock.sh hcie-engine-api +./lock.sh hcie-composite +``` + +--- + +## Files Modified + +| File | Change | +|---|---| +| `target/criterion/` → `./criterion/` | Directory move | +| `.cargo/config.toml` | Add `CRITERION_HOME = "criterion"` | +| `criterion.md` | Update output path | +| `notlar.txt` | Update bench instructions | +| `hcie-engine-api/Cargo.toml` | Remove `bench = false` | +| `hcie-engine-api/src/stroke_cache.rs` | below_cache optimization | +| `hcie-engine-api/src/partial_composite.rs` | Cold composite optimization | +| `hcie-composite/src/tiled.rs` | Tiled compositing optimization | + +--- + +## Risks + +| Risk | Mitigation | +|---|---| +| `CRITERION_HOME` doesn't work with criterion 0.5 | Fallback: use `--output-dir criterion` flag or `.cargo/config.toml` `[env]` section | +| Engine optimizations break pixel-perfect rendering | Run `visual_regression` test after every change | +| Changes to hot path break AGENTS.md-protected mechanisms | Verify all protected mechanisms still pass; no changes to pooling logic correctness | +| 2× target not achievable with these optimizations | Profile further; consider SIMD, parallelism in deeper layers | + +--- + +## Validation Commands + +```bash +cargo bench -p hcie-engine-api -- --baseline gold_standard +cargo test -p hcie-engine-api --test visual_regression +cargo test -p hcie-engine-api --test performance_stroke_4k -- --nocapture +cargo bench -p hcie-engine-api --no-run +``` diff --git a/criterion.md b/criterion.md index cc0d05a..68e3fe4 100644 --- a/criterion.md +++ b/criterion.md @@ -38,4 +38,4 @@ HCIE v4 engine API'si üzerindeki 4K tuval optimizasyonlarının yanlışlıkla > ```bash > cargo bench -p hcie-engine-api > ``` -> _Not: Bu testler 4K ve çok katmanlı benchmarklar içerdiğinden belleği yoğun kullanır. Sonuçlar `./target/criterion/report/index.html` olarak dökülecektir._ +> _Not: Bu testler 4K ve çok katmanlı benchmarklar içerdiğinden belleği yoğun kullanır. Sonuçlar `./criterion/report/index.html` olarak dökülecektir._ diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/base/benchmark.json b/criterion/below_cache_reuse/first_stroke_cache_build/base/benchmark.json new file mode 100644 index 0000000..b9c15c8 --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/base/benchmark.json @@ -0,0 +1 @@ +{"group_id":"below_cache_reuse","function_id":"first_stroke_cache_build","value_str":null,"throughput":null,"full_id":"below_cache_reuse/first_stroke_cache_build","directory_name":"below_cache_reuse/first_stroke_cache_build","title":"below_cache_reuse/first_stroke_cache_build"} \ No newline at end of file diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/base/estimates.json b/criterion/below_cache_reuse/first_stroke_cache_build/base/estimates.json new file mode 100644 index 0000000..5f216c4 --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/base/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":951849109.6060001,"upper_bound":997651459.8389999},"point_estimate":974726514.46,"standard_error":11692756.962205948},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":964333717.5,"upper_bound":1008235925.5},"point_estimate":997231071.5,"standard_error":10129990.438525524},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":69473355.28280139,"upper_bound":111001765.58222473},"point_estimate":82373110.72538495,"standard_error":11488167.256345619},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":100220051.94789164,"upper_bound":134052914.81567669},"point_estimate":117989793.53891322,"standard_error":8675705.832319831}} \ No newline at end of file diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/base/sample.json b/criterion/below_cache_reuse/first_stroke_cache_build/base/sample.json new file mode 100644 index 0000000..e5d6b9f --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/base/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0],"times":[766746117.0,762780503.0,802092317.0,810590059.0,785041479.0,833094129.0,797319443.0,781000772.0,824826845.0,838767365.0,791226110.0,829267788.0,781862950.0,779800184.0,771607272.0,789280774.0,945732988.0,910218833.0,917873393.0,940920778.0,947424737.0,923242219.0,931625753.0,919991609.0,913492448.0,916444409.0,950341592.0,923541197.0,928591390.0,995396149.0,1004683636.0,1011866867.0,1070420231.0,1166316467.0,1004262906.0,1011788215.0,1005062028.0,965194005.0,1011232148.0,1036411621.0,1132321236.0,1000067767.0,955373101.0,1003324041.0,1078142864.0,1049865974.0,1161677421.0,1053145913.0,1062159998.0,1063995056.0,1027989008.0,1047439652.0,1071278744.0,1022373315.0,1029988264.0,1023854165.0,982070928.0,996018276.0,1014625316.0,997491612.0,1027984925.0,1038370019.0,1002373050.0,1037010034.0,1093033883.0,1052436036.0,1031065937.0,1120454718.0,1063462438.0,1116641430.0,1047847072.0,1022917719.0,1007374935.0,1051745013.0,997741814.0,972218953.0,991919297.0,1207522671.0,1086048497.0,1030363359.0,973244186.0,994653301.0,948561347.0,943817508.0,952406570.0,956448482.0,953828399.0,1106507324.0,1314654041.0,1169445937.0,1278647220.0,1002822645.0,1064879109.0,996265656.0,996970531.0,947121336.0,754580294.0,758791074.0,740759124.0,749133185.0]} \ No newline at end of file diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/base/tukey.json b/criterion/below_cache_reuse/first_stroke_cache_build/base/tukey.json new file mode 100644 index 0000000..1f5f47a --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/base/tukey.json @@ -0,0 +1 @@ +[567805984.25,745117775.375,1217949218.375,1395261009.5] \ No newline at end of file diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/benchmark.json b/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/benchmark.json new file mode 100644 index 0000000..b9c15c8 --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/benchmark.json @@ -0,0 +1 @@ +{"group_id":"below_cache_reuse","function_id":"first_stroke_cache_build","value_str":null,"throughput":null,"full_id":"below_cache_reuse/first_stroke_cache_build","directory_name":"below_cache_reuse/first_stroke_cache_build","title":"below_cache_reuse/first_stroke_cache_build"} \ No newline at end of file diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/estimates.json b/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/estimates.json new file mode 100644 index 0000000..1310d27 --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":802628791.64,"upper_bound":813040484.75625},"point_estimate":807729115.66,"standard_error":2659045.297504378},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":795640433.0,"upper_bound":811508409.0},"point_estimate":802601736.5,"standard_error":3949402.862673317},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":20569345.92322111,"upper_bound":31956485.414358974},"point_estimate":26899691.986835003,"standard_error":3013983.96001046},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":22212337.25510467,"upper_bound":30449660.487286024},"point_estimate":26573217.06894172,"standard_error":2097572.804009924}} \ No newline at end of file diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/sample.json b/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/sample.json new file mode 100644 index 0000000..930915b --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0],"times":[790268733.0,778077824.0,777753927.0,790748016.0,774874563.0,795354479.0,830986321.0,774933025.0,795640433.0,781222991.0,783034032.0,779584961.0,860249621.0,824591352.0,770614531.0,793335010.0,793120148.0,798457837.0,789556400.0,791420744.0,824640662.0,786581195.0,833347053.0,819516805.0,806814155.0,799358662.0,823386809.0,809103800.0,809246261.0,798475071.0,822390064.0,814365804.0,766813870.0,801503376.0,785641800.0,829493669.0,807809674.0,818182313.0,782331838.0,802600901.0,828619321.0,865375932.0,847686000.0,868990008.0,865904316.0,836130205.0,829871107.0,879545539.0,811999444.0,804613012.0,812123871.0,832134920.0,821824032.0,811624727.0,843506464.0,809350841.0,788414381.0,828658428.0,813950594.0,824437606.0,799515634.0,801852171.0,789206101.0,777631654.0,819295064.0,817602677.0,844474444.0,817757416.0,857198407.0,891795835.0,797757772.0,807208096.0,792158260.0,788329122.0,829061221.0,802602572.0,803586470.0,813557418.0,814978517.0,867225429.0,834303995.0,829183844.0,786379472.0,780827692.0,785952512.0,781295034.0,781292589.0,785193215.0,781383953.0,781449903.0,783723070.0,791816434.0,782836286.0,778115079.0,780737656.0,783681127.0,797553564.0,767112383.0,811508409.0,795581591.0]} \ No newline at end of file diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/tukey.json b/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/tukey.json new file mode 100644 index 0000000..2b77ca9 --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/tukey.json @@ -0,0 +1 @@ +[674142403.25,730207567.625,879714672.625,935779837.0] \ No newline at end of file diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/new/benchmark.json b/criterion/below_cache_reuse/first_stroke_cache_build/new/benchmark.json new file mode 100644 index 0000000..b9c15c8 --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/new/benchmark.json @@ -0,0 +1 @@ +{"group_id":"below_cache_reuse","function_id":"first_stroke_cache_build","value_str":null,"throughput":null,"full_id":"below_cache_reuse/first_stroke_cache_build","directory_name":"below_cache_reuse/first_stroke_cache_build","title":"below_cache_reuse/first_stroke_cache_build"} \ No newline at end of file diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/new/estimates.json b/criterion/below_cache_reuse/first_stroke_cache_build/new/estimates.json new file mode 100644 index 0000000..1310d27 --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/new/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":802628791.64,"upper_bound":813040484.75625},"point_estimate":807729115.66,"standard_error":2659045.297504378},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":795640433.0,"upper_bound":811508409.0},"point_estimate":802601736.5,"standard_error":3949402.862673317},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":20569345.92322111,"upper_bound":31956485.414358974},"point_estimate":26899691.986835003,"standard_error":3013983.96001046},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":22212337.25510467,"upper_bound":30449660.487286024},"point_estimate":26573217.06894172,"standard_error":2097572.804009924}} \ No newline at end of file diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/new/sample.json b/criterion/below_cache_reuse/first_stroke_cache_build/new/sample.json new file mode 100644 index 0000000..930915b --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/new/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0],"times":[790268733.0,778077824.0,777753927.0,790748016.0,774874563.0,795354479.0,830986321.0,774933025.0,795640433.0,781222991.0,783034032.0,779584961.0,860249621.0,824591352.0,770614531.0,793335010.0,793120148.0,798457837.0,789556400.0,791420744.0,824640662.0,786581195.0,833347053.0,819516805.0,806814155.0,799358662.0,823386809.0,809103800.0,809246261.0,798475071.0,822390064.0,814365804.0,766813870.0,801503376.0,785641800.0,829493669.0,807809674.0,818182313.0,782331838.0,802600901.0,828619321.0,865375932.0,847686000.0,868990008.0,865904316.0,836130205.0,829871107.0,879545539.0,811999444.0,804613012.0,812123871.0,832134920.0,821824032.0,811624727.0,843506464.0,809350841.0,788414381.0,828658428.0,813950594.0,824437606.0,799515634.0,801852171.0,789206101.0,777631654.0,819295064.0,817602677.0,844474444.0,817757416.0,857198407.0,891795835.0,797757772.0,807208096.0,792158260.0,788329122.0,829061221.0,802602572.0,803586470.0,813557418.0,814978517.0,867225429.0,834303995.0,829183844.0,786379472.0,780827692.0,785952512.0,781295034.0,781292589.0,785193215.0,781383953.0,781449903.0,783723070.0,791816434.0,782836286.0,778115079.0,780737656.0,783681127.0,797553564.0,767112383.0,811508409.0,795581591.0]} \ No newline at end of file diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/new/tukey.json b/criterion/below_cache_reuse/first_stroke_cache_build/new/tukey.json new file mode 100644 index 0000000..2b77ca9 --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/new/tukey.json @@ -0,0 +1 @@ +[674142403.25,730207567.625,879714672.625,935779837.0] \ No newline at end of file diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/report/MAD.svg b/criterion/below_cache_reuse/first_stroke_cache_build/report/MAD.svg new file mode 100644 index 0000000..6625e44 --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/report/MAD.svg @@ -0,0 +1,84 @@ + + +below_cache_reuse/first_stroke_cache_build:MAD + + +Density (a.u.) + + +Average time (ms) + + + +0.02 + + + +0.04 + + + +0.06 + + + +0.08 + + + +0.1 + + + +0.12 + + + +0.14 + + + + +20 + + + +22 + + + +24 + + + +26 + + + +28 + + + +30 + + + +32 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/report/SD.svg b/criterion/below_cache_reuse/first_stroke_cache_build/report/SD.svg new file mode 100644 index 0000000..8df8cab --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/report/SD.svg @@ -0,0 +1,108 @@ + + +below_cache_reuse/first_stroke_cache_build:SD + + +Density (a.u.) + + +Average time (ms) + + + +0.02 + + + +0.04 + + + +0.06 + + + +0.08 + + + +0.1 + + + +0.12 + + + +0.14 + + + +0.16 + + + +0.18 + + + +0.2 + + + + +22 + + + +23 + + + +24 + + + +25 + + + +26 + + + +27 + + + +28 + + + +29 + + + +30 + + + +31 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/report/index.html b/criterion/below_cache_reuse/first_stroke_cache_build/report/index.html new file mode 100644 index 0000000..f6198de --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/report/index.html @@ -0,0 +1,193 @@ + + + + + + below_cache_reuse/first_stroke_cache_build - Criterion.rs + + + + +
+

below_cache_reuse/first_stroke_cache_build

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
R²0.00203100.00210640.0020248
Mean802.63 ms807.73 ms813.04 ms
Std. Dev.22.212 ms26.573 ms30.450 ms
Median795.64 ms802.60 ms811.51 ms
MAD20.569 ms26.900 ms31.956 ms
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probability of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the average time per iteration for the samples. Each point + represents one sample.

+

See the + documentation for more details on the additional statistics.

+
+
+
+ + + + \ No newline at end of file diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/report/iteration_times.svg b/criterion/below_cache_reuse/first_stroke_cache_build/report/iteration_times.svg new file mode 100644 index 0000000..6478cd2 --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/report/iteration_times.svg @@ -0,0 +1,194 @@ + + +below_cache_reuse/first_stroke_cache_build + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + +780.0 + + + +800.0 + + + +820.0 + + + +840.0 + + + +860.0 + + + +880.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + + diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/report/iteration_times_small.svg b/criterion/below_cache_reuse/first_stroke_cache_build/report/iteration_times_small.svg new file mode 100644 index 0000000..e0ec087 --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/report/iteration_times_small.svg @@ -0,0 +1,187 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + +780.0 + + + +800.0 + + + +820.0 + + + +840.0 + + + +860.0 + + + +880.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/report/mean.svg b/criterion/below_cache_reuse/first_stroke_cache_build/report/mean.svg new file mode 100644 index 0000000..bbbeb64 --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/report/mean.svg @@ -0,0 +1,88 @@ + + +below_cache_reuse/first_stroke_cache_build:mean + + +Density (a.u.) + + +Average time (ms) + + + +0.02 + + + +0.04 + + + +0.06 + + + +0.08 + + + +0.1 + + + +0.12 + + + +0.14 + + + +0.16 + + + + +802 + + + +804 + + + +806 + + + +808 + + + +810 + + + +812 + + + +814 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/report/median.svg b/criterion/below_cache_reuse/first_stroke_cache_build/report/median.svg new file mode 100644 index 0000000..cffb08e --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/report/median.svg @@ -0,0 +1,100 @@ + + +below_cache_reuse/first_stroke_cache_build:median + + +Density (a.u.) + + +Average time (ms) + + + +0.02 + + + +0.04 + + + +0.06 + + + +0.08 + + + +0.1 + + + +0.12 + + + +0.14 + + + +0.16 + + + + +794 + + + +796 + + + +798 + + + +800 + + + +802 + + + +804 + + + +806 + + + +808 + + + +810 + + + +812 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/report/pdf.svg b/criterion/below_cache_reuse/first_stroke_cache_build/report/pdf.svg new file mode 100644 index 0000000..59c8c97 --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/report/pdf.svg @@ -0,0 +1,161 @@ + + +below_cache_reuse/first_stroke_cache_build + + +Iterations + + +Average Time (ms) + + + +0 + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + +1 + + + + +740 + + + +760 + + + +780 + + + +800 + + + +820 + + + +840 + + + +860 + + + +880 + + + +900 + + + +920 + + + +Density (a.u.) + + + +0 + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + +0.014 + + + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/report/pdf_small.svg b/criterion/below_cache_reuse/first_stroke_cache_build/report/pdf_small.svg new file mode 100644 index 0000000..1a81fc2 --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/report/pdf_small.svg @@ -0,0 +1,64 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0 + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + +0.014 + + + +0.016 + + + + +750 + + + +800 + + + +850 + + + +900 + + + + + diff --git a/criterion/below_cache_reuse/first_stroke_cache_build/report/typical.svg b/criterion/below_cache_reuse/first_stroke_cache_build/report/typical.svg new file mode 100644 index 0000000..d85982e --- /dev/null +++ b/criterion/below_cache_reuse/first_stroke_cache_build/report/typical.svg @@ -0,0 +1,88 @@ + + +below_cache_reuse/first_stroke_cache_build:typical + + +Density (a.u.) + + +Average time (ms) + + + +0.02 + + + +0.04 + + + +0.06 + + + +0.08 + + + +0.1 + + + +0.12 + + + +0.14 + + + +0.16 + + + + +802 + + + +804 + + + +806 + + + +808 + + + +810 + + + +812 + + + +814 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/below_cache_reuse/report/index.html b/criterion/below_cache_reuse/report/index.html new file mode 100644 index 0000000..88fa8eb --- /dev/null +++ b/criterion/below_cache_reuse/report/index.html @@ -0,0 +1,116 @@ + + + + + + below_cache_reuse Summary - Criterion.rs + + + + +
+

below_cache_reuse

+

Violin Plot

+ + Violin Plot + +

This chart shows the relationship between function/parameter and iteration time. The thickness of the shaded + region indicates the probability that a measurement of the given function/parameter would take a particular + length of time.

+
+ +

below_cache_reuse/first_stroke_cache_build

+ + + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+ +

below_cache_reuse/second_stroke_cache_reuse

+ + + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+ + + + \ No newline at end of file diff --git a/criterion/below_cache_reuse/report/violin.svg b/criterion/below_cache_reuse/report/violin.svg new file mode 100644 index 0000000..53dec48 --- /dev/null +++ b/criterion/below_cache_reuse/report/violin.svg @@ -0,0 +1,65 @@ + + +below_cache_reuse: Violin plot + + +Input + + +Average time (ms) + + + +below_cache_reuse/second_stroke_cache_reuse + + + +below_cache_reuse/first_stroke_cache_build + + + + +0.0 + + + +100.0 + + + +200.0 + + + +300.0 + + + +400.0 + + + +500.0 + + + +600.0 + + + +700.0 + + + +800.0 + + + +900.0 + + + + + + + diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/base/benchmark.json b/criterion/below_cache_reuse/second_stroke_cache_reuse/base/benchmark.json new file mode 100644 index 0000000..ca406b8 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/base/benchmark.json @@ -0,0 +1 @@ +{"group_id":"below_cache_reuse","function_id":"second_stroke_cache_reuse","value_str":null,"throughput":null,"full_id":"below_cache_reuse/second_stroke_cache_reuse","directory_name":"below_cache_reuse/second_stroke_cache_reuse","title":"below_cache_reuse/second_stroke_cache_reuse"} \ No newline at end of file diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/base/estimates.json b/criterion/below_cache_reuse/second_stroke_cache_reuse/base/estimates.json new file mode 100644 index 0000000..8f6d368 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/base/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14011367.892625,"upper_bound":14115720.443625},"point_estimate":14063016.8175,"standard_error":26654.954641667526},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":13967945.25,"upper_bound":14050139.375},"point_estimate":13988508.0,"standard_error":23631.406088061587},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":142833.86678919196,"upper_bound":270162.1470786631},"point_estimate":193013.01887333393,"standard_error":32270.259457605036},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":224947.85966065503,"upper_bound":302207.5182213088},"point_estimate":266302.887150464,"standard_error":19729.233950716913}} \ No newline at end of file diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/base/sample.json b/criterion/below_cache_reuse/second_stroke_cache_reuse/base/sample.json new file mode 100644 index 0000000..2d90fda --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/base/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[53700467.0,54920518.0,55620742.0,55401828.0,56275616.0,56281127.0,55566845.0,57638433.0,55384168.0,56459830.0,55420778.0,55976192.0,55741099.0,58163455.0,58010257.0,57765430.0,55514508.0,56145854.0,57707338.0,56934870.0,56425730.0,55879764.0,56594316.0,55599331.0,56752996.0,56198005.0,55788767.0,56112775.0,55735305.0,55828801.0,54752868.0,55902707.0,54720836.0,56977682.0,55772899.0,55189105.0,55886251.0,55921354.0,56790773.0,55780122.0,55923160.0,55955315.0,56248256.0,54234083.0,56786365.0,54912957.0,56596124.0,54846407.0,56152859.0,55199440.0,57566823.0,55111440.0,57800400.0,55871781.0,59184692.0,57091628.0,55983390.0,55610283.0,56448828.0,56935160.0,55778031.0,55952749.0,55549556.0,55570569.0,55306819.0,57889433.0,57329625.0,58419235.0,55339956.0,57293029.0,56116090.0,55522431.0,57023081.0,55878478.0,55865568.0,54848641.0,58151349.0,58082040.0,58515454.0,56809313.0,56407775.0,58512002.0,55827513.0,56025264.0,55734745.0,55915356.0,57133267.0,56393244.0,55400787.0,54980254.0,55623337.0,58793969.0,55419158.0,55296670.0,55445802.0,56141139.0,55945852.0,58614479.0,56326723.0,56328811.0]} \ No newline at end of file diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/base/tukey.json b/criterion/below_cache_reuse/second_stroke_cache_reuse/base/tukey.json new file mode 100644 index 0000000..b9886c4 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/base/tukey.json @@ -0,0 +1 @@ +[12973082.0,13432745.75,14658515.75,15118179.5] \ No newline at end of file diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/benchmark.json b/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/benchmark.json new file mode 100644 index 0000000..ca406b8 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/benchmark.json @@ -0,0 +1 @@ +{"group_id":"below_cache_reuse","function_id":"second_stroke_cache_reuse","value_str":null,"throughput":null,"full_id":"below_cache_reuse/second_stroke_cache_reuse","directory_name":"below_cache_reuse/second_stroke_cache_reuse","title":"below_cache_reuse/second_stroke_cache_reuse"} \ No newline at end of file diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/estimates.json b/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/estimates.json new file mode 100644 index 0000000..1d87df0 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14488632.766375,"upper_bound":14661973.6175},"point_estimate":14573274.1025,"standard_error":44333.11722230234},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14410274.0,"upper_bound":14557348.625},"point_estimate":14450582.625,"standard_error":39224.00761103059},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":233399.4128063321,"upper_bound":439276.41884190927},"point_estimate":306014.56496715546,"standard_error":53814.48743505519},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":360937.87698428595,"upper_bound":507599.9889355485},"point_estimate":440183.1426105533,"standard_error":37275.52487032545}} \ No newline at end of file diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/sample.json b/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/sample.json new file mode 100644 index 0000000..5c480f2 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[57628913.0,58353908.0,56605650.0,57799624.0,58686849.0,55946393.0,56337845.0,55760868.0,56805002.0,57785389.0,56243017.0,58632749.0,57777417.0,57669559.0,56481193.0,57622070.0,57008318.0,56020679.0,56526513.0,57005853.0,56835596.0,57769094.0,56981517.0,56413875.0,56606509.0,58315868.0,57292684.0,57606731.0,59973906.0,63480721.0,62956347.0,61553983.0,62547651.0,59501308.0,62336152.0,57703451.0,57770279.0,57644664.0,58859858.0,62795382.0,62485666.0,58384144.0,59412088.0,59063185.0,58090574.0,58024579.0,57805037.0,60392763.0,58612125.0,56935410.0,58036047.0,58006286.0,57653279.0,57419211.0,58474392.0,60981794.0,57524070.0,61457181.0,57062106.0,57196936.0,58149191.0,57212231.0,57218615.0,57199377.0,59284978.0,57654495.0,56726059.0,59452210.0,59401486.0,58142921.0,60388321.0,56939117.0,61250168.0,56574771.0,57480802.0,58339161.0,59788369.0,58040318.0,57605241.0,58641391.0,56198499.0,59943735.0,58055631.0,59239610.0,58438516.0,58443994.0,60022111.0,57200925.0,56627532.0,57906487.0,57022995.0,57505197.0,59163050.0,54391122.0,58338005.0,61624038.0,56429249.0,58442056.0,57614149.0,60553260.0]} \ No newline at end of file diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/tukey.json b/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/tukey.json new file mode 100644 index 0000000..8e7bc91 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/tukey.json @@ -0,0 +1 @@ +[12847115.0625,13568961.09375,15493883.84375,16215729.875] \ No newline at end of file diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/new/benchmark.json b/criterion/below_cache_reuse/second_stroke_cache_reuse/new/benchmark.json new file mode 100644 index 0000000..ca406b8 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/new/benchmark.json @@ -0,0 +1 @@ +{"group_id":"below_cache_reuse","function_id":"second_stroke_cache_reuse","value_str":null,"throughput":null,"full_id":"below_cache_reuse/second_stroke_cache_reuse","directory_name":"below_cache_reuse/second_stroke_cache_reuse","title":"below_cache_reuse/second_stroke_cache_reuse"} \ No newline at end of file diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/new/estimates.json b/criterion/below_cache_reuse/second_stroke_cache_reuse/new/estimates.json new file mode 100644 index 0000000..1d87df0 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/new/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14488632.766375,"upper_bound":14661973.6175},"point_estimate":14573274.1025,"standard_error":44333.11722230234},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14410274.0,"upper_bound":14557348.625},"point_estimate":14450582.625,"standard_error":39224.00761103059},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":233399.4128063321,"upper_bound":439276.41884190927},"point_estimate":306014.56496715546,"standard_error":53814.48743505519},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":360937.87698428595,"upper_bound":507599.9889355485},"point_estimate":440183.1426105533,"standard_error":37275.52487032545}} \ No newline at end of file diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/new/sample.json b/criterion/below_cache_reuse/second_stroke_cache_reuse/new/sample.json new file mode 100644 index 0000000..5c480f2 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/new/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[57628913.0,58353908.0,56605650.0,57799624.0,58686849.0,55946393.0,56337845.0,55760868.0,56805002.0,57785389.0,56243017.0,58632749.0,57777417.0,57669559.0,56481193.0,57622070.0,57008318.0,56020679.0,56526513.0,57005853.0,56835596.0,57769094.0,56981517.0,56413875.0,56606509.0,58315868.0,57292684.0,57606731.0,59973906.0,63480721.0,62956347.0,61553983.0,62547651.0,59501308.0,62336152.0,57703451.0,57770279.0,57644664.0,58859858.0,62795382.0,62485666.0,58384144.0,59412088.0,59063185.0,58090574.0,58024579.0,57805037.0,60392763.0,58612125.0,56935410.0,58036047.0,58006286.0,57653279.0,57419211.0,58474392.0,60981794.0,57524070.0,61457181.0,57062106.0,57196936.0,58149191.0,57212231.0,57218615.0,57199377.0,59284978.0,57654495.0,56726059.0,59452210.0,59401486.0,58142921.0,60388321.0,56939117.0,61250168.0,56574771.0,57480802.0,58339161.0,59788369.0,58040318.0,57605241.0,58641391.0,56198499.0,59943735.0,58055631.0,59239610.0,58438516.0,58443994.0,60022111.0,57200925.0,56627532.0,57906487.0,57022995.0,57505197.0,59163050.0,54391122.0,58338005.0,61624038.0,56429249.0,58442056.0,57614149.0,60553260.0]} \ No newline at end of file diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/new/tukey.json b/criterion/below_cache_reuse/second_stroke_cache_reuse/new/tukey.json new file mode 100644 index 0000000..8e7bc91 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/new/tukey.json @@ -0,0 +1 @@ +[12847115.0625,13568961.09375,15493883.84375,16215729.875] \ No newline at end of file diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/report/MAD.svg b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/MAD.svg new file mode 100644 index 0000000..c16c9c9 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/MAD.svg @@ -0,0 +1,72 @@ + + +below_cache_reuse/second_stroke_cache_reuse:MAD + + +Density (a.u.) + + +Average time (µs) + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + + +250 + + + +300 + + + +350 + + + +400 + + + +450 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/report/SD.svg b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/SD.svg new file mode 100644 index 0000000..2264e6e --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/SD.svg @@ -0,0 +1,108 @@ + + +below_cache_reuse/second_stroke_cache_reuse:SD + + +Density (a.u.) + + +Average time (µs) + + + +0.001 + + + +0.002 + + + +0.003 + + + +0.004 + + + +0.005 + + + +0.006 + + + +0.007 + + + +0.008 + + + +0.009 + + + +0.01 + + + +0.011 + + + + +360 + + + +380 + + + +400 + + + +420 + + + +440 + + + +460 + + + +480 + + + +500 + + + +520 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/report/index.html b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/index.html new file mode 100644 index 0000000..275d1b3 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/index.html @@ -0,0 +1,193 @@ + + + + + + below_cache_reuse/second_stroke_cache_reuse - Criterion.rs + + + + +
+

below_cache_reuse/second_stroke_cache_reuse

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
R²0.01579140.01637150.0157366
Mean14.489 ms14.573 ms14.662 ms
Std. Dev.360.94 µs440.18 µs507.60 µs
Median14.410 ms14.451 ms14.557 ms
MAD233.40 µs306.01 µs439.28 µs
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probability of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the average time per iteration for the samples. Each point + represents one sample.

+

See the + documentation for more details on the additional statistics.

+
+
+
+ + + + \ No newline at end of file diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/report/iteration_times.svg b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/iteration_times.svg new file mode 100644 index 0000000..b41c4af --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/iteration_times.svg @@ -0,0 +1,184 @@ + + +below_cache_reuse/second_stroke_cache_reuse + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + +14.0 + + + +14.5 + + + +15.0 + + + +15.5 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + + diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/report/iteration_times_small.svg b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/iteration_times_small.svg new file mode 100644 index 0000000..ce123f7 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/iteration_times_small.svg @@ -0,0 +1,177 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + +14.0 + + + +14.5 + + + +15.0 + + + +15.5 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/report/mean.svg b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/mean.svg new file mode 100644 index 0000000..0e9cc45 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/mean.svg @@ -0,0 +1,108 @@ + + +below_cache_reuse/second_stroke_cache_reuse:mean + + +Density (a.u.) + + +Average time (ms) + + + +1 + + + +2 + + + +3 + + + +4 + + + +5 + + + +6 + + + +7 + + + +8 + + + +9 + + + + +14.48 + + + +14.5 + + + +14.52 + + + +14.54 + + + +14.56 + + + +14.58 + + + +14.6 + + + +14.62 + + + +14.64 + + + +14.66 + + + +14.68 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/report/median.svg b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/median.svg new file mode 100644 index 0000000..d1b2d8f --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/median.svg @@ -0,0 +1,84 @@ + + +below_cache_reuse/second_stroke_cache_reuse:median + + +Density (a.u.) + + +Average time (ms) + + + +5 + + + +10 + + + +15 + + + +20 + + + +25 + + + + +14.4 + + + +14.42 + + + +14.44 + + + +14.46 + + + +14.48 + + + +14.5 + + + +14.52 + + + +14.54 + + + +14.56 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/report/pdf.svg b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/pdf.svg new file mode 100644 index 0000000..d1ef255 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/pdf.svg @@ -0,0 +1,159 @@ + + +below_cache_reuse/second_stroke_cache_reuse + + +Iterations + + +Average Time (ms) + + + +0 + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + +4 + + + + +13.5 + + + +14 + + + +14.5 + + + +15 + + + +15.5 + + + +16 + + + +Density (a.u.) + + + +0 + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + +1 + + + + + + + + + + + + + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/report/pdf_small.svg b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/pdf_small.svg new file mode 100644 index 0000000..0a04ae1 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/pdf_small.svg @@ -0,0 +1,48 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0 + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + + +14 + + + +15 + + + +16 + + + + + diff --git a/criterion/below_cache_reuse/second_stroke_cache_reuse/report/typical.svg b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/typical.svg new file mode 100644 index 0000000..27a0491 --- /dev/null +++ b/criterion/below_cache_reuse/second_stroke_cache_reuse/report/typical.svg @@ -0,0 +1,108 @@ + + +below_cache_reuse/second_stroke_cache_reuse:typical + + +Density (a.u.) + + +Average time (ms) + + + +1 + + + +2 + + + +3 + + + +4 + + + +5 + + + +6 + + + +7 + + + +8 + + + +9 + + + + +14.48 + + + +14.5 + + + +14.52 + + + +14.54 + + + +14.56 + + + +14.58 + + + +14.6 + + + +14.62 + + + +14.64 + + + +14.66 + + + +14.68 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/composite_scratch_pooling/cold_composite/base/benchmark.json b/criterion/composite_scratch_pooling/cold_composite/base/benchmark.json new file mode 100644 index 0000000..2aa7bb5 --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/base/benchmark.json @@ -0,0 +1 @@ +{"group_id":"composite_scratch_pooling","function_id":"cold_composite","value_str":null,"throughput":null,"full_id":"composite_scratch_pooling/cold_composite","directory_name":"composite_scratch_pooling/cold_composite","title":"composite_scratch_pooling/cold_composite"} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/cold_composite/base/estimates.json b/criterion/composite_scratch_pooling/cold_composite/base/estimates.json new file mode 100644 index 0000000..4c11195 --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/base/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":812177406.29,"upper_bound":857389685.4535},"point_estimate":834486944.68,"standard_error":11495404.381205494},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":753737109.0,"upper_bound":766506110.0},"point_estimate":757074595.5,"standard_error":15857807.187801858},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":20968429.218935966,"upper_bound":54785502.7289629},"point_estimate":32723406.211343408,"standard_error":18347991.659907967},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":104116565.37937303,"upper_bound":124723900.34334047},"point_estimate":115441877.44917327,"standard_error":5215149.056436004}} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/cold_composite/base/sample.json b/criterion/composite_scratch_pooling/cold_composite/base/sample.json new file mode 100644 index 0000000..4a574a8 --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/base/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0],"times":[968619715.0,953627923.0,964541687.0,955168900.0,955717832.0,1022348923.0,965839588.0,1103478488.0,1034080999.0,950165158.0,956012404.0,959175353.0,966222089.0,977180444.0,975095845.0,959138267.0,1008696789.0,966282801.0,988549043.0,1010425104.0,969764812.0,950358931.0,993443001.0,950066156.0,944360183.0,960607173.0,942361182.0,955887554.0,952734176.0,954999194.0,997052828.0,953346204.0,945162531.0,1035485307.0,960848791.0,939055851.0,1125195702.0,963198525.0,731905787.0,764458461.0,729645027.0,731857131.0,739375996.0,733584526.0,738509146.0,746495790.0,764568053.0,751104982.0,747061408.0,742230172.0,745251281.0,754238195.0,740852823.0,754514600.0,753935651.0,746124575.0,729945665.0,756597494.0,738575150.0,717947736.0,739262456.0,728031313.0,735004616.0,749512342.0,761773639.0,734374504.0,738230335.0,754265206.0,751643954.0,736740556.0,756568457.0,759677820.0,754479818.0,742781581.0,753575353.0,754518077.0,749052781.0,763961053.0,758188943.0,761411664.0,769138847.0,732105094.0,750336235.0,745880463.0,747703486.0,757551697.0,752513334.0,760286523.0,746586523.0,768553759.0,745035539.0,741347243.0,735001304.0,730954649.0,736594714.0,729271515.0,764146545.0,753737109.0,751759311.0,754061008.0]} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/cold_composite/base/tukey.json b/criterion/composite_scratch_pooling/cold_composite/base/tukey.json new file mode 100644 index 0000000..54a96ef --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/base/tukey.json @@ -0,0 +1 @@ +[113508594.5,429352970.0,1271604638.0,1587449013.5] \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/cold_composite/gold_standard/benchmark.json b/criterion/composite_scratch_pooling/cold_composite/gold_standard/benchmark.json new file mode 100644 index 0000000..2aa7bb5 --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/gold_standard/benchmark.json @@ -0,0 +1 @@ +{"group_id":"composite_scratch_pooling","function_id":"cold_composite","value_str":null,"throughput":null,"full_id":"composite_scratch_pooling/cold_composite","directory_name":"composite_scratch_pooling/cold_composite","title":"composite_scratch_pooling/cold_composite"} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/cold_composite/gold_standard/estimates.json b/criterion/composite_scratch_pooling/cold_composite/gold_standard/estimates.json new file mode 100644 index 0000000..bb983c8 --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/gold_standard/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":1000498161.29825,"upper_bound":1099690001.8669999},"point_estimate":1048196884.82,"standard_error":25367730.011527233},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":934936845.0,"upper_bound":1051233781.0},"point_estimate":980892716.0,"standard_error":27134022.995351616},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":177003031.31002563,"upper_bound":306999435.59566045},"point_estimate":245161550.01531243,"standard_error":33985506.10896858},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":205921067.23108926,"upper_bound":304826695.59609365},"point_estimate":256849149.27776495,"standard_error":25157881.125520337}} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/cold_composite/gold_standard/sample.json b/criterion/composite_scratch_pooling/cold_composite/gold_standard/sample.json new file mode 100644 index 0000000..e1d9bfa --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/gold_standard/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0],"times":[923099625.0,921320537.0,824843569.0,885032478.0,900895392.0,1051233781.0,932208762.0,999381095.0,1052806204.0,1061894488.0,1088684665.0,1026156997.0,970041150.0,992728410.0,963334427.0,929496136.0,954705004.0,980612121.0,1011294246.0,1025284776.0,1057955115.0,950281769.0,983741477.0,1071953346.0,980491406.0,1067916469.0,1091671773.0,978887356.0,895437785.0,1025254703.0,934936845.0,944945338.0,981173311.0,909527857.0,839438515.0,850175785.0,909100614.0,896100351.0,798482215.0,788656880.0,786020039.0,783359749.0,790777260.0,806176031.0,809801070.0,818637745.0,875872393.0,941171790.0,826336772.0,821704791.0,785506329.0,792634355.0,801609253.0,787851280.0,793554572.0,799326910.0,823212033.0,792434451.0,794048259.0,804704164.0,805769800.0,809575864.0,788111106.0,802348229.0,782335356.0,794429035.0,1100516034.0,1149356151.0,1222619982.0,1185127595.0,1116905632.0,1241729911.0,1084361421.0,1053125618.0,1039174046.0,1128701069.0,1812978546.0,1181270028.0,1567076674.0,1536448943.0,1482078366.0,1599984505.0,2066423557.0,1366392465.0,1620498514.0,1543410483.0,1493344394.0,1231773106.0,1298556091.0,1514426126.0,1300489121.0,1211398841.0,1237395477.0,1278418182.0,1248865975.0,1243973433.0,1240671138.0,1297129039.0,1400353439.0,1256223171.0]} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/cold_composite/gold_standard/tukey.json b/criterion/composite_scratch_pooling/cold_composite/gold_standard/tukey.json new file mode 100644 index 0000000..4489321 --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/gold_standard/tukey.json @@ -0,0 +1 @@ +[-277343479.5,273546102.75,1742584988.75,2293474571.0] \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/cold_composite/new/benchmark.json b/criterion/composite_scratch_pooling/cold_composite/new/benchmark.json new file mode 100644 index 0000000..2aa7bb5 --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/new/benchmark.json @@ -0,0 +1 @@ +{"group_id":"composite_scratch_pooling","function_id":"cold_composite","value_str":null,"throughput":null,"full_id":"composite_scratch_pooling/cold_composite","directory_name":"composite_scratch_pooling/cold_composite","title":"composite_scratch_pooling/cold_composite"} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/cold_composite/new/estimates.json b/criterion/composite_scratch_pooling/cold_composite/new/estimates.json new file mode 100644 index 0000000..bb983c8 --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/new/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":1000498161.29825,"upper_bound":1099690001.8669999},"point_estimate":1048196884.82,"standard_error":25367730.011527233},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":934936845.0,"upper_bound":1051233781.0},"point_estimate":980892716.0,"standard_error":27134022.995351616},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":177003031.31002563,"upper_bound":306999435.59566045},"point_estimate":245161550.01531243,"standard_error":33985506.10896858},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":205921067.23108926,"upper_bound":304826695.59609365},"point_estimate":256849149.27776495,"standard_error":25157881.125520337}} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/cold_composite/new/sample.json b/criterion/composite_scratch_pooling/cold_composite/new/sample.json new file mode 100644 index 0000000..e1d9bfa --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/new/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0],"times":[923099625.0,921320537.0,824843569.0,885032478.0,900895392.0,1051233781.0,932208762.0,999381095.0,1052806204.0,1061894488.0,1088684665.0,1026156997.0,970041150.0,992728410.0,963334427.0,929496136.0,954705004.0,980612121.0,1011294246.0,1025284776.0,1057955115.0,950281769.0,983741477.0,1071953346.0,980491406.0,1067916469.0,1091671773.0,978887356.0,895437785.0,1025254703.0,934936845.0,944945338.0,981173311.0,909527857.0,839438515.0,850175785.0,909100614.0,896100351.0,798482215.0,788656880.0,786020039.0,783359749.0,790777260.0,806176031.0,809801070.0,818637745.0,875872393.0,941171790.0,826336772.0,821704791.0,785506329.0,792634355.0,801609253.0,787851280.0,793554572.0,799326910.0,823212033.0,792434451.0,794048259.0,804704164.0,805769800.0,809575864.0,788111106.0,802348229.0,782335356.0,794429035.0,1100516034.0,1149356151.0,1222619982.0,1185127595.0,1116905632.0,1241729911.0,1084361421.0,1053125618.0,1039174046.0,1128701069.0,1812978546.0,1181270028.0,1567076674.0,1536448943.0,1482078366.0,1599984505.0,2066423557.0,1366392465.0,1620498514.0,1543410483.0,1493344394.0,1231773106.0,1298556091.0,1514426126.0,1300489121.0,1211398841.0,1237395477.0,1278418182.0,1248865975.0,1243973433.0,1240671138.0,1297129039.0,1400353439.0,1256223171.0]} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/cold_composite/new/tukey.json b/criterion/composite_scratch_pooling/cold_composite/new/tukey.json new file mode 100644 index 0000000..4489321 --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/new/tukey.json @@ -0,0 +1 @@ +[-277343479.5,273546102.75,1742584988.75,2293474571.0] \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/cold_composite/report/MAD.svg b/criterion/composite_scratch_pooling/cold_composite/report/MAD.svg new file mode 100644 index 0000000..9f4b38d --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/report/MAD.svg @@ -0,0 +1,88 @@ + + +composite_scratch_pooling/cold_composite:MAD + + +Density (a.u.) + + +Average time (ms) + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + +0.014 + + + + +180 + + + +200 + + + +220 + + + +240 + + + +260 + + + +280 + + + +300 + + + +320 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/composite_scratch_pooling/cold_composite/report/SD.svg b/criterion/composite_scratch_pooling/cold_composite/report/SD.svg new file mode 100644 index 0000000..7bf8e18 --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/report/SD.svg @@ -0,0 +1,84 @@ + + +composite_scratch_pooling/cold_composite:SD + + +Density (a.u.) + + +Average time (ms) + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + +0.014 + + + +0.016 + + + + +200 + + + +220 + + + +240 + + + +260 + + + +280 + + + +300 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/composite_scratch_pooling/cold_composite/report/index.html b/criterion/composite_scratch_pooling/cold_composite/report/index.html new file mode 100644 index 0000000..9f33eae --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/report/index.html @@ -0,0 +1,193 @@ + + + + + + composite_scratch_pooling/cold_composite - Criterion.rs + + + + +
+

composite_scratch_pooling/cold_composite

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
R²0.00636210.00658230.0063271
Mean1.0005 s1.0482 s1.0997 s
Std. Dev.205.92 ms256.85 ms304.83 ms
Median934.94 ms980.89 ms1.0512 s
MAD177.00 ms245.16 ms307.00 ms
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probability of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the average time per iteration for the samples. Each point + represents one sample.

+

See the + documentation for more details on the additional statistics.

+
+
+
+ + + + \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/cold_composite/report/iteration_times.svg b/criterion/composite_scratch_pooling/cold_composite/report/iteration_times.svg new file mode 100644 index 0000000..5d443f4 --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/report/iteration_times.svg @@ -0,0 +1,199 @@ + + +composite_scratch_pooling/cold_composite + + +Average Iteration Time (s) + + + + + + + + + + + + + + + + + + + + +0.8 + + + +1.0 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + +2.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + + diff --git a/criterion/composite_scratch_pooling/cold_composite/report/iteration_times_small.svg b/criterion/composite_scratch_pooling/cold_composite/report/iteration_times_small.svg new file mode 100644 index 0000000..bd3211a --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/report/iteration_times_small.svg @@ -0,0 +1,192 @@ + + +Average Iteration Time (s) + + + + + + + + + + + + + + + + + + + + +0.8 + + + +1.0 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + +2.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/criterion/composite_scratch_pooling/cold_composite/report/mean.svg b/criterion/composite_scratch_pooling/cold_composite/report/mean.svg new file mode 100644 index 0000000..e57ed75 --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/report/mean.svg @@ -0,0 +1,84 @@ + + +composite_scratch_pooling/cold_composite:mean + + +Density (a.u.) + + +Average time (s) + + + +2 + + + +4 + + + +6 + + + +8 + + + +10 + + + +12 + + + +14 + + + +16 + + + + +1 + + + +1.02 + + + +1.04 + + + +1.06 + + + +1.08 + + + +1.1 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/composite_scratch_pooling/cold_composite/report/median.svg b/criterion/composite_scratch_pooling/cold_composite/report/median.svg new file mode 100644 index 0000000..1c72334 --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/report/median.svg @@ -0,0 +1,88 @@ + + +composite_scratch_pooling/cold_composite:median + + +Density (a.u.) + + +Average time (s) + + + +5 + + + +10 + + + +15 + + + +20 + + + +25 + + + +30 + + + +35 + + + +40 + + + + +0.94 + + + +0.96 + + + +0.98 + + + +1 + + + +1.02 + + + +1.04 + + + +1.06 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/composite_scratch_pooling/cold_composite/report/pdf.svg b/criterion/composite_scratch_pooling/cold_composite/report/pdf.svg new file mode 100644 index 0000000..88e0739 --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/report/pdf.svg @@ -0,0 +1,163 @@ + + +composite_scratch_pooling/cold_composite + + +Iterations + + +Average Time (s) + + + +0 + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + +1 + + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + +2 + + + +2.2 + + + +Density (a.u.) + + + +0 + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + + + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/criterion/composite_scratch_pooling/cold_composite/report/pdf_small.svg b/criterion/composite_scratch_pooling/cold_composite/report/pdf_small.svg new file mode 100644 index 0000000..c655768 --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/report/pdf_small.svg @@ -0,0 +1,68 @@ + + +Density (a.u.) + + +Average Time (s) + + + +0 + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + + + diff --git a/criterion/composite_scratch_pooling/cold_composite/report/typical.svg b/criterion/composite_scratch_pooling/cold_composite/report/typical.svg new file mode 100644 index 0000000..83d24cc --- /dev/null +++ b/criterion/composite_scratch_pooling/cold_composite/report/typical.svg @@ -0,0 +1,84 @@ + + +composite_scratch_pooling/cold_composite:typical + + +Density (a.u.) + + +Average time (s) + + + +2 + + + +4 + + + +6 + + + +8 + + + +10 + + + +12 + + + +14 + + + +16 + + + + +1 + + + +1.02 + + + +1.04 + + + +1.06 + + + +1.08 + + + +1.1 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/composite_scratch_pooling/report/index.html b/criterion/composite_scratch_pooling/report/index.html new file mode 100644 index 0000000..d7cff22 --- /dev/null +++ b/criterion/composite_scratch_pooling/report/index.html @@ -0,0 +1,116 @@ + + + + + + composite_scratch_pooling Summary - Criterion.rs + + + + +
+

composite_scratch_pooling

+

Violin Plot

+ + Violin Plot + +

This chart shows the relationship between function/parameter and iteration time. The thickness of the shaded + region indicates the probability that a measurement of the given function/parameter would take a particular + length of time.

+
+ +

composite_scratch_pooling/cold_composite

+ + + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+ +

composite_scratch_pooling/warm_composite

+ + + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+ + + + \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/report/violin.svg b/criterion/composite_scratch_pooling/report/violin.svg new file mode 100644 index 0000000..89c9fa8 --- /dev/null +++ b/criterion/composite_scratch_pooling/report/violin.svg @@ -0,0 +1,45 @@ + + +composite_scratch_pooling: Violin plot + + +Input + + +Average time (s) + + + +composite_scratch_pooling/warm_composite + + + +composite_scratch_pooling/cold_composite + + + + +0.0 + + + +0.5 + + + +1.0 + + + +1.5 + + + +2.0 + + + + + + + diff --git a/criterion/composite_scratch_pooling/warm_composite/base/benchmark.json b/criterion/composite_scratch_pooling/warm_composite/base/benchmark.json new file mode 100644 index 0000000..5ea831c --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/base/benchmark.json @@ -0,0 +1 @@ +{"group_id":"composite_scratch_pooling","function_id":"warm_composite","value_str":null,"throughput":null,"full_id":"composite_scratch_pooling/warm_composite","directory_name":"composite_scratch_pooling/warm_composite","title":"composite_scratch_pooling/warm_composite"} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/warm_composite/base/estimates.json b/criterion/composite_scratch_pooling/warm_composite/base/estimates.json new file mode 100644 index 0000000..66c4723 --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/base/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":8739193.281499999,"upper_bound":8836999.776666665},"point_estimate":8787918.621666668,"standard_error":24888.125751088177},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":8756321.833333334,"upper_bound":8835374.5},"point_estimate":8806424.166666668,"standard_error":18904.674435233715},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":127140.23719281005,"upper_bound":209397.84893244688},"point_estimate":167337.84672915752,"standard_error":20429.30194321241},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":201722.05613826346,"upper_bound":292081.34446231544},"point_estimate":249681.81711921998,"standard_error":23106.85080816357}} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/warm_composite/base/sample.json b/criterion/composite_scratch_pooling/warm_composite/base/sample.json new file mode 100644 index 0000000..f6a94da --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/base/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0],"times":[52882929.0,53468728.0,52656724.0,53263492.0,52984505.0,52974711.0,56264771.0,52641259.0,49729776.0,53588174.0,51841154.0,52012132.0,51690040.0,52240427.0,53558919.0,51787042.0,53059874.0,51744531.0,53897190.0,52537931.0,49548842.0,54476644.0,52219559.0,49668271.0,52495085.0,48807304.0,51486745.0,53542993.0,52183912.0,52445831.0,53069092.0,53582390.0,51013066.0,52829187.0,52847903.0,53252697.0,53511569.0,49078654.0,53353652.0,55582574.0,54164346.0,52031027.0,53519935.0,52245576.0,53449062.0,52977883.0,53610707.0,53623281.0,52878556.0,53049861.0,53161864.0,52917005.0,52253516.0,52733970.0,53039989.0,52366121.0,53238695.0,53449694.0,52122389.0,52800394.0,49211876.0,49969006.0,50581626.0,51356789.0,54580074.0,53363258.0,54342266.0,52418907.0,52797502.0,52536760.0,53550118.0,51567283.0,53375795.0,51736790.0,57073306.0,52462191.0,53600660.0,51757935.0,52981154.0,52482062.0,52810296.0,55966728.0,54667966.0,57154805.0,53311372.0,54154166.0,52564123.0,51129498.0,51124569.0,53537973.0,55569309.0,50729027.0,53005836.0,51301345.0,52536992.0,52115090.0,52897508.0,53296875.0,50948370.0,52729817.0]} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/warm_composite/base/tukey.json b/criterion/composite_scratch_pooling/warm_composite/base/tukey.json new file mode 100644 index 0000000..77748b8 --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/base/tukey.json @@ -0,0 +1 @@ +[8002156.583333332,8342251.145833333,9249169.979166668,9589264.54166667] \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/warm_composite/gold_standard/benchmark.json b/criterion/composite_scratch_pooling/warm_composite/gold_standard/benchmark.json new file mode 100644 index 0000000..5ea831c --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/gold_standard/benchmark.json @@ -0,0 +1 @@ +{"group_id":"composite_scratch_pooling","function_id":"warm_composite","value_str":null,"throughput":null,"full_id":"composite_scratch_pooling/warm_composite","directory_name":"composite_scratch_pooling/warm_composite","title":"composite_scratch_pooling/warm_composite"} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/warm_composite/gold_standard/estimates.json b/criterion/composite_scratch_pooling/warm_composite/gold_standard/estimates.json new file mode 100644 index 0000000..25412d9 --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/gold_standard/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":9856354.285599995,"upper_bound":10313847.4549},"point_estimate":10073839.414,"standard_error":116822.82503531317},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":9617188.2,"upper_bound":10150054.0},"point_estimate":10046595.5,"standard_error":147110.25133902175},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":823473.6834204189,"upper_bound":1353835.8694446085},"point_estimate":1137647.1443027258,"standard_error":139161.58345660588},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":859365.4333941842,"upper_bound":1493746.2934818633},"point_estimate":1171626.458718749,"standard_error":165429.36906611145}} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/warm_composite/gold_standard/sample.json b/criterion/composite_scratch_pooling/warm_composite/gold_standard/sample.json new file mode 100644 index 0000000..5161931 --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/gold_standard/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0],"times":[50336589.0,53354761.0,51253906.0,49338741.0,50323503.0,47437821.0,46203519.0,44796445.0,55620215.0,50514621.0,51657166.0,56317244.0,49115604.0,51061997.0,69947041.0,53166399.0,52243392.0,59365245.0,51775493.0,46453165.0,52307704.0,49617644.0,50727358.0,58850267.0,51168051.0,49357790.0,49138579.0,80022820.0,53954191.0,57312953.0,66078343.0,50675823.0,51585101.0,54446245.0,46339465.0,50581767.0,50142452.0,51723386.0,55221068.0,57689671.0,55854265.0,50827237.0,59355714.0,53500261.0,60513571.0,50773182.0,50488601.0,52116493.0,50658409.0,50699630.0,52174132.0,53294452.0,60080716.0,46558473.0,53915112.0,48509395.0,50669398.0,49528596.0,51212643.0,50958553.0,51502517.0,47210258.0,44916418.0,57754937.0,44496587.0,57007120.0,45073442.0,54324639.0,46755224.0,45377291.0,45232917.0,46089570.0,44929255.0,48085941.0,48798996.0,44753544.0,45355453.0,46240577.0,47742328.0,47165723.0,45213902.0,44517799.0,44704576.0,44574466.0,46319662.0,45262175.0,44128317.0,45617695.0,45693291.0,46721210.0,45513412.0,44329366.0,44829958.0,45150797.0,44171853.0,43907689.0,44321852.0,44596232.0,44624972.0,44995368.0]} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/warm_composite/gold_standard/tukey.json b/criterion/composite_scratch_pooling/warm_composite/gold_standard/tukey.json new file mode 100644 index 0000000..081837d --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/gold_standard/tukey.json @@ -0,0 +1 @@ +[5117617.3999999985,7117971.124999999,12452247.725000001,14452601.450000001] \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/warm_composite/new/benchmark.json b/criterion/composite_scratch_pooling/warm_composite/new/benchmark.json new file mode 100644 index 0000000..5ea831c --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/new/benchmark.json @@ -0,0 +1 @@ +{"group_id":"composite_scratch_pooling","function_id":"warm_composite","value_str":null,"throughput":null,"full_id":"composite_scratch_pooling/warm_composite","directory_name":"composite_scratch_pooling/warm_composite","title":"composite_scratch_pooling/warm_composite"} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/warm_composite/new/estimates.json b/criterion/composite_scratch_pooling/warm_composite/new/estimates.json new file mode 100644 index 0000000..25412d9 --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/new/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":9856354.285599995,"upper_bound":10313847.4549},"point_estimate":10073839.414,"standard_error":116822.82503531317},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":9617188.2,"upper_bound":10150054.0},"point_estimate":10046595.5,"standard_error":147110.25133902175},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":823473.6834204189,"upper_bound":1353835.8694446085},"point_estimate":1137647.1443027258,"standard_error":139161.58345660588},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":859365.4333941842,"upper_bound":1493746.2934818633},"point_estimate":1171626.458718749,"standard_error":165429.36906611145}} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/warm_composite/new/sample.json b/criterion/composite_scratch_pooling/warm_composite/new/sample.json new file mode 100644 index 0000000..5161931 --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/new/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0],"times":[50336589.0,53354761.0,51253906.0,49338741.0,50323503.0,47437821.0,46203519.0,44796445.0,55620215.0,50514621.0,51657166.0,56317244.0,49115604.0,51061997.0,69947041.0,53166399.0,52243392.0,59365245.0,51775493.0,46453165.0,52307704.0,49617644.0,50727358.0,58850267.0,51168051.0,49357790.0,49138579.0,80022820.0,53954191.0,57312953.0,66078343.0,50675823.0,51585101.0,54446245.0,46339465.0,50581767.0,50142452.0,51723386.0,55221068.0,57689671.0,55854265.0,50827237.0,59355714.0,53500261.0,60513571.0,50773182.0,50488601.0,52116493.0,50658409.0,50699630.0,52174132.0,53294452.0,60080716.0,46558473.0,53915112.0,48509395.0,50669398.0,49528596.0,51212643.0,50958553.0,51502517.0,47210258.0,44916418.0,57754937.0,44496587.0,57007120.0,45073442.0,54324639.0,46755224.0,45377291.0,45232917.0,46089570.0,44929255.0,48085941.0,48798996.0,44753544.0,45355453.0,46240577.0,47742328.0,47165723.0,45213902.0,44517799.0,44704576.0,44574466.0,46319662.0,45262175.0,44128317.0,45617695.0,45693291.0,46721210.0,45513412.0,44329366.0,44829958.0,45150797.0,44171853.0,43907689.0,44321852.0,44596232.0,44624972.0,44995368.0]} \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/warm_composite/new/tukey.json b/criterion/composite_scratch_pooling/warm_composite/new/tukey.json new file mode 100644 index 0000000..081837d --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/new/tukey.json @@ -0,0 +1 @@ +[5117617.3999999985,7117971.124999999,12452247.725000001,14452601.450000001] \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/warm_composite/report/MAD.svg b/criterion/composite_scratch_pooling/warm_composite/report/MAD.svg new file mode 100644 index 0000000..f595c49 --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/report/MAD.svg @@ -0,0 +1,84 @@ + + +composite_scratch_pooling/warm_composite:MAD + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + + +0.8 + + + +0.9 + + + +1 + + + +1.1 + + + +1.2 + + + +1.3 + + + +1.4 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/composite_scratch_pooling/warm_composite/report/SD.svg b/criterion/composite_scratch_pooling/warm_composite/report/SD.svg new file mode 100644 index 0000000..547f4a1 --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/report/SD.svg @@ -0,0 +1,80 @@ + + +composite_scratch_pooling/warm_composite:SD + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + + +0.8 + + + +0.9 + + + +1 + + + +1.1 + + + +1.2 + + + +1.3 + + + +1.4 + + + +1.5 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/composite_scratch_pooling/warm_composite/report/index.html b/criterion/composite_scratch_pooling/warm_composite/report/index.html new file mode 100644 index 0000000..8752447 --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/report/index.html @@ -0,0 +1,193 @@ + + + + + + composite_scratch_pooling/warm_composite - Criterion.rs + + + + +
+

composite_scratch_pooling/warm_composite

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
R²0.00814710.00842830.0080883
Mean9.8564 ms10.074 ms10.314 ms
Std. Dev.859.37 µs1.1716 ms1.4937 ms
Median9.6172 ms10.047 ms10.150 ms
MAD823.47 µs1.1376 ms1.3538 ms
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probability of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the average time per iteration for the samples. Each point + represents one sample.

+

See the + documentation for more details on the additional statistics.

+
+
+
+ + + + \ No newline at end of file diff --git a/criterion/composite_scratch_pooling/warm_composite/report/iteration_times.svg b/criterion/composite_scratch_pooling/warm_composite/report/iteration_times.svg new file mode 100644 index 0000000..1521029 --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/report/iteration_times.svg @@ -0,0 +1,204 @@ + + +composite_scratch_pooling/warm_composite + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + +9.0 + + + +10.0 + + + +11.0 + + + +12.0 + + + +13.0 + + + +14.0 + + + +15.0 + + + +16.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + + diff --git a/criterion/composite_scratch_pooling/warm_composite/report/iteration_times_small.svg b/criterion/composite_scratch_pooling/warm_composite/report/iteration_times_small.svg new file mode 100644 index 0000000..018d3fe --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/report/iteration_times_small.svg @@ -0,0 +1,197 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + +9.0 + + + +10.0 + + + +11.0 + + + +12.0 + + + +13.0 + + + +14.0 + + + +15.0 + + + +16.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/criterion/composite_scratch_pooling/warm_composite/report/mean.svg b/criterion/composite_scratch_pooling/warm_composite/report/mean.svg new file mode 100644 index 0000000..bb576e7 --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/report/mean.svg @@ -0,0 +1,100 @@ + + +composite_scratch_pooling/warm_composite:mean + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + + +9.85 + + + +9.9 + + + +9.95 + + + +10 + + + +10.05 + + + +10.1 + + + +10.15 + + + +10.2 + + + +10.25 + + + +10.3 + + + +10.35 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/composite_scratch_pooling/warm_composite/report/median.svg b/criterion/composite_scratch_pooling/warm_composite/report/median.svg new file mode 100644 index 0000000..d7d5f6b --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/report/median.svg @@ -0,0 +1,96 @@ + + +composite_scratch_pooling/warm_composite:median + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + +4 + + + +4.5 + + + +5 + + + + +9.6 + + + +9.7 + + + +9.8 + + + +9.9 + + + +10 + + + +10.1 + + + +10.2 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/composite_scratch_pooling/warm_composite/report/pdf.svg b/criterion/composite_scratch_pooling/warm_composite/report/pdf.svg new file mode 100644 index 0000000..497a0a0 --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/report/pdf.svg @@ -0,0 +1,165 @@ + + +composite_scratch_pooling/warm_composite + + +Iterations + + +Average Time (ms) + + + +0 + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + +4 + + + +4.5 + + + +5 + + + + +8 + + + +9 + + + +10 + + + +11 + + + +12 + + + +13 + + + +14 + + + +15 + + + +16 + + + +17 + + + +Density (a.u.) + + + +0 + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + +0.35 + + + + + + + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/criterion/composite_scratch_pooling/warm_composite/report/pdf_small.svg b/criterion/composite_scratch_pooling/warm_composite/report/pdf_small.svg new file mode 100644 index 0000000..d68caa2 --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/report/pdf_small.svg @@ -0,0 +1,64 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0 + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + +0.35 + + + + +8 + + + +10 + + + +12 + + + +14 + + + +16 + + + + + diff --git a/criterion/composite_scratch_pooling/warm_composite/report/typical.svg b/criterion/composite_scratch_pooling/warm_composite/report/typical.svg new file mode 100644 index 0000000..679c24e --- /dev/null +++ b/criterion/composite_scratch_pooling/warm_composite/report/typical.svg @@ -0,0 +1,100 @@ + + +composite_scratch_pooling/warm_composite:typical + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + + +9.85 + + + +9.9 + + + +9.95 + + + +10 + + + +10.05 + + + +10.1 + + + +10.15 + + + +10.2 + + + +10.25 + + + +10.3 + + + +10.35 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/effects_skip/no_effects_composite/base/benchmark.json b/criterion/effects_skip/no_effects_composite/base/benchmark.json new file mode 100644 index 0000000..f203c7a --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/base/benchmark.json @@ -0,0 +1 @@ +{"group_id":"effects_skip","function_id":"no_effects_composite","value_str":null,"throughput":null,"full_id":"effects_skip/no_effects_composite","directory_name":"effects_skip/no_effects_composite","title":"effects_skip/no_effects_composite"} \ No newline at end of file diff --git a/criterion/effects_skip/no_effects_composite/base/estimates.json b/criterion/effects_skip/no_effects_composite/base/estimates.json new file mode 100644 index 0000000..9496e53 --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/base/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":13901288.715,"upper_bound":14001873.6375},"point_estimate":13950669.475,"standard_error":25603.975760750767},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":13854098.75,"upper_bound":13966037.75},"point_estimate":13900019.25,"standard_error":26058.9377434986},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":143698.88511070982,"upper_bound":285231.478536129},"point_estimate":201941.79188981652,"standard_error":36905.72917854722},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":213895.24134239493,"upper_bound":295793.3361530977},"point_estimate":257762.6060915311,"standard_error":21018.794855795608}} \ No newline at end of file diff --git a/criterion/effects_skip/no_effects_composite/base/sample.json b/criterion/effects_skip/no_effects_composite/base/sample.json new file mode 100644 index 0000000..079a81e --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/base/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[57231994.0,54410897.0,54649608.0,54606701.0,54261974.0,55516470.0,55596995.0,54408492.0,56036968.0,54454837.0,56869134.0,56482999.0,55332725.0,55324855.0,54542073.0,58552445.0,55422220.0,57214981.0,55264484.0,54513183.0,58568049.0,58647597.0,54762499.0,54131480.0,55178742.0,54871270.0,55442147.0,54242344.0,58154401.0,55280317.0,57149799.0,58132938.0,54984578.0,56032958.0,56078387.0,55639863.0,55410390.0,57091713.0,56036830.0,56824012.0,55749050.0,55603159.0,54258456.0,54598492.0,56935667.0,56299411.0,55526082.0,56048950.0,56746038.0,54848604.0,54838650.0,55014421.0,55349822.0,55534369.0,55387294.0,55810086.0,56130415.0,56080207.0,55458986.0,55560383.0,55175957.0,57087939.0,55320370.0,56642204.0,54591272.0,56660491.0,55360749.0,55330827.0,55342368.0,55422400.0,55927640.0,58605137.0,56507648.0,55633993.0,55323381.0,54286898.0,56224640.0,55352583.0,55801800.0,55864151.0,55883964.0,55380766.0,56238104.0,55220225.0,56813185.0,55885003.0,55756210.0,54930120.0,56599494.0,57036000.0,56067334.0,55628149.0,56350661.0,54777599.0,55592656.0,55623183.0,56159402.0,55873236.0,57568149.0,55289011.0]} \ No newline at end of file diff --git a/criterion/effects_skip/no_effects_composite/base/tukey.json b/criterion/effects_skip/no_effects_composite/base/tukey.json new file mode 100644 index 0000000..e3edfe0 --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/base/tukey.json @@ -0,0 +1 @@ +[13063346.1875,13438350.5,14438362.0,14813366.3125] \ No newline at end of file diff --git a/criterion/effects_skip/no_effects_composite/gold_standard/benchmark.json b/criterion/effects_skip/no_effects_composite/gold_standard/benchmark.json new file mode 100644 index 0000000..f203c7a --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/gold_standard/benchmark.json @@ -0,0 +1 @@ +{"group_id":"effects_skip","function_id":"no_effects_composite","value_str":null,"throughput":null,"full_id":"effects_skip/no_effects_composite","directory_name":"effects_skip/no_effects_composite","title":"effects_skip/no_effects_composite"} \ No newline at end of file diff --git a/criterion/effects_skip/no_effects_composite/gold_standard/estimates.json b/criterion/effects_skip/no_effects_composite/gold_standard/estimates.json new file mode 100644 index 0000000..2863e1b --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/gold_standard/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14294604.633000001,"upper_bound":14389322.2345625},"point_estimate":14340411.3025,"standard_error":24177.99057768436},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14285229.75,"upper_bound":14356321.5},"point_estimate":14320755.625,"standard_error":17394.833163515425},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":120027.21671909094,"upper_bound":244679.59401419366},"point_estimate":181111.07693463564,"standard_error":31398.747757507397},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":187703.49900049344,"upper_bound":299589.1466900533},"point_estimate":244056.43934057056,"standard_error":28823.595616845265}} \ No newline at end of file diff --git a/criterion/effects_skip/no_effects_composite/gold_standard/sample.json b/criterion/effects_skip/no_effects_composite/gold_standard/sample.json new file mode 100644 index 0000000..dc6e613 --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/gold_standard/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[58004265.0,57571569.0,56740285.0,56345215.0,57835922.0,57856142.0,57995132.0,57174474.0,56640869.0,55955863.0,57355358.0,56581148.0,58265228.0,56515654.0,57008567.0,57285399.0,56993187.0,58033819.0,57243585.0,57291172.0,57678512.0,57276293.0,57465095.0,56124245.0,58315014.0,57378915.0,56327800.0,57339464.0,58436405.0,57354666.0,57781340.0,57296883.0,57192051.0,56768093.0,57030356.0,59359611.0,58138253.0,57517661.0,56866666.0,57732023.0,57559429.0,57018157.0,58993877.0,56079843.0,57407203.0,57248943.0,55815506.0,56366337.0,56834579.0,56661208.0,57083330.0,55670280.0,57196927.0,56546313.0,57063868.0,61706759.0,57614266.0,57532974.0,57135259.0,56904224.0,57443369.0,56966608.0,57164424.0,57794160.0,59562684.0,57034356.0,57022130.0,55500368.0,57204984.0,58601376.0,56278696.0,56976429.0,57335217.0,57466929.0,56892624.0,57489816.0,57411725.0,56250651.0,57119501.0,58154668.0,57761967.0,58073155.0,59677603.0,58729310.0,58529661.0,56191187.0,57280646.0,56352662.0,55557715.0,57140919.0,56287717.0,57535999.0,58175172.0,57909381.0,60387017.0,58315409.0,57904059.0,56051189.0,56421526.0,57700031.0]} \ No newline at end of file diff --git a/criterion/effects_skip/no_effects_composite/gold_standard/tukey.json b/criterion/effects_skip/no_effects_composite/gold_standard/tukey.json new file mode 100644 index 0000000..e3ec4bd --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/gold_standard/tukey.json @@ -0,0 +1 @@ +[13520235.5,13867448.28125,14793349.03125,15140561.8125] \ No newline at end of file diff --git a/criterion/effects_skip/no_effects_composite/new/benchmark.json b/criterion/effects_skip/no_effects_composite/new/benchmark.json new file mode 100644 index 0000000..f203c7a --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/new/benchmark.json @@ -0,0 +1 @@ +{"group_id":"effects_skip","function_id":"no_effects_composite","value_str":null,"throughput":null,"full_id":"effects_skip/no_effects_composite","directory_name":"effects_skip/no_effects_composite","title":"effects_skip/no_effects_composite"} \ No newline at end of file diff --git a/criterion/effects_skip/no_effects_composite/new/estimates.json b/criterion/effects_skip/no_effects_composite/new/estimates.json new file mode 100644 index 0000000..2863e1b --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/new/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14294604.633000001,"upper_bound":14389322.2345625},"point_estimate":14340411.3025,"standard_error":24177.99057768436},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14285229.75,"upper_bound":14356321.5},"point_estimate":14320755.625,"standard_error":17394.833163515425},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":120027.21671909094,"upper_bound":244679.59401419366},"point_estimate":181111.07693463564,"standard_error":31398.747757507397},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":187703.49900049344,"upper_bound":299589.1466900533},"point_estimate":244056.43934057056,"standard_error":28823.595616845265}} \ No newline at end of file diff --git a/criterion/effects_skip/no_effects_composite/new/sample.json b/criterion/effects_skip/no_effects_composite/new/sample.json new file mode 100644 index 0000000..dc6e613 --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/new/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[58004265.0,57571569.0,56740285.0,56345215.0,57835922.0,57856142.0,57995132.0,57174474.0,56640869.0,55955863.0,57355358.0,56581148.0,58265228.0,56515654.0,57008567.0,57285399.0,56993187.0,58033819.0,57243585.0,57291172.0,57678512.0,57276293.0,57465095.0,56124245.0,58315014.0,57378915.0,56327800.0,57339464.0,58436405.0,57354666.0,57781340.0,57296883.0,57192051.0,56768093.0,57030356.0,59359611.0,58138253.0,57517661.0,56866666.0,57732023.0,57559429.0,57018157.0,58993877.0,56079843.0,57407203.0,57248943.0,55815506.0,56366337.0,56834579.0,56661208.0,57083330.0,55670280.0,57196927.0,56546313.0,57063868.0,61706759.0,57614266.0,57532974.0,57135259.0,56904224.0,57443369.0,56966608.0,57164424.0,57794160.0,59562684.0,57034356.0,57022130.0,55500368.0,57204984.0,58601376.0,56278696.0,56976429.0,57335217.0,57466929.0,56892624.0,57489816.0,57411725.0,56250651.0,57119501.0,58154668.0,57761967.0,58073155.0,59677603.0,58729310.0,58529661.0,56191187.0,57280646.0,56352662.0,55557715.0,57140919.0,56287717.0,57535999.0,58175172.0,57909381.0,60387017.0,58315409.0,57904059.0,56051189.0,56421526.0,57700031.0]} \ No newline at end of file diff --git a/criterion/effects_skip/no_effects_composite/new/tukey.json b/criterion/effects_skip/no_effects_composite/new/tukey.json new file mode 100644 index 0000000..e3ec4bd --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/new/tukey.json @@ -0,0 +1 @@ +[13520235.5,13867448.28125,14793349.03125,15140561.8125] \ No newline at end of file diff --git a/criterion/effects_skip/no_effects_composite/report/MAD.svg b/criterion/effects_skip/no_effects_composite/report/MAD.svg new file mode 100644 index 0000000..8990456 --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/report/MAD.svg @@ -0,0 +1,84 @@ + + +effects_skip/no_effects_composite:MAD + + +Density (a.u.) + + +Average time (µs) + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + +0.014 + + + + +120 + + + +140 + + + +160 + + + +180 + + + +200 + + + +220 + + + +240 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/effects_skip/no_effects_composite/report/SD.svg b/criterion/effects_skip/no_effects_composite/report/SD.svg new file mode 100644 index 0000000..9be4277 --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/report/SD.svg @@ -0,0 +1,84 @@ + + +effects_skip/no_effects_composite:SD + + +Density (a.u.) + + +Average time (µs) + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + +0.014 + + + + +180 + + + +200 + + + +220 + + + +240 + + + +260 + + + +280 + + + +300 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/effects_skip/no_effects_composite/report/index.html b/criterion/effects_skip/no_effects_composite/report/index.html new file mode 100644 index 0000000..d68f557 --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/report/index.html @@ -0,0 +1,193 @@ + + + + + + effects_skip/no_effects_composite - Criterion.rs + + + + +
+

effects_skip/no_effects_composite

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
R²0.00117060.00121220.0011650
Mean14.295 ms14.340 ms14.389 ms
Std. Dev.187.70 µs244.06 µs299.59 µs
Median14.285 ms14.321 ms14.356 ms
MAD120.03 µs181.11 µs244.68 µs
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probability of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the average time per iteration for the samples. Each point + represents one sample.

+

See the + documentation for more details on the additional statistics.

+
+
+
+ + + + \ No newline at end of file diff --git a/criterion/effects_skip/no_effects_composite/report/iteration_times.svg b/criterion/effects_skip/no_effects_composite/report/iteration_times.svg new file mode 100644 index 0000000..17b0908 --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/report/iteration_times.svg @@ -0,0 +1,204 @@ + + +effects_skip/no_effects_composite + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + +14.0 + + + +14.2 + + + +14.4 + + + +14.6 + + + +14.8 + + + +15.0 + + + +15.2 + + + +15.4 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + + diff --git a/criterion/effects_skip/no_effects_composite/report/iteration_times_small.svg b/criterion/effects_skip/no_effects_composite/report/iteration_times_small.svg new file mode 100644 index 0000000..e0ecb09 --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/report/iteration_times_small.svg @@ -0,0 +1,197 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + +14.0 + + + +14.2 + + + +14.4 + + + +14.6 + + + +14.8 + + + +15.0 + + + +15.2 + + + +15.4 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/criterion/effects_skip/no_effects_composite/report/mean.svg b/criterion/effects_skip/no_effects_composite/report/mean.svg new file mode 100644 index 0000000..95bf1e8 --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/report/mean.svg @@ -0,0 +1,108 @@ + + +effects_skip/no_effects_composite:mean + + +Density (a.u.) + + +Average time (ms) + + + +2 + + + +4 + + + +6 + + + +8 + + + +10 + + + +12 + + + +14 + + + +16 + + + +18 + + + + +14.29 + + + +14.3 + + + +14.31 + + + +14.32 + + + +14.33 + + + +14.34 + + + +14.35 + + + +14.36 + + + +14.37 + + + +14.38 + + + +14.39 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/effects_skip/no_effects_composite/report/median.svg b/criterion/effects_skip/no_effects_composite/report/median.svg new file mode 100644 index 0000000..2bcb76f --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/report/median.svg @@ -0,0 +1,104 @@ + + +effects_skip/no_effects_composite:median + + +Density (a.u.) + + +Average time (ms) + + + +5 + + + +10 + + + +15 + + + +20 + + + +25 + + + +30 + + + +35 + + + +40 + + + +45 + + + +50 + + + + +14.28 + + + +14.29 + + + +14.3 + + + +14.31 + + + +14.32 + + + +14.33 + + + +14.34 + + + +14.35 + + + +14.36 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/effects_skip/no_effects_composite/report/pdf.svg b/criterion/effects_skip/no_effects_composite/report/pdf.svg new file mode 100644 index 0000000..161eac4 --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/report/pdf.svg @@ -0,0 +1,173 @@ + + +effects_skip/no_effects_composite + + +Iterations + + +Average Time (ms) + + + +0 + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + +4 + + + + +13.6 + + + +13.8 + + + +14 + + + +14.2 + + + +14.4 + + + +14.6 + + + +14.8 + + + +15 + + + +15.2 + + + +15.4 + + + +15.6 + + + +Density (a.u.) + + + +0 + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + + + + + + + + + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/criterion/effects_skip/no_effects_composite/report/pdf_small.svg b/criterion/effects_skip/no_effects_composite/report/pdf_small.svg new file mode 100644 index 0000000..4090889 --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/report/pdf_small.svg @@ -0,0 +1,72 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0 + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + +2 + + + + +14 + + + +14.5 + + + +15 + + + +15.5 + + + + + diff --git a/criterion/effects_skip/no_effects_composite/report/typical.svg b/criterion/effects_skip/no_effects_composite/report/typical.svg new file mode 100644 index 0000000..96c66c1 --- /dev/null +++ b/criterion/effects_skip/no_effects_composite/report/typical.svg @@ -0,0 +1,108 @@ + + +effects_skip/no_effects_composite:typical + + +Density (a.u.) + + +Average time (ms) + + + +2 + + + +4 + + + +6 + + + +8 + + + +10 + + + +12 + + + +14 + + + +16 + + + +18 + + + + +14.29 + + + +14.3 + + + +14.31 + + + +14.32 + + + +14.33 + + + +14.34 + + + +14.35 + + + +14.36 + + + +14.37 + + + +14.38 + + + +14.39 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/effects_skip/report/index.html b/criterion/effects_skip/report/index.html new file mode 100644 index 0000000..4d042e1 --- /dev/null +++ b/criterion/effects_skip/report/index.html @@ -0,0 +1,116 @@ + + + + + + effects_skip Summary - Criterion.rs + + + + +
+

effects_skip

+

Violin Plot

+ + Violin Plot + +

This chart shows the relationship between function/parameter and iteration time. The thickness of the shaded + region indicates the probability that a measurement of the given function/parameter would take a particular + length of time.

+
+ +

effects_skip/no_effects_composite

+ + + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+ +

effects_skip/with_one_dropshadow

+ + + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+ + + + \ No newline at end of file diff --git a/criterion/effects_skip/report/violin.svg b/criterion/effects_skip/report/violin.svg new file mode 100644 index 0000000..9d89259 --- /dev/null +++ b/criterion/effects_skip/report/violin.svg @@ -0,0 +1,69 @@ + + +effects_skip: Violin plot + + +Input + + +Average time (ms) + + + +effects_skip/with_one_dropshadow + + + +effects_skip/no_effects_composite + + + + +0.0 + + + +2.0 + + + +4.0 + + + +6.0 + + + +8.0 + + + +10.0 + + + +12.0 + + + +14.0 + + + +16.0 + + + +18.0 + + + +20.0 + + + + + + + diff --git a/criterion/effects_skip/with_one_dropshadow/base/benchmark.json b/criterion/effects_skip/with_one_dropshadow/base/benchmark.json new file mode 100644 index 0000000..1bc82f5 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/base/benchmark.json @@ -0,0 +1 @@ +{"group_id":"effects_skip","function_id":"with_one_dropshadow","value_str":null,"throughput":null,"full_id":"effects_skip/with_one_dropshadow","directory_name":"effects_skip/with_one_dropshadow","title":"effects_skip/with_one_dropshadow"} \ No newline at end of file diff --git a/criterion/effects_skip/with_one_dropshadow/base/estimates.json b/criterion/effects_skip/with_one_dropshadow/base/estimates.json new file mode 100644 index 0000000..18492bd --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/base/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":13780018.134249998,"upper_bound":13886297.5913125},"point_estimate":13831975.0225,"standard_error":27133.41577161727},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":13741697.5,"upper_bound":13811362.125},"point_estimate":13780321.875,"standard_error":17225.82142598741},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":132409.15039926767,"upper_bound":275279.7115378082},"point_estimate":185821.85302600265,"standard_error":36808.44593337942},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":215011.03392536283,"upper_bound":324976.4551425306},"point_estimate":272760.8761748222,"standard_error":28160.285445702797}} \ No newline at end of file diff --git a/criterion/effects_skip/with_one_dropshadow/base/sample.json b/criterion/effects_skip/with_one_dropshadow/base/sample.json new file mode 100644 index 0000000..7dc6cf5 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/base/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[54861430.0,54893747.0,53296402.0,53977667.0,53474748.0,55125587.0,54109010.0,54769099.0,55107979.0,55089067.0,57821518.0,55823397.0,54812259.0,53816738.0,55116988.0,55471276.0,53855473.0,54945921.0,54738381.0,54962294.0,54125289.0,54946319.0,55909456.0,54287850.0,54896936.0,55410020.0,56504693.0,55379341.0,56949453.0,54688496.0,53975037.0,54310496.0,55285917.0,54829871.0,54540912.0,55034836.0,59459671.0,57353579.0,55491898.0,55394812.0,55629353.0,56027751.0,54671809.0,54792737.0,54008854.0,55442001.0,55801488.0,54966790.0,55764241.0,53742810.0,54563791.0,54664281.0,58218452.0,56072922.0,54259347.0,55057395.0,55607029.0,55201875.0,55950066.0,54402746.0,56800177.0,57118308.0,55615903.0,55197033.0,54338008.0,54705991.0,58541592.0,55151891.0,55186875.0,56934765.0,56567596.0,56371464.0,55701872.0,55188896.0,55559738.0,55204980.0,55228175.0,55333369.0,56099120.0,56094326.0,54207246.0,55081896.0,55725828.0,54952028.0,56250569.0,55012403.0,55075716.0,56144847.0,54369012.0,54208808.0,55159733.0,54981546.0,56091866.0,54911882.0,58432327.0,56480956.0,55173976.0,54178027.0,54954720.0,54766943.0]} \ No newline at end of file diff --git a/criterion/effects_skip/with_one_dropshadow/base/tukey.json b/criterion/effects_skip/with_one_dropshadow/base/tukey.json new file mode 100644 index 0000000..d76c6f7 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/base/tukey.json @@ -0,0 +1 @@ +[12900118.9375,13291344.90625,14334614.15625,14725840.125] \ No newline at end of file diff --git a/criterion/effects_skip/with_one_dropshadow/gold_standard/benchmark.json b/criterion/effects_skip/with_one_dropshadow/gold_standard/benchmark.json new file mode 100644 index 0000000..1bc82f5 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/gold_standard/benchmark.json @@ -0,0 +1 @@ +{"group_id":"effects_skip","function_id":"with_one_dropshadow","value_str":null,"throughput":null,"full_id":"effects_skip/with_one_dropshadow","directory_name":"effects_skip/with_one_dropshadow","title":"effects_skip/with_one_dropshadow"} \ No newline at end of file diff --git a/criterion/effects_skip/with_one_dropshadow/gold_standard/estimates.json b/criterion/effects_skip/with_one_dropshadow/gold_standard/estimates.json new file mode 100644 index 0000000..9bc6f17 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/gold_standard/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14610490.7725,"upper_bound":14980479.253625},"point_estimate":14780582.065,"standard_error":94488.98974178794},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14374457.75,"upper_bound":14577650.375},"point_estimate":14451439.0,"standard_error":52764.118565748424},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":253802.95364409685,"upper_bound":516612.5399689188},"point_estimate":344235.25098860264,"standard_error":74136.30974615621},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":595903.8369936231,"upper_bound":1259962.175133716},"point_estimate":950078.9865659074,"standard_error":169450.9269726278}} \ No newline at end of file diff --git a/criterion/effects_skip/with_one_dropshadow/gold_standard/sample.json b/criterion/effects_skip/with_one_dropshadow/gold_standard/sample.json new file mode 100644 index 0000000..942e580 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/gold_standard/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[57497831.0,57109815.0,57551266.0,57267756.0,59279166.0,56894826.0,58340318.0,57319374.0,58299858.0,57358404.0,56508915.0,57198289.0,58461688.0,56629557.0,59443830.0,56812491.0,59628054.0,56303437.0,57493925.0,57808885.0,57921916.0,56209446.0,57672872.0,57087202.0,58854740.0,60339261.0,57365801.0,59590917.0,58531767.0,72047043.0,60201098.0,59619308.0,59663946.0,56609250.0,56940240.0,57064319.0,57588525.0,57808537.0,57184693.0,57433898.0,57265018.0,56643724.0,56438764.0,57445407.0,57678384.0,58123993.0,58241989.0,59444667.0,62727362.0,60699840.0,56476319.0,58445234.0,58501287.0,58379214.0,57218787.0,56879477.0,56318485.0,56057294.0,63593487.0,58637132.0,57662576.0,62155537.0,58307243.0,57151104.0,56539251.0,57802975.0,56416493.0,57555165.0,57755367.0,60968624.0,56220327.0,58066245.0,56867104.0,59952791.0,57157854.0,57958813.0,56804628.0,56481887.0,57606167.0,56910867.0,58062921.0,57212470.0,61006821.0,58452680.0,57421635.0,59632485.0,62793605.0,65366322.0,67146792.0,75411752.0,64206487.0,62795317.0,63134330.0,61618679.0,59730290.0,59690721.0,62589356.0,56874567.0,69477370.0,79108880.0]} \ No newline at end of file diff --git a/criterion/effects_skip/with_one_dropshadow/gold_standard/tukey.json b/criterion/effects_skip/with_one_dropshadow/gold_standard/tukey.json new file mode 100644 index 0000000..97b56d9 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/gold_standard/tukey.json @@ -0,0 +1 @@ +[12418910.4375,13352052.9375,15840432.9375,16773575.4375] \ No newline at end of file diff --git a/criterion/effects_skip/with_one_dropshadow/new/benchmark.json b/criterion/effects_skip/with_one_dropshadow/new/benchmark.json new file mode 100644 index 0000000..1bc82f5 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/new/benchmark.json @@ -0,0 +1 @@ +{"group_id":"effects_skip","function_id":"with_one_dropshadow","value_str":null,"throughput":null,"full_id":"effects_skip/with_one_dropshadow","directory_name":"effects_skip/with_one_dropshadow","title":"effects_skip/with_one_dropshadow"} \ No newline at end of file diff --git a/criterion/effects_skip/with_one_dropshadow/new/estimates.json b/criterion/effects_skip/with_one_dropshadow/new/estimates.json new file mode 100644 index 0000000..9bc6f17 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/new/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14610490.7725,"upper_bound":14980479.253625},"point_estimate":14780582.065,"standard_error":94488.98974178794},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14374457.75,"upper_bound":14577650.375},"point_estimate":14451439.0,"standard_error":52764.118565748424},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":253802.95364409685,"upper_bound":516612.5399689188},"point_estimate":344235.25098860264,"standard_error":74136.30974615621},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":595903.8369936231,"upper_bound":1259962.175133716},"point_estimate":950078.9865659074,"standard_error":169450.9269726278}} \ No newline at end of file diff --git a/criterion/effects_skip/with_one_dropshadow/new/sample.json b/criterion/effects_skip/with_one_dropshadow/new/sample.json new file mode 100644 index 0000000..942e580 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/new/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[57497831.0,57109815.0,57551266.0,57267756.0,59279166.0,56894826.0,58340318.0,57319374.0,58299858.0,57358404.0,56508915.0,57198289.0,58461688.0,56629557.0,59443830.0,56812491.0,59628054.0,56303437.0,57493925.0,57808885.0,57921916.0,56209446.0,57672872.0,57087202.0,58854740.0,60339261.0,57365801.0,59590917.0,58531767.0,72047043.0,60201098.0,59619308.0,59663946.0,56609250.0,56940240.0,57064319.0,57588525.0,57808537.0,57184693.0,57433898.0,57265018.0,56643724.0,56438764.0,57445407.0,57678384.0,58123993.0,58241989.0,59444667.0,62727362.0,60699840.0,56476319.0,58445234.0,58501287.0,58379214.0,57218787.0,56879477.0,56318485.0,56057294.0,63593487.0,58637132.0,57662576.0,62155537.0,58307243.0,57151104.0,56539251.0,57802975.0,56416493.0,57555165.0,57755367.0,60968624.0,56220327.0,58066245.0,56867104.0,59952791.0,57157854.0,57958813.0,56804628.0,56481887.0,57606167.0,56910867.0,58062921.0,57212470.0,61006821.0,58452680.0,57421635.0,59632485.0,62793605.0,65366322.0,67146792.0,75411752.0,64206487.0,62795317.0,63134330.0,61618679.0,59730290.0,59690721.0,62589356.0,56874567.0,69477370.0,79108880.0]} \ No newline at end of file diff --git a/criterion/effects_skip/with_one_dropshadow/new/tukey.json b/criterion/effects_skip/with_one_dropshadow/new/tukey.json new file mode 100644 index 0000000..97b56d9 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/new/tukey.json @@ -0,0 +1 @@ +[12418910.4375,13352052.9375,15840432.9375,16773575.4375] \ No newline at end of file diff --git a/criterion/effects_skip/with_one_dropshadow/report/MAD.svg b/criterion/effects_skip/with_one_dropshadow/report/MAD.svg new file mode 100644 index 0000000..aec08c2 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/report/MAD.svg @@ -0,0 +1,80 @@ + + +effects_skip/with_one_dropshadow:MAD + + +Density (a.u.) + + +Average time (µs) + + + +0.001 + + + +0.002 + + + +0.003 + + + +0.004 + + + +0.005 + + + +0.006 + + + +0.007 + + + + +250 + + + +300 + + + +350 + + + +400 + + + +450 + + + +500 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/effects_skip/with_one_dropshadow/report/SD.svg b/criterion/effects_skip/with_one_dropshadow/report/SD.svg new file mode 100644 index 0000000..601ea17 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/report/SD.svg @@ -0,0 +1,80 @@ + + +effects_skip/with_one_dropshadow:SD + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + +1 + + + +1.1 + + + +1.2 + + + +1.3 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/effects_skip/with_one_dropshadow/report/index.html b/criterion/effects_skip/with_one_dropshadow/report/index.html new file mode 100644 index 0000000..a6e2164 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/report/index.html @@ -0,0 +1,193 @@ + + + + + + effects_skip/with_one_dropshadow - Criterion.rs + + + + +
+

effects_skip/with_one_dropshadow

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
R²0.21298410.21837370.2109991
Mean14.610 ms14.781 ms14.980 ms
Std. Dev.595.90 µs950.08 µs1.2600 ms
Median14.374 ms14.451 ms14.578 ms
MAD253.80 µs344.24 µs516.61 µs
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probability of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the average time per iteration for the samples. Each point + represents one sample.

+

See the + documentation for more details on the additional statistics.

+
+
+
+ + + + \ No newline at end of file diff --git a/criterion/effects_skip/with_one_dropshadow/report/iteration_times.svg b/criterion/effects_skip/with_one_dropshadow/report/iteration_times.svg new file mode 100644 index 0000000..d4f9cc4 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/report/iteration_times.svg @@ -0,0 +1,219 @@ + + +effects_skip/with_one_dropshadow + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + + + +14.5 + + + +15.0 + + + +15.5 + + + +16.0 + + + +16.5 + + + +17.0 + + + +17.5 + + + +18.0 + + + +18.5 + + + +19.0 + + + +19.5 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + + diff --git a/criterion/effects_skip/with_one_dropshadow/report/iteration_times_small.svg b/criterion/effects_skip/with_one_dropshadow/report/iteration_times_small.svg new file mode 100644 index 0000000..f85cbf9 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/report/iteration_times_small.svg @@ -0,0 +1,212 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + + + +14.5 + + + +15.0 + + + +15.5 + + + +16.0 + + + +16.5 + + + +17.0 + + + +17.5 + + + +18.0 + + + +18.5 + + + +19.0 + + + +19.5 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/criterion/effects_skip/with_one_dropshadow/report/mean.svg b/criterion/effects_skip/with_one_dropshadow/report/mean.svg new file mode 100644 index 0000000..203a604 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/report/mean.svg @@ -0,0 +1,96 @@ + + +effects_skip/with_one_dropshadow:mean + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + +4 + + + +4.5 + + + + +14.6 + + + +14.65 + + + +14.7 + + + +14.75 + + + +14.8 + + + +14.85 + + + +14.9 + + + +14.95 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/effects_skip/with_one_dropshadow/report/median.svg b/criterion/effects_skip/with_one_dropshadow/report/median.svg new file mode 100644 index 0000000..81ca904 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/report/median.svg @@ -0,0 +1,76 @@ + + +effects_skip/with_one_dropshadow:median + + +Density (a.u.) + + +Average time (ms) + + + +2 + + + +4 + + + +6 + + + +8 + + + +10 + + + +12 + + + +14 + + + + +14.4 + + + +14.45 + + + +14.5 + + + +14.55 + + + +14.6 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/effects_skip/with_one_dropshadow/report/pdf.svg b/criterion/effects_skip/with_one_dropshadow/report/pdf.svg new file mode 100644 index 0000000..d0d8e1c --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/report/pdf.svg @@ -0,0 +1,155 @@ + + +effects_skip/with_one_dropshadow + + +Iterations + + +Average Time (ms) + + + +0 + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + +4 + + + + +13 + + + +14 + + + +15 + + + +16 + + + +17 + + + +18 + + + +19 + + + +20 + + + +Density (a.u.) + + + +0 + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + + + + + + + + + + + + + + + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/criterion/effects_skip/with_one_dropshadow/report/pdf_small.svg b/criterion/effects_skip/with_one_dropshadow/report/pdf_small.svg new file mode 100644 index 0000000..581b5a4 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/report/pdf_small.svg @@ -0,0 +1,60 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0 + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + + +14 + + + +16 + + + +18 + + + +20 + + + + + diff --git a/criterion/effects_skip/with_one_dropshadow/report/typical.svg b/criterion/effects_skip/with_one_dropshadow/report/typical.svg new file mode 100644 index 0000000..f9f9b25 --- /dev/null +++ b/criterion/effects_skip/with_one_dropshadow/report/typical.svg @@ -0,0 +1,96 @@ + + +effects_skip/with_one_dropshadow:typical + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + +4 + + + +4.5 + + + + +14.6 + + + +14.65 + + + +14.7 + + + +14.75 + + + +14.8 + + + +14.85 + + + +14.9 + + + +14.95 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/report/index.html b/criterion/report/index.html new file mode 100644 index 0000000..d030098 --- /dev/null +++ b/criterion/report/index.html @@ -0,0 +1,99 @@ + + + + + + Index - Criterion.rs + + + + +
+

Criterion.rs Benchmark Index

+ See individual benchmark pages below for more details. + +
+ + + \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/base/benchmark.json b/criterion/stroke_mask_pooling/cold_first_stroke/base/benchmark.json new file mode 100644 index 0000000..81fb672 --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/base/benchmark.json @@ -0,0 +1 @@ +{"group_id":"stroke_mask_pooling","function_id":"cold_first_stroke","value_str":null,"throughput":null,"full_id":"stroke_mask_pooling/cold_first_stroke","directory_name":"stroke_mask_pooling/cold_first_stroke","title":"stroke_mask_pooling/cold_first_stroke"} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/base/estimates.json b/criterion/stroke_mask_pooling/cold_first_stroke/base/estimates.json new file mode 100644 index 0000000..352f0b8 --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/base/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":29327261.09,"upper_bound":29674045.147749998},"point_estimate":29495829.7,"standard_error":88714.3578004953},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":29094156.0,"upper_bound":29345121.5},"point_estimate":29217192.5,"standard_error":60163.9402983977},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":418843.3881640434,"upper_bound":820378.1629353762},"point_estimate":573864.7827118635,"standard_error":98905.20419995091},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":703634.7941635476,"upper_bound":1053580.2717513547},"point_estimate":891766.1017041047,"standard_error":89508.08261851824}} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/base/sample.json b/criterion/stroke_mask_pooling/cold_first_stroke/base/sample.json new file mode 100644 index 0000000..817820d --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/base/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0],"times":[28637392.0,29216981.0,28863190.0,29112921.0,29433556.0,30371264.0,28916351.0,29234783.0,29203517.0,28980009.0,30892478.0,29517597.0,29217404.0,29227988.0,28757329.0,30366144.0,31477375.0,29819273.0,29110495.0,28566313.0,29151315.0,28989577.0,31052386.0,30176380.0,30804525.0,28773441.0,28424822.0,29315579.0,29263307.0,30130566.0,32570086.0,28775920.0,29201849.0,28760213.0,30839758.0,30397426.0,32554962.0,28591965.0,28857205.0,28855819.0,28547046.0,30058398.0,30141964.0,29080935.0,29044572.0,28655034.0,29580813.0,29466754.0,30800985.0,29325184.0,28871328.0,28831901.0,29365059.0,29700909.0,28483833.0,29380346.0,28828351.0,28698098.0,30162535.0,29384834.0,29647080.0,30821370.0,28514933.0,29206278.0,28642535.0,29571994.0,30225811.0,32014529.0,29222453.0,29138325.0,29094156.0,29284080.0,30631467.0,29940314.0,28559486.0,28716625.0,28905092.0,28952604.0,30235009.0,31875136.0,29084437.0,28735696.0,28613815.0,28879410.0,29387138.0,30925484.0,29025860.0,28899118.0,28923410.0,28969724.0,29861448.0,29329496.0,29253705.0,29117492.0,28875948.0,28778876.0,29574906.0,30060646.0,30224279.0,29044465.0]} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/base/tukey.json b/criterion/stroke_mask_pooling/cold_first_stroke/base/tukey.json new file mode 100644 index 0000000..9a595c5 --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/base/tukey.json @@ -0,0 +1 @@ +[25589667.0,27232230.0,31612398.0,33254961.0] \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/benchmark.json b/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/benchmark.json new file mode 100644 index 0000000..81fb672 --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/benchmark.json @@ -0,0 +1 @@ +{"group_id":"stroke_mask_pooling","function_id":"cold_first_stroke","value_str":null,"throughput":null,"full_id":"stroke_mask_pooling/cold_first_stroke","directory_name":"stroke_mask_pooling/cold_first_stroke","title":"stroke_mask_pooling/cold_first_stroke"} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/estimates.json b/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/estimates.json new file mode 100644 index 0000000..f584f3a --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":45757132.2795,"upper_bound":47119417.908250004},"point_estimate":46427571.0,"standard_error":346247.92108471284},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":45537847.5,"upper_bound":46396334.0},"point_estimate":46001341.5,"standard_error":201526.6485855393},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":1439871.442437172,"upper_bound":2779889.776647091},"point_estimate":2041476.4119565487,"standard_error":373447.75423074444},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":2648638.504946559,"upper_bound":4245406.138727979},"point_estimate":3480424.040201351,"standard_error":408328.72579061694}} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/sample.json b/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/sample.json new file mode 100644 index 0000000..8b712e6 --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0],"times":[44891931.0,48812016.0,43197056.0,32784577.0,42208114.0,46714991.0,50149305.0,46586652.0,45419971.0,47093693.0,47906444.0,42065659.0,46799403.0,45743811.0,43232951.0,42278196.0,53674302.0,41282744.0,44763710.0,48238622.0,43505720.0,50323408.0,45989813.0,45586220.0,47567808.0,45382019.0,45131475.0,55279189.0,44994776.0,49124716.0,46396334.0,44077196.0,46609222.0,48817581.0,46385473.0,42797679.0,43416321.0,45197144.0,46116545.0,45365182.0,43208955.0,45655724.0,47104251.0,46111164.0,47173782.0,42861999.0,46031434.0,50895936.0,45678195.0,47172023.0,43504107.0,46728868.0,55667836.0,58716319.0,45793750.0,45287857.0,44380485.0,44041862.0,40469582.0,46029201.0,45560256.0,48446902.0,48475712.0,45805927.0,44280830.0,46071054.0,44846173.0,44965418.0,44912807.0,44230565.0,44996636.0,47558358.0,46628112.0,46699375.0,45077346.0,46122340.0,45932517.0,55424103.0,43945992.0,53605945.0,54329464.0,47517624.0,44928584.0,43856496.0,45906471.0,46787986.0,46018637.0,45489763.0,48026004.0,46836824.0,47753807.0,47926474.0,45094797.0,50469106.0,49821528.0,52789408.0,47567418.0,43578348.0,46012870.0,44037824.0]} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/tukey.json b/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/tukey.json new file mode 100644 index 0000000..85f68cc --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/tukey.json @@ -0,0 +1 @@ +[36840097.0,40860294.25,51580820.25,55601017.5] \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/new/benchmark.json b/criterion/stroke_mask_pooling/cold_first_stroke/new/benchmark.json new file mode 100644 index 0000000..81fb672 --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/new/benchmark.json @@ -0,0 +1 @@ +{"group_id":"stroke_mask_pooling","function_id":"cold_first_stroke","value_str":null,"throughput":null,"full_id":"stroke_mask_pooling/cold_first_stroke","directory_name":"stroke_mask_pooling/cold_first_stroke","title":"stroke_mask_pooling/cold_first_stroke"} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/new/estimates.json b/criterion/stroke_mask_pooling/cold_first_stroke/new/estimates.json new file mode 100644 index 0000000..f584f3a --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/new/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":45757132.2795,"upper_bound":47119417.908250004},"point_estimate":46427571.0,"standard_error":346247.92108471284},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":45537847.5,"upper_bound":46396334.0},"point_estimate":46001341.5,"standard_error":201526.6485855393},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":1439871.442437172,"upper_bound":2779889.776647091},"point_estimate":2041476.4119565487,"standard_error":373447.75423074444},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":2648638.504946559,"upper_bound":4245406.138727979},"point_estimate":3480424.040201351,"standard_error":408328.72579061694}} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/new/sample.json b/criterion/stroke_mask_pooling/cold_first_stroke/new/sample.json new file mode 100644 index 0000000..8b712e6 --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/new/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0],"times":[44891931.0,48812016.0,43197056.0,32784577.0,42208114.0,46714991.0,50149305.0,46586652.0,45419971.0,47093693.0,47906444.0,42065659.0,46799403.0,45743811.0,43232951.0,42278196.0,53674302.0,41282744.0,44763710.0,48238622.0,43505720.0,50323408.0,45989813.0,45586220.0,47567808.0,45382019.0,45131475.0,55279189.0,44994776.0,49124716.0,46396334.0,44077196.0,46609222.0,48817581.0,46385473.0,42797679.0,43416321.0,45197144.0,46116545.0,45365182.0,43208955.0,45655724.0,47104251.0,46111164.0,47173782.0,42861999.0,46031434.0,50895936.0,45678195.0,47172023.0,43504107.0,46728868.0,55667836.0,58716319.0,45793750.0,45287857.0,44380485.0,44041862.0,40469582.0,46029201.0,45560256.0,48446902.0,48475712.0,45805927.0,44280830.0,46071054.0,44846173.0,44965418.0,44912807.0,44230565.0,44996636.0,47558358.0,46628112.0,46699375.0,45077346.0,46122340.0,45932517.0,55424103.0,43945992.0,53605945.0,54329464.0,47517624.0,44928584.0,43856496.0,45906471.0,46787986.0,46018637.0,45489763.0,48026004.0,46836824.0,47753807.0,47926474.0,45094797.0,50469106.0,49821528.0,52789408.0,47567418.0,43578348.0,46012870.0,44037824.0]} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/new/tukey.json b/criterion/stroke_mask_pooling/cold_first_stroke/new/tukey.json new file mode 100644 index 0000000..85f68cc --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/new/tukey.json @@ -0,0 +1 @@ +[36840097.0,40860294.25,51580820.25,55601017.5] \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/report/MAD.svg b/criterion/stroke_mask_pooling/cold_first_stroke/report/MAD.svg new file mode 100644 index 0000000..e9cbd49 --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/report/MAD.svg @@ -0,0 +1,88 @@ + + +stroke_mask_pooling/cold_first_stroke:MAD + + +Density (a.u.) + + +Average time (ms) + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + + +1.4 + + + +1.6 + + + +1.8 + + + +2 + + + +2.2 + + + +2.4 + + + +2.6 + + + +2.8 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/report/SD.svg b/criterion/stroke_mask_pooling/cold_first_stroke/report/SD.svg new file mode 100644 index 0000000..5a4875d --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/report/SD.svg @@ -0,0 +1,108 @@ + + +stroke_mask_pooling/cold_first_stroke:SD + + +Density (a.u.) + + +Average time (ms) + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + +1 + + + + +2.6 + + + +2.8 + + + +3 + + + +3.2 + + + +3.4 + + + +3.6 + + + +3.8 + + + +4 + + + +4.2 + + + +4.4 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/report/index.html b/criterion/stroke_mask_pooling/cold_first_stroke/report/index.html new file mode 100644 index 0000000..47b6ebb --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/report/index.html @@ -0,0 +1,193 @@ + + + + + + stroke_mask_pooling/cold_first_stroke - Criterion.rs + + + + +
+

stroke_mask_pooling/cold_first_stroke

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
R²0.00456910.00473960.0045585
Mean45.757 ms46.428 ms47.119 ms
Std. Dev.2.6486 ms3.4804 ms4.2454 ms
Median45.538 ms46.001 ms46.396 ms
MAD1.4399 ms2.0415 ms2.7799 ms
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probability of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the average time per iteration for the samples. Each point + represents one sample.

+

See the + documentation for more details on the additional statistics.

+
+
+
+ + + + \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/report/iteration_times.svg b/criterion/stroke_mask_pooling/cold_first_stroke/report/iteration_times.svg new file mode 100644 index 0000000..584f65e --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/report/iteration_times.svg @@ -0,0 +1,189 @@ + + +stroke_mask_pooling/cold_first_stroke + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + +35.0 + + + +40.0 + + + +45.0 + + + +50.0 + + + +55.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + + diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/report/iteration_times_small.svg b/criterion/stroke_mask_pooling/cold_first_stroke/report/iteration_times_small.svg new file mode 100644 index 0000000..8ec0544 --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/report/iteration_times_small.svg @@ -0,0 +1,182 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + +35.0 + + + +40.0 + + + +45.0 + + + +50.0 + + + +55.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/report/mean.svg b/criterion/stroke_mask_pooling/cold_first_stroke/report/mean.svg new file mode 100644 index 0000000..12aa3ec --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/report/mean.svg @@ -0,0 +1,84 @@ + + +stroke_mask_pooling/cold_first_stroke:mean + + +Density (a.u.) + + +Average time (ms) + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + + +45.8 + + + +46 + + + +46.2 + + + +46.4 + + + +46.6 + + + +46.8 + + + +47 + + + +47.2 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/report/median.svg b/criterion/stroke_mask_pooling/cold_first_stroke/report/median.svg new file mode 100644 index 0000000..330e2ae --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/report/median.svg @@ -0,0 +1,112 @@ + + +stroke_mask_pooling/cold_first_stroke:median + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + +4 + + + +4.5 + + + +5 + + + +5.5 + + + + +45.5 + + + +45.6 + + + +45.7 + + + +45.8 + + + +45.9 + + + +46 + + + +46.1 + + + +46.2 + + + +46.3 + + + +46.4 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/report/pdf.svg b/criterion/stroke_mask_pooling/cold_first_stroke/report/pdf.svg new file mode 100644 index 0000000..1178e5a --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/report/pdf.svg @@ -0,0 +1,167 @@ + + +stroke_mask_pooling/cold_first_stroke + + +Iterations + + +Average Time (ms) + + + +0 + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + +1 + + + + +30 + + + +35 + + + +40 + + + +45 + + + +50 + + + +55 + + + +60 + + + +Density (a.u.) + + + +0 + + + +0.02 + + + +0.04 + + + +0.06 + + + +0.08 + + + +0.1 + + + +0.12 + + + +0.14 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/report/pdf_small.svg b/criterion/stroke_mask_pooling/cold_first_stroke/report/pdf_small.svg new file mode 100644 index 0000000..f606d51 --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/report/pdf_small.svg @@ -0,0 +1,64 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0 + + + +0.02 + + + +0.04 + + + +0.06 + + + +0.08 + + + +0.1 + + + +0.12 + + + +0.14 + + + +0.16 + + + + +30 + + + +40 + + + +50 + + + +60 + + + + + diff --git a/criterion/stroke_mask_pooling/cold_first_stroke/report/typical.svg b/criterion/stroke_mask_pooling/cold_first_stroke/report/typical.svg new file mode 100644 index 0000000..138bb80 --- /dev/null +++ b/criterion/stroke_mask_pooling/cold_first_stroke/report/typical.svg @@ -0,0 +1,84 @@ + + +stroke_mask_pooling/cold_first_stroke:typical + + +Density (a.u.) + + +Average time (ms) + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + + +45.8 + + + +46 + + + +46.2 + + + +46.4 + + + +46.6 + + + +46.8 + + + +47 + + + +47.2 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/stroke_mask_pooling/report/index.html b/criterion/stroke_mask_pooling/report/index.html new file mode 100644 index 0000000..2856b81 --- /dev/null +++ b/criterion/stroke_mask_pooling/report/index.html @@ -0,0 +1,116 @@ + + + + + + stroke_mask_pooling Summary - Criterion.rs + + + + +
+

stroke_mask_pooling

+

Violin Plot

+ + Violin Plot + +

This chart shows the relationship between function/parameter and iteration time. The thickness of the shaded + region indicates the probability that a measurement of the given function/parameter would take a particular + length of time.

+
+ +

stroke_mask_pooling/cold_first_stroke

+ + + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+ +

stroke_mask_pooling/warm_10th_stroke

+ + + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+ + + + \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/report/violin.svg b/criterion/stroke_mask_pooling/report/violin.svg new file mode 100644 index 0000000..a7c9bd6 --- /dev/null +++ b/criterion/stroke_mask_pooling/report/violin.svg @@ -0,0 +1,53 @@ + + +stroke_mask_pooling: Violin plot + + +Input + + +Average time (ms) + + + +stroke_mask_pooling/warm_10th_stroke + + + +stroke_mask_pooling/cold_first_stroke + + + + +0.0 + + + +10.0 + + + +20.0 + + + +30.0 + + + +40.0 + + + +50.0 + + + +60.0 + + + + + + + diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/base/benchmark.json b/criterion/stroke_mask_pooling/warm_10th_stroke/base/benchmark.json new file mode 100644 index 0000000..c115f88 --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/base/benchmark.json @@ -0,0 +1 @@ +{"group_id":"stroke_mask_pooling","function_id":"warm_10th_stroke","value_str":null,"throughput":null,"full_id":"stroke_mask_pooling/warm_10th_stroke","directory_name":"stroke_mask_pooling/warm_10th_stroke","title":"stroke_mask_pooling/warm_10th_stroke"} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/base/estimates.json b/criterion/stroke_mask_pooling/warm_10th_stroke/base/estimates.json new file mode 100644 index 0000000..0823ac5 --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/base/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14346648.215937499,"upper_bound":14554805.603374999},"point_estimate":14448395.26,"standard_error":52914.66380788922},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14184305.375,"upper_bound":14494901.25},"point_estimate":14323320.25,"standard_error":89004.7531738194},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":356848.47026467323,"upper_bound":632578.706869483},"point_estimate":515189.9621285498,"standard_error":72914.79278205201},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":447832.24359681195,"upper_bound":603314.2671876643},"point_estimate":531308.8055791821,"standard_error":39649.80876608677}} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/base/sample.json b/criterion/stroke_mask_pooling/warm_10th_stroke/base/sample.json new file mode 100644 index 0000000..8bf5e3a --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/base/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[56765408.0,58612771.0,56791526.0,55447885.0,55846858.0,57658546.0,59674371.0,56553146.0,56277880.0,59916482.0,58988942.0,58422098.0,63063018.0,58648340.0,55575008.0,56688974.0,55474637.0,58015789.0,57417520.0,55572256.0,55926671.0,55022096.0,56374298.0,61340279.0,56001505.0,59973432.0,58598430.0,64383914.0,55856550.0,62388534.0,57916426.0,59266612.0,61226779.0,60206355.0,55607115.0,55857124.0,57310268.0,62345197.0,57979605.0,57605369.0,55474332.0,56346047.0,60781644.0,59553390.0,56208890.0,56945407.0,57276294.0,61953561.0,59622238.0,57193233.0,55339496.0,54908429.0,55404016.0,59023539.0,59482788.0,56108905.0,58208484.0,57636275.0,56785469.0,55718719.0,57547543.0,61633557.0,59338886.0,59183864.0,56088945.0,55700010.0,56230035.0,58847176.0,56311892.0,56814755.0,57491463.0,58960605.0,62440350.0,56794224.0,58807772.0,56871424.0,56062250.0,56932503.0,56212623.0,55857245.0,58033278.0,55742171.0,58619007.0,56256108.0,59001307.0,59136587.0,62019606.0,57850386.0,55902594.0,55469764.0,59636141.0,62118552.0,58193630.0,55904041.0,55925169.0,56025568.0,55638259.0,58297147.0,56319295.0,56573202.0]} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/base/tukey.json b/criterion/stroke_mask_pooling/warm_10th_stroke/base/tukey.json new file mode 100644 index 0000000..8a01cec --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/base/tukey.json @@ -0,0 +1 @@ +[11797930.75,12905600.3125,15859385.8125,16967055.375] \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/benchmark.json b/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/benchmark.json new file mode 100644 index 0000000..c115f88 --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/benchmark.json @@ -0,0 +1 @@ +{"group_id":"stroke_mask_pooling","function_id":"warm_10th_stroke","value_str":null,"throughput":null,"full_id":"stroke_mask_pooling/warm_10th_stroke","directory_name":"stroke_mask_pooling/warm_10th_stroke","title":"stroke_mask_pooling/warm_10th_stroke"} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/estimates.json b/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/estimates.json new file mode 100644 index 0000000..ecf1818 --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":16523211.678250005,"upper_bound":17014151.842833336},"point_estimate":16749901.79666667,"standard_error":125530.15838596656},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":16292685.0,"upper_bound":16706545.166666666},"point_estimate":16482146.833333332,"standard_error":110352.59700561242},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":583994.8941320172,"upper_bound":1042081.2209993606},"point_estimate":797708.220937849,"standard_error":116125.74405557872},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":769183.2300756236,"upper_bound":1704752.3266124448},"point_estimate":1262355.3007423256,"standard_error":240590.86290816558}} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/sample.json b/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/sample.json new file mode 100644 index 0000000..7f1c7f9 --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0],"times":[50824375.0,51891667.0,47341278.0,67677605.0,48368119.0,49152372.0,47133474.0,48640140.0,46616024.0,47670724.0,50260488.0,49453566.0,48624419.0,53405563.0,49987121.0,48167116.0,46952003.0,48179742.0,50611749.0,48283099.0,52009723.0,50497387.0,55440776.0,46895530.0,49095492.0,54786397.0,54750780.0,49043734.0,49252373.0,51282440.0,48470599.0,49810265.0,46342575.0,56221825.0,48066432.0,46736017.0,53148217.0,47300573.0,52032031.0,48083239.0,46115840.0,48744676.0,48878055.0,51308400.0,46559493.0,50038577.0,47138908.0,51424688.0,49463077.0,50522816.0,61609532.0,50200694.0,47015432.0,46005418.0,71311953.0,50429827.0,48611280.0,51361836.0,50049372.0,52086649.0,52792760.0,48215701.0,49487693.0,53681330.0,49429548.0,48630421.0,52349603.0,46229362.0,48605442.0,49046555.0,52766499.0,46800566.0,50952953.0,49243977.0,47911447.0,48742906.0,52684403.0,49109108.0,46631849.0,49439315.0,46789021.0,52111765.0,49839839.0,52449040.0,51075193.0,51045969.0,50338279.0,50000312.0,48870274.0,47461074.0,53190820.0,52727744.0,48537850.0,54932681.0,51012589.0,51171194.0,47299142.0,49946661.0,48491579.0,47544503.0]} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/tukey.json b/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/tukey.json new file mode 100644 index 0000000..b30beb3 --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/tukey.json @@ -0,0 +1 @@ +[12913688.333333336,14486275.083333336,18679839.75,20252426.5] \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/new/benchmark.json b/criterion/stroke_mask_pooling/warm_10th_stroke/new/benchmark.json new file mode 100644 index 0000000..c115f88 --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/new/benchmark.json @@ -0,0 +1 @@ +{"group_id":"stroke_mask_pooling","function_id":"warm_10th_stroke","value_str":null,"throughput":null,"full_id":"stroke_mask_pooling/warm_10th_stroke","directory_name":"stroke_mask_pooling/warm_10th_stroke","title":"stroke_mask_pooling/warm_10th_stroke"} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/new/estimates.json b/criterion/stroke_mask_pooling/warm_10th_stroke/new/estimates.json new file mode 100644 index 0000000..ecf1818 --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/new/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":16523211.678250005,"upper_bound":17014151.842833336},"point_estimate":16749901.79666667,"standard_error":125530.15838596656},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":16292685.0,"upper_bound":16706545.166666666},"point_estimate":16482146.833333332,"standard_error":110352.59700561242},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":583994.8941320172,"upper_bound":1042081.2209993606},"point_estimate":797708.220937849,"standard_error":116125.74405557872},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":769183.2300756236,"upper_bound":1704752.3266124448},"point_estimate":1262355.3007423256,"standard_error":240590.86290816558}} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/new/sample.json b/criterion/stroke_mask_pooling/warm_10th_stroke/new/sample.json new file mode 100644 index 0000000..7f1c7f9 --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/new/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0],"times":[50824375.0,51891667.0,47341278.0,67677605.0,48368119.0,49152372.0,47133474.0,48640140.0,46616024.0,47670724.0,50260488.0,49453566.0,48624419.0,53405563.0,49987121.0,48167116.0,46952003.0,48179742.0,50611749.0,48283099.0,52009723.0,50497387.0,55440776.0,46895530.0,49095492.0,54786397.0,54750780.0,49043734.0,49252373.0,51282440.0,48470599.0,49810265.0,46342575.0,56221825.0,48066432.0,46736017.0,53148217.0,47300573.0,52032031.0,48083239.0,46115840.0,48744676.0,48878055.0,51308400.0,46559493.0,50038577.0,47138908.0,51424688.0,49463077.0,50522816.0,61609532.0,50200694.0,47015432.0,46005418.0,71311953.0,50429827.0,48611280.0,51361836.0,50049372.0,52086649.0,52792760.0,48215701.0,49487693.0,53681330.0,49429548.0,48630421.0,52349603.0,46229362.0,48605442.0,49046555.0,52766499.0,46800566.0,50952953.0,49243977.0,47911447.0,48742906.0,52684403.0,49109108.0,46631849.0,49439315.0,46789021.0,52111765.0,49839839.0,52449040.0,51075193.0,51045969.0,50338279.0,50000312.0,48870274.0,47461074.0,53190820.0,52727744.0,48537850.0,54932681.0,51012589.0,51171194.0,47299142.0,49946661.0,48491579.0,47544503.0]} \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/new/tukey.json b/criterion/stroke_mask_pooling/warm_10th_stroke/new/tukey.json new file mode 100644 index 0000000..b30beb3 --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/new/tukey.json @@ -0,0 +1 @@ +[12913688.333333336,14486275.083333336,18679839.75,20252426.5] \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/report/MAD.svg b/criterion/stroke_mask_pooling/warm_10th_stroke/report/MAD.svg new file mode 100644 index 0000000..7db537b --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/report/MAD.svg @@ -0,0 +1,100 @@ + + +stroke_mask_pooling/warm_10th_stroke:MAD + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + + +0.55 + + + +0.6 + + + +0.65 + + + +0.7 + + + +0.75 + + + +0.8 + + + +0.85 + + + +0.9 + + + +0.95 + + + +1 + + + +1.05 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/report/SD.svg b/criterion/stroke_mask_pooling/warm_10th_stroke/report/SD.svg new file mode 100644 index 0000000..58e0709 --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/report/SD.svg @@ -0,0 +1,88 @@ + + +stroke_mask_pooling/warm_10th_stroke:SD + + +Density (a.u.) + + +Average time (ms) + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/report/index.html b/criterion/stroke_mask_pooling/warm_10th_stroke/report/index.html new file mode 100644 index 0000000..b8454a5 --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/report/index.html @@ -0,0 +1,193 @@ + + + + + + stroke_mask_pooling/warm_10th_stroke - Criterion.rs + + + + +
+

stroke_mask_pooling/warm_10th_stroke

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
R²0.00496680.00512770.0049115
Mean16.523 ms16.750 ms17.014 ms
Std. Dev.769.18 µs1.2624 ms1.7048 ms
Median16.293 ms16.482 ms16.707 ms
MAD583.99 µs797.71 µs1.0421 ms
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probability of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the average time per iteration for the samples. Each point + represents one sample.

+

See the + documentation for more details on the additional statistics.

+
+
+
+ + + + \ No newline at end of file diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/report/iteration_times.svg b/criterion/stroke_mask_pooling/warm_10th_stroke/report/iteration_times.svg new file mode 100644 index 0000000..748b0dd --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/report/iteration_times.svg @@ -0,0 +1,204 @@ + + +stroke_mask_pooling/warm_10th_stroke + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + +16.0 + + + +17.0 + + + +18.0 + + + +19.0 + + + +20.0 + + + +21.0 + + + +22.0 + + + +23.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + + diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/report/iteration_times_small.svg b/criterion/stroke_mask_pooling/warm_10th_stroke/report/iteration_times_small.svg new file mode 100644 index 0000000..e9b8145 --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/report/iteration_times_small.svg @@ -0,0 +1,197 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + +16.0 + + + +17.0 + + + +18.0 + + + +19.0 + + + +20.0 + + + +21.0 + + + +22.0 + + + +23.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/report/mean.svg b/criterion/stroke_mask_pooling/warm_10th_stroke/report/mean.svg new file mode 100644 index 0000000..cd035f7 --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/report/mean.svg @@ -0,0 +1,76 @@ + + +stroke_mask_pooling/warm_10th_stroke:mean + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + + +16.5 + + + +16.6 + + + +16.7 + + + +16.8 + + + +16.9 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/report/median.svg b/criterion/stroke_mask_pooling/warm_10th_stroke/report/median.svg new file mode 100644 index 0000000..78e8c8b --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/report/median.svg @@ -0,0 +1,112 @@ + + +stroke_mask_pooling/warm_10th_stroke:median + + +Density (a.u.) + + +Average time (ms) + + + +1 + + + +2 + + + +3 + + + +4 + + + +5 + + + +6 + + + +7 + + + +8 + + + +9 + + + +10 + + + + +16.25 + + + +16.3 + + + +16.35 + + + +16.4 + + + +16.45 + + + +16.5 + + + +16.55 + + + +16.6 + + + +16.65 + + + +16.7 + + + +16.75 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/report/pdf.svg b/criterion/stroke_mask_pooling/warm_10th_stroke/report/pdf.svg new file mode 100644 index 0000000..35dcf82 --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/report/pdf.svg @@ -0,0 +1,139 @@ + + +stroke_mask_pooling/warm_10th_stroke + + +Iterations + + +Average Time (ms) + + + +0 + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + + +14 + + + +16 + + + +18 + + + +20 + + + +22 + + + +24 + + + +Density (a.u.) + + + +0 + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + +0.35 + + + +0.4 + + + + + + + + + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/report/pdf_small.svg b/criterion/stroke_mask_pooling/warm_10th_stroke/report/pdf_small.svg new file mode 100644 index 0000000..1de15d4 --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/report/pdf_small.svg @@ -0,0 +1,64 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0 + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + +0.35 + + + +0.4 + + + +0.45 + + + + +15 + + + +20 + + + +25 + + + + + diff --git a/criterion/stroke_mask_pooling/warm_10th_stroke/report/typical.svg b/criterion/stroke_mask_pooling/warm_10th_stroke/report/typical.svg new file mode 100644 index 0000000..48875c4 --- /dev/null +++ b/criterion/stroke_mask_pooling/warm_10th_stroke/report/typical.svg @@ -0,0 +1,76 @@ + + +stroke_mask_pooling/warm_10th_stroke:typical + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + + +16.5 + + + +16.6 + + + +16.7 + + + +16.8 + + + +16.9 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/benches/below_cache_reuse.rs b/hcie-engine-api/benches/below_cache_reuse.rs index 7ee9a25..fc7c9c0 100644 --- a/hcie-engine-api/benches/below_cache_reuse.rs +++ b/hcie-engine-api/benches/below_cache_reuse.rs @@ -142,5 +142,9 @@ fn bench_below_cache_reuse(c: &mut Criterion) { group.finish(); } -criterion_group!(benches, bench_below_cache_reuse); +criterion_group!{ + name = benches; + config = Criterion::default().output_directory(std::path::Path::new("criterion")); + targets = bench_below_cache_reuse +} criterion_main!(benches); diff --git a/hcie-engine-api/benches/composite_scratch_pooling.rs b/hcie-engine-api/benches/composite_scratch_pooling.rs index fbb8bb8..6c3d144 100644 --- a/hcie-engine-api/benches/composite_scratch_pooling.rs +++ b/hcie-engine-api/benches/composite_scratch_pooling.rs @@ -142,5 +142,9 @@ fn bench_composite_scratch_pooling(c: &mut Criterion) { group.finish(); } -criterion_group!(benches, bench_composite_scratch_pooling); +criterion_group!{ + name = benches; + config = Criterion::default().output_directory(std::path::Path::new("criterion")); + targets = bench_composite_scratch_pooling +} criterion_main!(benches); diff --git a/hcie-engine-api/benches/effects_skip.rs b/hcie-engine-api/benches/effects_skip.rs index fed8952..a1b61e1 100644 --- a/hcie-engine-api/benches/effects_skip.rs +++ b/hcie-engine-api/benches/effects_skip.rs @@ -162,5 +162,9 @@ fn bench_effects_skip(c: &mut Criterion) { group.finish(); } -criterion_group!(benches, bench_effects_skip); +criterion_group!{ + name = benches; + config = Criterion::default().output_directory(std::path::Path::new("criterion")); + targets = bench_effects_skip +} criterion_main!(benches); diff --git a/hcie-engine-api/benches/stroke_mask_pooling.rs b/hcie-engine-api/benches/stroke_mask_pooling.rs index 2808d91..546b0e9 100644 --- a/hcie-engine-api/benches/stroke_mask_pooling.rs +++ b/hcie-engine-api/benches/stroke_mask_pooling.rs @@ -116,5 +116,9 @@ fn bench_mask_pooling(c: &mut Criterion) { group.finish(); } -criterion_group!(benches, bench_mask_pooling); +criterion_group!{ + name = benches; + config = Criterion::default().output_directory(std::path::Path::new("criterion")); + targets = bench_mask_pooling +} criterion_main!(benches); diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/change/estimates.json b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/change/estimates.json new file mode 100644 index 0000000..505983d --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/change/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":-0.1736530609600688,"upper_bound":-0.10686053897431724},"point_estimate":-0.14138294667028606,"standard_error":0.016954900672688414},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":-0.14814048689152826,"upper_bound":-0.09920809508494938},"point_estimate":-0.13256504196774332,"standard_error":0.012846207705347154}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/benchmark.json b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/benchmark.json new file mode 100644 index 0000000..b9c15c8 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/benchmark.json @@ -0,0 +1 @@ +{"group_id":"below_cache_reuse","function_id":"first_stroke_cache_build","value_str":null,"throughput":null,"full_id":"below_cache_reuse/first_stroke_cache_build","directory_name":"below_cache_reuse/first_stroke_cache_build","title":"below_cache_reuse/first_stroke_cache_build"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/estimates.json b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/estimates.json new file mode 100644 index 0000000..c186a04 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":563547257.5552499,"upper_bound":592825536.99},"point_estimate":577579982.05,"standard_error":7412840.62486779},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":570050135.0,"upper_bound":580303038.5},"point_estimate":575156492.0,"standard_error":2590246.2686335165},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":17757919.762533903,"upper_bound":43661908.72654617},"point_estimate":28044410.39171219,"standard_error":6496538.073342821},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":53178149.80360058,"upper_bound":93931107.39559157},"point_estimate":74052951.44827443,"standard_error":10493245.206589472}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/sample.json b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/sample.json new file mode 100644 index 0000000..c060f19 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0],"times":[550746008.0,537533816.0,526516631.0,539964719.0,508414351.0,553660623.0,529837935.0,527177593.0,518556013.0,590887757.0,568883990.0,571877548.0,551714120.0,579405120.0,597831399.0,571074828.0,575544281.0,581533045.0,570050135.0,560816216.0,523735690.0,565011502.0,625697300.0,617445001.0,700532433.0,633191889.0,564014378.0,685290803.0,808947269.0,587420150.0,568656128.0,640310613.0,835427582.0,579399196.0,616177370.0,592335499.0,628459363.0,586161952.0,590644246.0,609645117.0,580010101.0,569168444.0,564904275.0,580854692.0,595808877.0,553433404.0,603276070.0,565255735.0,571724516.0,605140582.0,589699735.0,565126595.0,677411940.0,630116040.0,627263115.0,690995815.0,930241423.0,659053306.0,553042772.0,582151316.0,625719381.0,614040028.0,575863388.0,607931602.0,580206520.0,583236338.0,595838829.0,576312466.0,560557455.0,572258397.0,576506920.0,574768703.0,573443481.0,566907026.0,569272727.0,560909798.0,573608915.0,580745728.0,573515648.0,589932964.0,578855256.0,574438809.0,577566878.0,580399557.0,563465044.0,581667827.0,560988822.0,565109290.0,609538144.0,542991875.0,437355753.0,441029416.0,443608968.0,440786375.0,433691107.0,448990034.0,457425312.0,443097491.0,426881083.0,453326488.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/tukey.json b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/tukey.json new file mode 100644 index 0000000..bde63d5 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/gold_standard/tukey.json @@ -0,0 +1 @@ +[455557008.0,508154266.875,648413623.875,701010882.75] \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/new/benchmark.json b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/new/benchmark.json new file mode 100644 index 0000000..b9c15c8 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/new/benchmark.json @@ -0,0 +1 @@ +{"group_id":"below_cache_reuse","function_id":"first_stroke_cache_build","value_str":null,"throughput":null,"full_id":"below_cache_reuse/first_stroke_cache_build","directory_name":"below_cache_reuse/first_stroke_cache_build","title":"below_cache_reuse/first_stroke_cache_build"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/new/estimates.json b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/new/estimates.json new file mode 100644 index 0000000..715aa6e --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/new/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":481812094.01575,"upper_bound":510496335.7875},"point_estimate":495920022.25,"standard_error":7337492.273210429},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":491535867.0,"upper_bound":517707163.5},"point_estimate":498910847.5,"standard_error":6976528.707703898},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":38299283.093851805,"upper_bound":103157653.81088555},"point_estimate":65690266.45786464,"standard_error":18807141.79202498},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":61536512.309797674,"upper_bound":86329317.80180116},"point_estimate":74025312.17218262,"standard_error":6345054.021576602}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/new/sample.json b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/new/sample.json new file mode 100644 index 0000000..2803b2d --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/new/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0],"times":[397007052.0,399503928.0,406564207.0,410670133.0,399416065.0,399481553.0,406754167.0,406011680.0,403744663.0,402348650.0,399600668.0,402716721.0,400615196.0,404108758.0,427036960.0,402990223.0,423466355.0,401441962.0,409157580.0,405567950.0,413143882.0,419449327.0,409128159.0,404458365.0,411188425.0,405111785.0,395343621.0,419918587.0,404646670.0,401570490.0,478389725.0,499120126.0,509826346.0,546238399.0,494449275.0,484154946.0,474355222.0,572212613.0,493981780.0,491535867.0,494708971.0,506905200.0,497243960.0,483811664.0,522581089.0,490513507.0,489818075.0,486290830.0,498701569.0,493566717.0,508898970.0,493875599.0,574289578.0,519571813.0,507274762.0,582666133.0,515842514.0,487290687.0,496536206.0,497116364.0,500502729.0,483569322.0,476300089.0,767668414.0,532327106.0,553614084.0,532058720.0,521985428.0,506374321.0,565782178.0,524635466.0,536455151.0,695157028.0,529371852.0,523427836.0,528864932.0,556823704.0,573907999.0,535819972.0,517319279.0,530203311.0,529443034.0,560297212.0,556924282.0,540198253.0,521410145.0,531575873.0,520240132.0,560790056.0,557361719.0,646219718.0,639439046.0,632561180.0,672094935.0,532732804.0,593012798.0,536925015.0,519707052.0,516302776.0,548664985.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/new/tukey.json b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/new/tukey.json new file mode 100644 index 0000000..bcc0257 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/new/tukey.json @@ -0,0 +1 @@ +[53334479.5,232994748.625,712088799.625,891749068.75] \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/MAD.svg b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/MAD.svg new file mode 100644 index 0000000..1df93bf --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/MAD.svg @@ -0,0 +1,80 @@ + + +below_cache_reuse/first_stroke_cache_build:MAD + + +Density (a.u.) + + +Average time (ms) + + + +0.005 + + + +0.01 + + + +0.015 + + + +0.02 + + + +0.025 + + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + +110 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/SD.svg b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/SD.svg new file mode 100644 index 0000000..b68f230 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/SD.svg @@ -0,0 +1,76 @@ + + +below_cache_reuse/first_stroke_cache_build:SD + + +Density (a.u.) + + +Average time (ms) + + + +0.01 + + + +0.02 + + + +0.03 + + + +0.04 + + + +0.05 + + + +0.06 + + + + +60 + + + +65 + + + +70 + + + +75 + + + +80 + + + +85 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/both/iteration_times.svg b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/both/iteration_times.svg new file mode 100644 index 0000000..ea9ec73 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/both/iteration_times.svg @@ -0,0 +1,328 @@ + + +below_cache_reuse/first_stroke_cache_build + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + + + + +400.0 + + + +450.0 + + + +500.0 + + + +550.0 + + + +600.0 + + + +650.0 + + + +700.0 + + + +750.0 + + + +800.0 + + + +850.0 + + + +900.0 + + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Current + + +Base + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/both/pdf.svg b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/both/pdf.svg new file mode 100644 index 0000000..e951765 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/both/pdf.svg @@ -0,0 +1,81 @@ + + +below_cache_reuse/first_stroke_cache_build + + +Density (a.u.) + + +Average Time (ms) + + + +0.001 + + + +0.002 + + + +0.003 + + + +0.004 + + + +0.005 + + + +0.006 + + + +0.007 + + + +0.008 + + + + +400 + + + +600 + + + +800 + + + +1000 + + + + + + + +Base PDF + + +New PDF + + +Base Mean + + +New Mean + + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/change/mean.svg b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/change/mean.svg new file mode 100644 index 0000000..ee49065 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/change/mean.svg @@ -0,0 +1,113 @@ + + +below_cache_reuse/first_stroke_cache_build:mean + + +Density (a.u.) + + +Relative change (%) + + + +2 + + + +4 + + + +6 + + + +8 + + + +10 + + + +12 + + + +14 + + + +16 + + + +18 + + + +20 + + + +22 + + + + +-0.18 + + + +-0.17 + + + +-0.16 + + + +-0.15 + + + +-0.14 + + + +-0.13 + + + +-0.12 + + + +-0.11 + + + +-0.1 + + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + +Noise threshold + + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/change/median.svg b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/change/median.svg new file mode 100644 index 0000000..40b395b --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/change/median.svg @@ -0,0 +1,85 @@ + + +below_cache_reuse/first_stroke_cache_build:median + + +Density (a.u.) + + +Relative change (%) + + + +5 + + + +10 + + + +15 + + + +20 + + + +25 + + + +30 + + + +35 + + + + +-0.15 + + + +-0.14 + + + +-0.13 + + + +-0.12 + + + +-0.11 + + + +-0.1 + + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + +Noise threshold + + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/change/t-test.svg b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/change/t-test.svg new file mode 100644 index 0000000..b09954c --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/change/t-test.svg @@ -0,0 +1,99 @@ + + +below_cache_reuse/first_stroke_cache_build: Welch t test + + +Density + + +t score + + + +0.0 + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + +0.35 + + + +0.4 + + + + +-5.0 + + + +-4.0 + + + +-3.0 + + + +-2.0 + + + +-1.0 + + + +0.0 + + + +1.0 + + + +2.0 + + + +3.0 + + + +4.0 + + + + + +t distribution + + +t statistic + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/index.html b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/index.html new file mode 100644 index 0000000..005c48c --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/index.html @@ -0,0 +1,269 @@ + + + + + + below_cache_reuse/first_stroke_cache_build - Criterion.rs + + + + +
+

below_cache_reuse/first_stroke_cache_build

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
R²0.00492240.00510210.0049107
Mean481.81 ms495.92 ms510.50 ms
Std. Dev.61.537 ms74.025 ms86.329 ms
Median491.54 ms498.91 ms517.71 ms
MAD38.299 ms65.690 ms103.16 ms
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probability of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the average time per iteration for the samples. Each point + represents one sample.

+

See the + documentation for more details on the additional statistics.

+
+
+
+

Change Since Previous Benchmark

+
+ + + + + + + +
+ + PDF Comparison + + + + Iteration Time Comparison + +
+
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
Change in time-17.365%-14.138%-10.686%(p = 0.00 < + 0.05)
+ Performance has improved. +
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left shows the probability of the function taking a certain amount of time. The red + curve represents the saved measurements from the last time this benchmark was run, while the blue curve + shows the measurements from this run. The lines represent the mean time per iteration. Click on the + plot for a larger view.

+

The plot on the right shows the iteration times for the two measurements. Again, the red dots represent + the previous measurement while the blue dots show the current measurement.

+

See the + documentation for more details on the additional statistics.

+
+
+ + + + \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/iteration_times.svg b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/iteration_times.svg new file mode 100644 index 0000000..1bfb897 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/iteration_times.svg @@ -0,0 +1,204 @@ + + +below_cache_reuse/first_stroke_cache_build + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + +400.0 + + + +450.0 + + + +500.0 + + + +550.0 + + + +600.0 + + + +650.0 + + + +700.0 + + + +750.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/iteration_times_small.svg b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/iteration_times_small.svg new file mode 100644 index 0000000..68bbea1 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/iteration_times_small.svg @@ -0,0 +1,197 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + +400.0 + + + +450.0 + + + +500.0 + + + +550.0 + + + +600.0 + + + +650.0 + + + +700.0 + + + +750.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/mean.svg b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/mean.svg new file mode 100644 index 0000000..6ed927e --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/mean.svg @@ -0,0 +1,80 @@ + + +below_cache_reuse/first_stroke_cache_build:mean + + +Density (a.u.) + + +Average time (ms) + + + +0.01 + + + +0.02 + + + +0.03 + + + +0.04 + + + +0.05 + + + +0.06 + + + + +480 + + + +485 + + + +490 + + + +495 + + + +500 + + + +505 + + + +510 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/median.svg b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/median.svg new file mode 100644 index 0000000..6e1dd5c --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/median.svg @@ -0,0 +1,100 @@ + + +below_cache_reuse/first_stroke_cache_build:median + + +Density (a.u.) + + +Average time (ms) + + + +0.01 + + + +0.02 + + + +0.03 + + + +0.04 + + + +0.05 + + + +0.06 + + + +0.07 + + + +0.08 + + + +0.09 + + + +0.1 + + + +0.11 + + + + +490 + + + +495 + + + +500 + + + +505 + + + +510 + + + +515 + + + +520 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/pdf.svg b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/pdf.svg new file mode 100644 index 0000000..dde8213 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/pdf.svg @@ -0,0 +1,157 @@ + + +below_cache_reuse/first_stroke_cache_build + + +Iterations + + +Average Time (ms) + + + +0 + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + +1 + + + + +350 + + + +400 + + + +450 + + + +500 + + + +550 + + + +600 + + + +650 + + + +700 + + + +750 + + + +800 + + + +850 + + + +Density (a.u.) + + + +0 + + + +0.001 + + + +0.002 + + + +0.003 + + + +0.004 + + + +0.005 + + + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/pdf_small.svg b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/pdf_small.svg new file mode 100644 index 0000000..b1e5616 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/pdf_small.svg @@ -0,0 +1,60 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0 + + + +0.001 + + + +0.002 + + + +0.003 + + + +0.004 + + + +0.005 + + + +0.006 + + + + +400 + + + +500 + + + +600 + + + +700 + + + +800 + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/relative_iteration_times_small.svg b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/relative_iteration_times_small.svg new file mode 100644 index 0000000..b2fd1f9 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/relative_iteration_times_small.svg @@ -0,0 +1,317 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + + + + +400.0 + + + +450.0 + + + +500.0 + + + +550.0 + + + +600.0 + + + +650.0 + + + +700.0 + + + +750.0 + + + +800.0 + + + +850.0 + + + +900.0 + + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/relative_pdf_small.svg b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/relative_pdf_small.svg new file mode 100644 index 0000000..95b0c21 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/relative_pdf_small.svg @@ -0,0 +1,62 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0.001 + + + +0.002 + + + +0.003 + + + +0.004 + + + +0.005 + + + +0.006 + + + +0.007 + + + +0.008 + + + + +400 + + + +600 + + + +800 + + + +1000 + + + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/typical.svg b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/typical.svg new file mode 100644 index 0000000..0452e13 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/first_stroke_cache_build/report/typical.svg @@ -0,0 +1,80 @@ + + +below_cache_reuse/first_stroke_cache_build:typical + + +Density (a.u.) + + +Average time (ms) + + + +0.01 + + + +0.02 + + + +0.03 + + + +0.04 + + + +0.05 + + + +0.06 + + + + +480 + + + +485 + + + +490 + + + +495 + + + +500 + + + +505 + + + +510 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/report/index.html b/hcie-engine-api/criterion/below_cache_reuse/report/index.html new file mode 100644 index 0000000..88fa8eb --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/report/index.html @@ -0,0 +1,116 @@ + + + + + + below_cache_reuse Summary - Criterion.rs + + + + +
+

below_cache_reuse

+

Violin Plot

+ + Violin Plot + +

This chart shows the relationship between function/parameter and iteration time. The thickness of the shaded + region indicates the probability that a measurement of the given function/parameter would take a particular + length of time.

+
+ +

below_cache_reuse/first_stroke_cache_build

+ + + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+ +

below_cache_reuse/second_stroke_cache_reuse

+ + + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+ + + + \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/report/violin.svg b/hcie-engine-api/criterion/below_cache_reuse/report/violin.svg new file mode 100644 index 0000000..33ed9b8 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/report/violin.svg @@ -0,0 +1,69 @@ + + +below_cache_reuse: Violin plot + + +Input + + +Average time (s) + + + +below_cache_reuse/second_stroke_cache_reuse + + + +below_cache_reuse/first_stroke_cache_build + + + + +0.0 + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + +1.0 + + + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/change/estimates.json b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/change/estimates.json new file mode 100644 index 0000000..9d7a9ac --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/change/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":-0.009007095726474068,"upper_bound":0.006881219039340094},"point_estimate":-0.000424502219330658,"standard_error":0.004063650834340504},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":-0.0038116585744026876,"upper_bound":0.013402399642500118},"point_estimate":0.00414700803314294,"standard_error":0.00459993067264349}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/benchmark.json b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/benchmark.json new file mode 100644 index 0000000..ca406b8 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/benchmark.json @@ -0,0 +1 @@ +{"group_id":"below_cache_reuse","function_id":"second_stroke_cache_reuse","value_str":null,"throughput":null,"full_id":"below_cache_reuse/second_stroke_cache_reuse","directory_name":"below_cache_reuse/second_stroke_cache_reuse","title":"below_cache_reuse/second_stroke_cache_reuse"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/estimates.json b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/estimates.json new file mode 100644 index 0000000..f5bb4e5 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14100185.1459375,"upper_bound":14194123.8220625},"point_estimate":14146415.33,"standard_error":24081.366377833903},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14055463.5,"upper_bound":14170439.125},"point_estimate":14138027.125,"standard_error":35582.66761410533},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":161260.73121204972,"upper_bound":272958.0109434016},"point_estimate":219025.7913865149,"standard_error":28530.551069950936},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":204843.6646659785,"upper_bound":276433.41191427095},"point_estimate":242278.1186880092,"standard_error":18306.532360063127}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/sample.json b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/sample.json new file mode 100644 index 0000000..02b57a9 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[55709089.0,56308870.0,56717903.0,56332065.0,55715756.0,56200523.0,56380975.0,56832490.0,56078801.0,55780706.0,56973232.0,55634742.0,56266398.0,57413646.0,54971939.0,55961604.0,56662097.0,57655498.0,56205349.0,55390050.0,58555515.0,55929407.0,56869787.0,56347990.0,54465913.0,56181637.0,56780794.0,57186699.0,54733834.0,56221854.0,56217466.0,58162201.0,56838642.0,55961514.0,56667766.0,56543060.0,56087549.0,56561157.0,55518026.0,55977181.0,56593824.0,59602541.0,55063748.0,56701416.0,56618477.0,57772134.0,55567316.0,55368763.0,57058696.0,56176831.0,57983500.0,56339576.0,55383107.0,55817434.0,57577998.0,57946276.0,57797978.0,55846589.0,58191401.0,57367170.0,54896488.0,56281622.0,57105271.0,55948169.0,57861572.0,56336473.0,56629160.0,55693469.0,56189065.0,56610187.0,58725308.0,57168948.0,55714899.0,55631429.0,55392041.0,57296385.0,58259940.0,56194754.0,57969556.0,57983638.0,55960856.0,54905995.0,56722020.0,57371388.0,55498877.0,57024307.0,57951857.0,57129418.0,56655065.0,56842102.0,57151972.0,56118265.0,56619804.0,59052466.0,56034245.0,56850429.0,56644663.0,57164079.0,56140029.0,57065421.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/tukey.json b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/tukey.json new file mode 100644 index 0000000..fb36640 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/gold_standard/tukey.json @@ -0,0 +1 @@ +[13110057.125,13550197.25,14723904.25,15164044.375] \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/new/benchmark.json b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/new/benchmark.json new file mode 100644 index 0000000..ca406b8 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/new/benchmark.json @@ -0,0 +1 @@ +{"group_id":"below_cache_reuse","function_id":"second_stroke_cache_reuse","value_str":null,"throughput":null,"full_id":"below_cache_reuse/second_stroke_cache_reuse","directory_name":"below_cache_reuse/second_stroke_cache_reuse","title":"below_cache_reuse/second_stroke_cache_reuse"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/new/estimates.json b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/new/estimates.json new file mode 100644 index 0000000..f5bb4e5 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/new/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14100185.1459375,"upper_bound":14194123.8220625},"point_estimate":14146415.33,"standard_error":24081.366377833903},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14055463.5,"upper_bound":14170439.125},"point_estimate":14138027.125,"standard_error":35582.66761410533},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":161260.73121204972,"upper_bound":272958.0109434016},"point_estimate":219025.7913865149,"standard_error":28530.551069950936},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":204843.6646659785,"upper_bound":276433.41191427095},"point_estimate":242278.1186880092,"standard_error":18306.532360063127}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/new/sample.json b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/new/sample.json new file mode 100644 index 0000000..02b57a9 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/new/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[55709089.0,56308870.0,56717903.0,56332065.0,55715756.0,56200523.0,56380975.0,56832490.0,56078801.0,55780706.0,56973232.0,55634742.0,56266398.0,57413646.0,54971939.0,55961604.0,56662097.0,57655498.0,56205349.0,55390050.0,58555515.0,55929407.0,56869787.0,56347990.0,54465913.0,56181637.0,56780794.0,57186699.0,54733834.0,56221854.0,56217466.0,58162201.0,56838642.0,55961514.0,56667766.0,56543060.0,56087549.0,56561157.0,55518026.0,55977181.0,56593824.0,59602541.0,55063748.0,56701416.0,56618477.0,57772134.0,55567316.0,55368763.0,57058696.0,56176831.0,57983500.0,56339576.0,55383107.0,55817434.0,57577998.0,57946276.0,57797978.0,55846589.0,58191401.0,57367170.0,54896488.0,56281622.0,57105271.0,55948169.0,57861572.0,56336473.0,56629160.0,55693469.0,56189065.0,56610187.0,58725308.0,57168948.0,55714899.0,55631429.0,55392041.0,57296385.0,58259940.0,56194754.0,57969556.0,57983638.0,55960856.0,54905995.0,56722020.0,57371388.0,55498877.0,57024307.0,57951857.0,57129418.0,56655065.0,56842102.0,57151972.0,56118265.0,56619804.0,59052466.0,56034245.0,56850429.0,56644663.0,57164079.0,56140029.0,57065421.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/new/tukey.json b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/new/tukey.json new file mode 100644 index 0000000..fb36640 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/new/tukey.json @@ -0,0 +1 @@ +[13110057.125,13550197.25,14723904.25,15164044.375] \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/MAD.svg b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/MAD.svg new file mode 100644 index 0000000..428bab1 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/MAD.svg @@ -0,0 +1,84 @@ + + +below_cache_reuse/second_stroke_cache_reuse:MAD + + +Density (a.u.) + + +Average time (µs) + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + +0.014 + + + + +160 + + + +180 + + + +200 + + + +220 + + + +240 + + + +260 + + + +280 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/SD.svg b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/SD.svg new file mode 100644 index 0000000..e2366cb --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/SD.svg @@ -0,0 +1,80 @@ + + +below_cache_reuse/second_stroke_cache_reuse:SD + + +Density (a.u.) + + +Average time (µs) + + + +0.005 + + + +0.01 + + + +0.015 + + + +0.02 + + + + +200 + + + +210 + + + +220 + + + +230 + + + +240 + + + +250 + + + +260 + + + +270 + + + +280 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/both/iteration_times.svg b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/both/iteration_times.svg new file mode 100644 index 0000000..3c27fae --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/both/iteration_times.svg @@ -0,0 +1,318 @@ + + +below_cache_reuse/second_stroke_cache_reuse + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + + +14.0 + + + +14.5 + + + +15.0 + + + +15.5 + + + +16.0 + + + +16.5 + + + +17.0 + + + +17.5 + + + +18.0 + + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Current + + +Base + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/both/pdf.svg b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/both/pdf.svg new file mode 100644 index 0000000..b7ec1c5 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/both/pdf.svg @@ -0,0 +1,77 @@ + + +below_cache_reuse/second_stroke_cache_reuse + + +Density (a.u.) + + +Average Time (ms) + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + + +14 + + + +16 + + + +18 + + + + + + + +Base PDF + + +New PDF + + +Base Mean + + +New Mean + + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/change/mean.svg b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/change/mean.svg new file mode 100644 index 0000000..f7f21c6 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/change/mean.svg @@ -0,0 +1,109 @@ + + +below_cache_reuse/second_stroke_cache_reuse:mean + + +Density (a.u.) + + +Relative change (%) + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + + +-0.01 + + + +-0.008 + + + +-0.006 + + + +-0.004 + + + +-0.002 + + + +0 + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + +Noise threshold + + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/change/median.svg b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/change/median.svg new file mode 100644 index 0000000..4ad2b85 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/change/median.svg @@ -0,0 +1,113 @@ + + +below_cache_reuse/second_stroke_cache_reuse:median + + +Density (a.u.) + + +Relative change (%) + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + +-0.004 + + + +-0.002 + + + +0 + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + +0.014 + + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + +Noise threshold + + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/change/t-test.svg b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/change/t-test.svg new file mode 100644 index 0000000..8cb98e5 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/change/t-test.svg @@ -0,0 +1,95 @@ + + +below_cache_reuse/second_stroke_cache_reuse: Welch t test + + +Density + + +t score + + + +0.0 + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + +0.35 + + + +0.4 + + + + +-4.0 + + + +-3.0 + + + +-2.0 + + + +-1.0 + + + +0.0 + + + +1.0 + + + +2.0 + + + +3.0 + + + +4.0 + + + + + +t distribution + + +t statistic + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/index.html b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/index.html new file mode 100644 index 0000000..f4d3595 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/index.html @@ -0,0 +1,269 @@ + + + + + + below_cache_reuse/second_stroke_cache_reuse - Criterion.rs + + + + +
+

below_cache_reuse/second_stroke_cache_reuse

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
R²0.00238200.00246940.0023765
Mean14.100 ms14.146 ms14.194 ms
Std. Dev.204.84 µs242.28 µs276.43 µs
Median14.055 ms14.138 ms14.170 ms
MAD161.26 µs219.03 µs272.96 µs
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probability of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the average time per iteration for the samples. Each point + represents one sample.

+

See the + documentation for more details on the additional statistics.

+
+
+
+

Change Since Previous Benchmark

+
+ + + + + + + +
+ + PDF Comparison + + + + Iteration Time Comparison + +
+
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
Change in time-0.9007%-0.0425%+0.6881%(p = 0.92 > + 0.05)
+ No change in performance detected. +
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left shows the probability of the function taking a certain amount of time. The red + curve represents the saved measurements from the last time this benchmark was run, while the blue curve + shows the measurements from this run. The lines represent the mean time per iteration. Click on the + plot for a larger view.

+

The plot on the right shows the iteration times for the two measurements. Again, the red dots represent + the previous measurement while the blue dots show the current measurement.

+

See the + documentation for more details on the additional statistics.

+
+
+ + + + \ No newline at end of file diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/iteration_times.svg b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/iteration_times.svg new file mode 100644 index 0000000..99376ec --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/iteration_times.svg @@ -0,0 +1,194 @@ + + +below_cache_reuse/second_stroke_cache_reuse + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + +13.8 + + + +14.0 + + + +14.2 + + + +14.4 + + + +14.6 + + + +14.8 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/iteration_times_small.svg b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/iteration_times_small.svg new file mode 100644 index 0000000..71725e3 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/iteration_times_small.svg @@ -0,0 +1,187 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + +13.8 + + + +14.0 + + + +14.2 + + + +14.4 + + + +14.6 + + + +14.8 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/mean.svg b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/mean.svg new file mode 100644 index 0000000..7647e8e --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/mean.svg @@ -0,0 +1,88 @@ + + +below_cache_reuse/second_stroke_cache_reuse:mean + + +Density (a.u.) + + +Average time (ms) + + + +2 + + + +4 + + + +6 + + + +8 + + + +10 + + + +12 + + + +14 + + + +16 + + + +18 + + + + +14.1 + + + +14.12 + + + +14.14 + + + +14.16 + + + +14.18 + + + +14.2 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/median.svg b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/median.svg new file mode 100644 index 0000000..e9366f0 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/median.svg @@ -0,0 +1,76 @@ + + +below_cache_reuse/second_stroke_cache_reuse:median + + +Density (a.u.) + + +Average time (ms) + + + +5 + + + +10 + + + +15 + + + +20 + + + +25 + + + + +14.06 + + + +14.08 + + + +14.1 + + + +14.12 + + + +14.14 + + + +14.16 + + + +14.18 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/pdf.svg b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/pdf.svg new file mode 100644 index 0000000..6035d84 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/pdf.svg @@ -0,0 +1,159 @@ + + +below_cache_reuse/second_stroke_cache_reuse + + +Iterations + + +Average Time (ms) + + + +0 + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + +4 + + + + +13.4 + + + +13.6 + + + +13.8 + + + +14 + + + +14.2 + + + +14.4 + + + +14.6 + + + +14.8 + + + +15 + + + +15.2 + + + +Density (a.u.) + + + +0 + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + + + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/pdf_small.svg b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/pdf_small.svg new file mode 100644 index 0000000..d443beb --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/pdf_small.svg @@ -0,0 +1,68 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0 + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + + +13.5 + + + +14 + + + +14.5 + + + +15 + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/relative_iteration_times_small.svg b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/relative_iteration_times_small.svg new file mode 100644 index 0000000..b00339f --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/relative_iteration_times_small.svg @@ -0,0 +1,307 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + + +14.0 + + + +14.5 + + + +15.0 + + + +15.5 + + + +16.0 + + + +16.5 + + + +17.0 + + + +17.5 + + + +18.0 + + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/relative_pdf_small.svg b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/relative_pdf_small.svg new file mode 100644 index 0000000..5421e09 --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/relative_pdf_small.svg @@ -0,0 +1,58 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + + +14 + + + +16 + + + +18 + + + + + + + diff --git a/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/typical.svg b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/typical.svg new file mode 100644 index 0000000..6c391bd --- /dev/null +++ b/hcie-engine-api/criterion/below_cache_reuse/second_stroke_cache_reuse/report/typical.svg @@ -0,0 +1,88 @@ + + +below_cache_reuse/second_stroke_cache_reuse:typical + + +Density (a.u.) + + +Average time (ms) + + + +2 + + + +4 + + + +6 + + + +8 + + + +10 + + + +12 + + + +14 + + + +16 + + + +18 + + + + +14.1 + + + +14.12 + + + +14.14 + + + +14.16 + + + +14.18 + + + +14.2 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/change/estimates.json b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/change/estimates.json new file mode 100644 index 0000000..f21f864 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/change/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":-0.42315037023592006,"upper_bound":-0.4087094337283811},"point_estimate":-0.4158410689019737,"standard_error":0.0037182951978890905},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":-0.42166273312097546,"upper_bound":-0.40886823321622},"point_estimate":-0.4146200448326248,"standard_error":0.0031994176570940658}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/gold_standard/benchmark.json b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/gold_standard/benchmark.json new file mode 100644 index 0000000..2aa7bb5 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/gold_standard/benchmark.json @@ -0,0 +1 @@ +{"group_id":"composite_scratch_pooling","function_id":"cold_composite","value_str":null,"throughput":null,"full_id":"composite_scratch_pooling/cold_composite","directory_name":"composite_scratch_pooling/cold_composite","title":"composite_scratch_pooling/cold_composite"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/gold_standard/estimates.json b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/gold_standard/estimates.json new file mode 100644 index 0000000..9b58baa --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/gold_standard/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":440192426.16,"upper_bound":449137761.7475},"point_estimate":444469678.4,"standard_error":2296762.5433040247},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":438964982.0,"upper_bound":446739956.0},"point_estimate":444074206.5,"standard_error":1876183.3456172838},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":13737012.264919281,"upper_bound":22752180.829668045},"point_estimate":17522593.340411782,"standard_error":2380152.6285270834},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":17335045.08831479,"upper_bound":28426807.368330386},"point_estimate":23079452.353550024,"standard_error":2842837.215412171}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/gold_standard/sample.json b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/gold_standard/sample.json new file mode 100644 index 0000000..a5cae41 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/gold_standard/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0],"times":[532876004.0,475434850.0,435243418.0,441712445.0,440986007.0,433350401.0,435597209.0,455230177.0,429475010.0,449229708.0,456087679.0,444327014.0,443646653.0,445636564.0,474675059.0,448830342.0,443271389.0,440766284.0,446219101.0,447675812.0,445678177.0,448705569.0,436895060.0,463786400.0,463115714.0,515851905.0,438964982.0,441458342.0,431564855.0,453366622.0,428916933.0,418319655.0,427222314.0,417066754.0,415938828.0,412626807.0,415789501.0,426425557.0,417587774.0,426213109.0,417255138.0,539363710.0,421000661.0,425281774.0,413889898.0,428292159.0,425165804.0,415381637.0,420026693.0,422504513.0,424562331.0,448424668.0,422101972.0,409300864.0,414368318.0,421160073.0,446739956.0,415754515.0,413030208.0,434881203.0,449498108.0,455048990.0,445475159.0,434528149.0,431759398.0,455579773.0,449205093.0,458315491.0,440134584.0,434465313.0,455622231.0,469346124.0,457518059.0,444894889.0,502268681.0,437878619.0,436353411.0,443821399.0,459609205.0,468990102.0,445352662.0,455705357.0,447881752.0,451745958.0,484159164.0,462174376.0,447198396.0,475438340.0,458312806.0,444371634.0,458319507.0,438942029.0,464491013.0,456080711.0,436587450.0,442656725.0,454346574.0,455006635.0,448755052.0,444876842.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/gold_standard/tukey.json b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/gold_standard/tukey.json new file mode 100644 index 0000000..b77fea6 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/gold_standard/tukey.json @@ -0,0 +1 @@ +[349760097.75,389260418.625,494594607.625,534094928.5] \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/new/benchmark.json b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/new/benchmark.json new file mode 100644 index 0000000..2aa7bb5 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/new/benchmark.json @@ -0,0 +1 @@ +{"group_id":"composite_scratch_pooling","function_id":"cold_composite","value_str":null,"throughput":null,"full_id":"composite_scratch_pooling/cold_composite","directory_name":"composite_scratch_pooling/cold_composite","title":"composite_scratch_pooling/cold_composite"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/new/estimates.json b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/new/estimates.json new file mode 100644 index 0000000..9b58baa --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/new/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":440192426.16,"upper_bound":449137761.7475},"point_estimate":444469678.4,"standard_error":2296762.5433040247},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":438964982.0,"upper_bound":446739956.0},"point_estimate":444074206.5,"standard_error":1876183.3456172838},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":13737012.264919281,"upper_bound":22752180.829668045},"point_estimate":17522593.340411782,"standard_error":2380152.6285270834},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":17335045.08831479,"upper_bound":28426807.368330386},"point_estimate":23079452.353550024,"standard_error":2842837.215412171}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/new/sample.json b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/new/sample.json new file mode 100644 index 0000000..a5cae41 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/new/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0],"times":[532876004.0,475434850.0,435243418.0,441712445.0,440986007.0,433350401.0,435597209.0,455230177.0,429475010.0,449229708.0,456087679.0,444327014.0,443646653.0,445636564.0,474675059.0,448830342.0,443271389.0,440766284.0,446219101.0,447675812.0,445678177.0,448705569.0,436895060.0,463786400.0,463115714.0,515851905.0,438964982.0,441458342.0,431564855.0,453366622.0,428916933.0,418319655.0,427222314.0,417066754.0,415938828.0,412626807.0,415789501.0,426425557.0,417587774.0,426213109.0,417255138.0,539363710.0,421000661.0,425281774.0,413889898.0,428292159.0,425165804.0,415381637.0,420026693.0,422504513.0,424562331.0,448424668.0,422101972.0,409300864.0,414368318.0,421160073.0,446739956.0,415754515.0,413030208.0,434881203.0,449498108.0,455048990.0,445475159.0,434528149.0,431759398.0,455579773.0,449205093.0,458315491.0,440134584.0,434465313.0,455622231.0,469346124.0,457518059.0,444894889.0,502268681.0,437878619.0,436353411.0,443821399.0,459609205.0,468990102.0,445352662.0,455705357.0,447881752.0,451745958.0,484159164.0,462174376.0,447198396.0,475438340.0,458312806.0,444371634.0,458319507.0,438942029.0,464491013.0,456080711.0,436587450.0,442656725.0,454346574.0,455006635.0,448755052.0,444876842.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/new/tukey.json b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/new/tukey.json new file mode 100644 index 0000000..b77fea6 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/new/tukey.json @@ -0,0 +1 @@ +[349760097.75,389260418.625,494594607.625,534094928.5] \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/MAD.svg b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/MAD.svg new file mode 100644 index 0000000..1efc4d0 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/MAD.svg @@ -0,0 +1,108 @@ + + +composite_scratch_pooling/cold_composite:MAD + + +Density (a.u.) + + +Average time (ms) + + + +0.02 + + + +0.04 + + + +0.06 + + + +0.08 + + + +0.1 + + + +0.12 + + + +0.14 + + + +0.16 + + + +0.18 + + + + +13 + + + +14 + + + +15 + + + +16 + + + +17 + + + +18 + + + +19 + + + +20 + + + +21 + + + +22 + + + +23 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/SD.svg b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/SD.svg new file mode 100644 index 0000000..3e83a63 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/SD.svg @@ -0,0 +1,80 @@ + + +composite_scratch_pooling/cold_composite:SD + + +Density (a.u.) + + +Average time (ms) + + + +0.02 + + + +0.04 + + + +0.06 + + + +0.08 + + + +0.1 + + + +0.12 + + + +0.14 + + + + +18 + + + +20 + + + +22 + + + +24 + + + +26 + + + +28 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/both/iteration_times.svg b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/both/iteration_times.svg new file mode 100644 index 0000000..456cc3b --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/both/iteration_times.svg @@ -0,0 +1,318 @@ + + +composite_scratch_pooling/cold_composite + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + + +450.0 + + + +500.0 + + + +550.0 + + + +600.0 + + + +650.0 + + + +700.0 + + + +750.0 + + + +800.0 + + + +850.0 + + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Current + + +Base + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/both/pdf.svg b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/both/pdf.svg new file mode 100644 index 0000000..a967642 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/both/pdf.svg @@ -0,0 +1,69 @@ + + +composite_scratch_pooling/cold_composite + + +Density (a.u.) + + +Average Time (ms) + + + +0.005 + + + +0.01 + + + +0.015 + + + +0.02 + + + + +400 + + + +500 + + + +600 + + + +700 + + + +800 + + + + + + + +Base PDF + + +New PDF + + +Base Mean + + +New Mean + + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/change/mean.svg b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/change/mean.svg new file mode 100644 index 0000000..e2c470a --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/change/mean.svg @@ -0,0 +1,109 @@ + + +composite_scratch_pooling/cold_composite:mean + + +Density (a.u.) + + +Relative change (%) + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + +-0.424 + + + +-0.422 + + + +-0.42 + + + +-0.418 + + + +-0.416 + + + +-0.414 + + + +-0.412 + + + +-0.41 + + + +-0.408 + + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + +Noise threshold + + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/change/median.svg b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/change/median.svg new file mode 100644 index 0000000..2c56f21 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/change/median.svg @@ -0,0 +1,93 @@ + + +composite_scratch_pooling/cold_composite:median + + +Density (a.u.) + + +Relative change (%) + + + +20 + + + +40 + + + +60 + + + +80 + + + +100 + + + +120 + + + +140 + + + + +-0.422 + + + +-0.42 + + + +-0.418 + + + +-0.416 + + + +-0.414 + + + +-0.412 + + + +-0.41 + + + +-0.408 + + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + +Noise threshold + + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/change/t-test.svg b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/change/t-test.svg new file mode 100644 index 0000000..8edfa5f --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/change/t-test.svg @@ -0,0 +1,95 @@ + + +composite_scratch_pooling/cold_composite: Welch t test + + +Density + + +t score + + + +0.0 + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + +0.35 + + + +0.4 + + + + +-4.0 + + + +-3.0 + + + +-2.0 + + + +-1.0 + + + +0.0 + + + +1.0 + + + +2.0 + + + +3.0 + + + +4.0 + + + + + +t distribution + + +t statistic + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/index.html b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/index.html new file mode 100644 index 0000000..927328e --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/index.html @@ -0,0 +1,269 @@ + + + + + + composite_scratch_pooling/cold_composite - Criterion.rs + + + + +
+

composite_scratch_pooling/cold_composite

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
R²0.00000300.00000310.0000030
Mean440.19 ms444.47 ms449.14 ms
Std. Dev.17.335 ms23.079 ms28.427 ms
Median438.96 ms444.07 ms446.74 ms
MAD13.737 ms17.523 ms22.752 ms
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probability of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the average time per iteration for the samples. Each point + represents one sample.

+

See the + documentation for more details on the additional statistics.

+
+
+
+

Change Since Previous Benchmark

+
+ + + + + + + +
+ + PDF Comparison + + + + Iteration Time Comparison + +
+
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
Change in time-42.315%-41.584%-40.871%(p = 0.00 < + 0.05)
+ Performance has improved. +
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left shows the probability of the function taking a certain amount of time. The red + curve represents the saved measurements from the last time this benchmark was run, while the blue curve + shows the measurements from this run. The lines represent the mean time per iteration. Click on the + plot for a larger view.

+

The plot on the right shows the iteration times for the two measurements. Again, the red dots represent + the previous measurement while the blue dots show the current measurement.

+

See the + documentation for more details on the additional statistics.

+
+
+ + + + \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/iteration_times.svg b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/iteration_times.svg new file mode 100644 index 0000000..350baa0 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/iteration_times.svg @@ -0,0 +1,194 @@ + + +composite_scratch_pooling/cold_composite + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + +420.0 + + + +440.0 + + + +460.0 + + + +480.0 + + + +500.0 + + + +520.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/iteration_times_small.svg b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/iteration_times_small.svg new file mode 100644 index 0000000..01c3e08 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/iteration_times_small.svg @@ -0,0 +1,187 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + +420.0 + + + +440.0 + + + +460.0 + + + +480.0 + + + +500.0 + + + +520.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/mean.svg b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/mean.svg new file mode 100644 index 0000000..67ba5b7 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/mean.svg @@ -0,0 +1,108 @@ + + +composite_scratch_pooling/cold_composite:mean + + +Density (a.u.) + + +Average time (ms) + + + +0.02 + + + +0.04 + + + +0.06 + + + +0.08 + + + +0.1 + + + +0.12 + + + +0.14 + + + +0.16 + + + +0.18 + + + + +440 + + + +441 + + + +442 + + + +443 + + + +444 + + + +445 + + + +446 + + + +447 + + + +448 + + + +449 + + + +450 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/median.svg b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/median.svg new file mode 100644 index 0000000..fb89cf1 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/median.svg @@ -0,0 +1,88 @@ + + +composite_scratch_pooling/cold_composite:median + + +Density (a.u.) + + +Average time (ms) + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + + +439 + + + +440 + + + +441 + + + +442 + + + +443 + + + +444 + + + +445 + + + +446 + + + +447 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/pdf.svg b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/pdf.svg new file mode 100644 index 0000000..ef9efca --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/pdf.svg @@ -0,0 +1,171 @@ + + +composite_scratch_pooling/cold_composite + + +Iterations + + +Average Time (ms) + + + +0 + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + +1 + + + + +400 + + + +420 + + + +440 + + + +460 + + + +480 + + + +500 + + + +520 + + + +540 + + + +560 + + + +Density (a.u.) + + + +0 + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + +0.014 + + + +0.016 + + + +0.018 + + + + + + + + + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/pdf_small.svg b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/pdf_small.svg new file mode 100644 index 0000000..51058f7 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/pdf_small.svg @@ -0,0 +1,72 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0 + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + +0.014 + + + +0.016 + + + +0.018 + + + +0.02 + + + + +400 + + + +450 + + + +500 + + + +550 + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/relative_iteration_times_small.svg b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/relative_iteration_times_small.svg new file mode 100644 index 0000000..cdad89d --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/relative_iteration_times_small.svg @@ -0,0 +1,307 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + + +450.0 + + + +500.0 + + + +550.0 + + + +600.0 + + + +650.0 + + + +700.0 + + + +750.0 + + + +800.0 + + + +850.0 + + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/relative_pdf_small.svg b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/relative_pdf_small.svg new file mode 100644 index 0000000..e2c51cc --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/relative_pdf_small.svg @@ -0,0 +1,50 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0.005 + + + +0.01 + + + +0.015 + + + +0.02 + + + + +400 + + + +500 + + + +600 + + + +700 + + + +800 + + + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/typical.svg b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/typical.svg new file mode 100644 index 0000000..6b72342 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/cold_composite/report/typical.svg @@ -0,0 +1,108 @@ + + +composite_scratch_pooling/cold_composite:typical + + +Density (a.u.) + + +Average time (ms) + + + +0.02 + + + +0.04 + + + +0.06 + + + +0.08 + + + +0.1 + + + +0.12 + + + +0.14 + + + +0.16 + + + +0.18 + + + + +440 + + + +441 + + + +442 + + + +443 + + + +444 + + + +445 + + + +446 + + + +447 + + + +448 + + + +449 + + + +450 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/report/index.html b/hcie-engine-api/criterion/composite_scratch_pooling/report/index.html new file mode 100644 index 0000000..d7cff22 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/report/index.html @@ -0,0 +1,116 @@ + + + + + + composite_scratch_pooling Summary - Criterion.rs + + + + +
+

composite_scratch_pooling

+

Violin Plot

+ + Violin Plot + +

This chart shows the relationship between function/parameter and iteration time. The thickness of the shaded + region indicates the probability that a measurement of the given function/parameter would take a particular + length of time.

+
+ +

composite_scratch_pooling/cold_composite

+ + + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+ +

composite_scratch_pooling/warm_composite

+ + + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+ + + + \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/report/violin.svg b/hcie-engine-api/criterion/composite_scratch_pooling/report/violin.svg new file mode 100644 index 0000000..0cd819f --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/report/violin.svg @@ -0,0 +1,49 @@ + + +composite_scratch_pooling: Violin plot + + +Input + + +Average time (ms) + + + +composite_scratch_pooling/warm_composite + + + +composite_scratch_pooling/cold_composite + + + + +0.0 + + + +100.0 + + + +200.0 + + + +300.0 + + + +400.0 + + + +500.0 + + + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/change/estimates.json b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/change/estimates.json new file mode 100644 index 0000000..320eb18 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/change/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":0.012593563322978242,"upper_bound":0.025225911843116663},"point_estimate":0.018660760392857023,"standard_error":0.0032192976047844685},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":0.01634941139857049,"upper_bound":0.030575460217646233},"point_estimate":0.024238734500064973,"standard_error":0.0037915169494280062}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/gold_standard/benchmark.json b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/gold_standard/benchmark.json new file mode 100644 index 0000000..5ea831c --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/gold_standard/benchmark.json @@ -0,0 +1 @@ +{"group_id":"composite_scratch_pooling","function_id":"warm_composite","value_str":null,"throughput":null,"full_id":"composite_scratch_pooling/warm_composite","directory_name":"composite_scratch_pooling/warm_composite","title":"composite_scratch_pooling/warm_composite"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/gold_standard/estimates.json b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/gold_standard/estimates.json new file mode 100644 index 0000000..9ea7c5f --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/gold_standard/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":8833824.074708333,"upper_bound":8915798.563333329},"point_estimate":8874930.57833333,"standard_error":20879.85779316704},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":8837037.833333334,"upper_bound":8936574.0},"point_estimate":8888935.833333332,"standard_error":26766.372712948083},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":165373.64886403084,"upper_bound":288374.5904803276},"point_estimate":233619.08470242986,"standard_error":31796.078669134673},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":182365.40571385314,"upper_bound":234555.15182122847},"point_estimate":209913.20656842188,"standard_error":13268.280058798873}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/gold_standard/sample.json b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/gold_standard/sample.json new file mode 100644 index 0000000..5d66c8b --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/gold_standard/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0],"times":[50669467.0,50553538.0,52464947.0,52176890.0,51929117.0,52849788.0,51220383.0,54723878.0,53463462.0,54324031.0,53574061.0,51756900.0,52684899.0,52269884.0,52027019.0,51107346.0,54848339.0,56158822.0,54328009.0,54115144.0,53555289.0,54554585.0,54805090.0,53215016.0,54971641.0,53317477.0,50790535.0,54695379.0,53287132.0,53022227.0,53929509.0,54102155.0,53335768.0,53811649.0,52025813.0,55051307.0,51720940.0,52985515.0,54693540.0,53476925.0,53331462.0,52179723.0,52352147.0,51953691.0,53869840.0,52137857.0,52584804.0,53680157.0,55300435.0,52476520.0,54028512.0,52242022.0,52641853.0,51761468.0,53734347.0,51339167.0,52219060.0,53991337.0,54686219.0,51461057.0,52424196.0,54454855.0,53884399.0,52752182.0,53059347.0,51408214.0,53751444.0,54592856.0,53449801.0,53467699.0,53099536.0,52188100.0,54728745.0,54037938.0,56065403.0,52998121.0,53436623.0,51758656.0,54572276.0,55165897.0,50871847.0,56319401.0,54733920.0,53074228.0,53630636.0,54688201.0,53850410.0,53538828.0,53162397.0,53944714.0,52078063.0,51269243.0,53619444.0,53619583.0,52670832.0,53816036.0,53122567.0,54230278.0,51928454.0,52927883.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/gold_standard/tukey.json b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/gold_standard/tukey.json new file mode 100644 index 0000000..74c4fc9 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/gold_standard/tukey.json @@ -0,0 +1 @@ +[7797191.541666662,8251619.229166664,9463426.395833336,9917854.083333338] \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/new/benchmark.json b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/new/benchmark.json new file mode 100644 index 0000000..5ea831c --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/new/benchmark.json @@ -0,0 +1 @@ +{"group_id":"composite_scratch_pooling","function_id":"warm_composite","value_str":null,"throughput":null,"full_id":"composite_scratch_pooling/warm_composite","directory_name":"composite_scratch_pooling/warm_composite","title":"composite_scratch_pooling/warm_composite"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/new/estimates.json b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/new/estimates.json new file mode 100644 index 0000000..9ea7c5f --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/new/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":8833824.074708333,"upper_bound":8915798.563333329},"point_estimate":8874930.57833333,"standard_error":20879.85779316704},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":8837037.833333334,"upper_bound":8936574.0},"point_estimate":8888935.833333332,"standard_error":26766.372712948083},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":165373.64886403084,"upper_bound":288374.5904803276},"point_estimate":233619.08470242986,"standard_error":31796.078669134673},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":182365.40571385314,"upper_bound":234555.15182122847},"point_estimate":209913.20656842188,"standard_error":13268.280058798873}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/new/sample.json b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/new/sample.json new file mode 100644 index 0000000..5d66c8b --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/new/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0],"times":[50669467.0,50553538.0,52464947.0,52176890.0,51929117.0,52849788.0,51220383.0,54723878.0,53463462.0,54324031.0,53574061.0,51756900.0,52684899.0,52269884.0,52027019.0,51107346.0,54848339.0,56158822.0,54328009.0,54115144.0,53555289.0,54554585.0,54805090.0,53215016.0,54971641.0,53317477.0,50790535.0,54695379.0,53287132.0,53022227.0,53929509.0,54102155.0,53335768.0,53811649.0,52025813.0,55051307.0,51720940.0,52985515.0,54693540.0,53476925.0,53331462.0,52179723.0,52352147.0,51953691.0,53869840.0,52137857.0,52584804.0,53680157.0,55300435.0,52476520.0,54028512.0,52242022.0,52641853.0,51761468.0,53734347.0,51339167.0,52219060.0,53991337.0,54686219.0,51461057.0,52424196.0,54454855.0,53884399.0,52752182.0,53059347.0,51408214.0,53751444.0,54592856.0,53449801.0,53467699.0,53099536.0,52188100.0,54728745.0,54037938.0,56065403.0,52998121.0,53436623.0,51758656.0,54572276.0,55165897.0,50871847.0,56319401.0,54733920.0,53074228.0,53630636.0,54688201.0,53850410.0,53538828.0,53162397.0,53944714.0,52078063.0,51269243.0,53619444.0,53619583.0,52670832.0,53816036.0,53122567.0,54230278.0,51928454.0,52927883.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/new/tukey.json b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/new/tukey.json new file mode 100644 index 0000000..74c4fc9 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/new/tukey.json @@ -0,0 +1 @@ +[7797191.541666662,8251619.229166664,9463426.395833336,9917854.083333338] \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/MAD.svg b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/MAD.svg new file mode 100644 index 0000000..ea073fd --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/MAD.svg @@ -0,0 +1,88 @@ + + +composite_scratch_pooling/warm_composite:MAD + + +Density (a.u.) + + +Average time (µs) + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + +0.014 + + + + +160 + + + +180 + + + +200 + + + +220 + + + +240 + + + +260 + + + +280 + + + +300 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/SD.svg b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/SD.svg new file mode 100644 index 0000000..23a8235 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/SD.svg @@ -0,0 +1,80 @@ + + +composite_scratch_pooling/warm_composite:SD + + +Density (a.u.) + + +Average time (µs) + + + +0.005 + + + +0.01 + + + +0.015 + + + +0.02 + + + +0.025 + + + +0.03 + + + + +180 + + + +190 + + + +200 + + + +210 + + + +220 + + + +230 + + + +240 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/both/iteration_times.svg b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/both/iteration_times.svg new file mode 100644 index 0000000..1909e35 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/both/iteration_times.svg @@ -0,0 +1,323 @@ + + +composite_scratch_pooling/warm_composite + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + + + +8.4 + + + +8.5 + + + +8.6 + + + +8.7 + + + +8.8 + + + +8.9 + + + +9.0 + + + +9.1 + + + +9.2 + + + +9.3 + + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Current + + +Base + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/both/pdf.svg b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/both/pdf.svg new file mode 100644 index 0000000..e5ab775 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/both/pdf.svg @@ -0,0 +1,61 @@ + + +composite_scratch_pooling/warm_composite + + +Density (a.u.) + + +Average Time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + + +8.5 + + + +9 + + + +9.5 + + + + + + + +Base PDF + + +New PDF + + +Base Mean + + +New Mean + + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/change/mean.svg b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/change/mean.svg new file mode 100644 index 0000000..d4434c5 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/change/mean.svg @@ -0,0 +1,89 @@ + + +composite_scratch_pooling/warm_composite:mean + + +Density (a.u.) + + +Relative change (%) + + + +20 + + + +40 + + + +60 + + + +80 + + + +100 + + + +120 + + + + +0.012 + + + +0.014 + + + +0.016 + + + +0.018 + + + +0.02 + + + +0.022 + + + +0.024 + + + +0.026 + + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + +Noise threshold + + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/change/median.svg b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/change/median.svg new file mode 100644 index 0000000..1316da7 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/change/median.svg @@ -0,0 +1,93 @@ + + +composite_scratch_pooling/warm_composite:median + + +Density (a.u.) + + +Relative change (%) + + + +20 + + + +40 + + + +60 + + + +80 + + + +100 + + + +120 + + + + +0.016 + + + +0.018 + + + +0.02 + + + +0.022 + + + +0.024 + + + +0.026 + + + +0.028 + + + +0.03 + + + +0.032 + + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + +Noise threshold + + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/change/t-test.svg b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/change/t-test.svg new file mode 100644 index 0000000..202201a --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/change/t-test.svg @@ -0,0 +1,99 @@ + + +composite_scratch_pooling/warm_composite: Welch t test + + +Density + + +t score + + + +0.0 + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + +0.35 + + + +0.4 + + + + +-5.0 + + + +-4.0 + + + +-3.0 + + + +-2.0 + + + +-1.0 + + + +0.0 + + + +1.0 + + + +2.0 + + + +3.0 + + + +4.0 + + + + + +t distribution + + +t statistic + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/index.html b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/index.html new file mode 100644 index 0000000..68d253e --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/index.html @@ -0,0 +1,269 @@ + + + + + + composite_scratch_pooling/warm_composite - Criterion.rs + + + + +
+

composite_scratch_pooling/warm_composite

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
R²0.00063400.00065860.0006343
Mean8.8338 ms8.8749 ms8.9158 ms
Std. Dev.182.37 µs209.91 µs234.56 µs
Median8.8370 ms8.8889 ms8.9366 ms
MAD165.37 µs233.62 µs288.37 µs
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probability of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the average time per iteration for the samples. Each point + represents one sample.

+

See the + documentation for more details on the additional statistics.

+
+
+
+

Change Since Previous Benchmark

+
+ + + + + + + +
+ + PDF Comparison + + + + Iteration Time Comparison + +
+
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
Change in time+1.2594%+1.8661%+2.5226%(p = 0.00 < + 0.05)
+ Performance has regressed. +
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left shows the probability of the function taking a certain amount of time. The red + curve represents the saved measurements from the last time this benchmark was run, while the blue curve + shows the measurements from this run. The lines represent the mean time per iteration. Click on the + plot for a larger view.

+

The plot on the right shows the iteration times for the two measurements. Again, the red dots represent + the previous measurement while the blue dots show the current measurement.

+

See the + documentation for more details on the additional statistics.

+
+
+ + + + \ No newline at end of file diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/iteration_times.svg b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/iteration_times.svg new file mode 100644 index 0000000..deb123a --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/iteration_times.svg @@ -0,0 +1,209 @@ + + +composite_scratch_pooling/warm_composite + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + +8.5 + + + +8.6 + + + +8.7 + + + +8.8 + + + +8.9 + + + +9.0 + + + +9.1 + + + +9.2 + + + +9.3 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/iteration_times_small.svg b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/iteration_times_small.svg new file mode 100644 index 0000000..af89051 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/iteration_times_small.svg @@ -0,0 +1,202 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + +8.5 + + + +8.6 + + + +8.7 + + + +8.8 + + + +8.9 + + + +9.0 + + + +9.1 + + + +9.2 + + + +9.3 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/mean.svg b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/mean.svg new file mode 100644 index 0000000..0c689b6 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/mean.svg @@ -0,0 +1,108 @@ + + +composite_scratch_pooling/warm_composite:mean + + +Density (a.u.) + + +Average time (ms) + + + +2 + + + +4 + + + +6 + + + +8 + + + +10 + + + +12 + + + +14 + + + +16 + + + +18 + + + +20 + + + + +8.83 + + + +8.84 + + + +8.85 + + + +8.86 + + + +8.87 + + + +8.88 + + + +8.89 + + + +8.9 + + + +8.91 + + + +8.92 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/median.svg b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/median.svg new file mode 100644 index 0000000..c998a32 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/median.svg @@ -0,0 +1,76 @@ + + +composite_scratch_pooling/warm_composite:median + + +Density (a.u.) + + +Average time (ms) + + + +5 + + + +10 + + + +15 + + + +20 + + + +25 + + + +30 + + + + +8.84 + + + +8.86 + + + +8.88 + + + +8.9 + + + +8.92 + + + +8.94 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/pdf.svg b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/pdf.svg new file mode 100644 index 0000000..ade2118 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/pdf.svg @@ -0,0 +1,139 @@ + + +composite_scratch_pooling/warm_composite + + +Iterations + + +Average Time (ms) + + + +0 + + + +1 + + + +2 + + + +3 + + + +4 + + + +5 + + + +6 + + + + +8.2 + + + +8.4 + + + +8.6 + + + +8.8 + + + +9 + + + +9.2 + + + +9.4 + + + +9.6 + + + +Density (a.u.) + + + +0 + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/pdf_small.svg b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/pdf_small.svg new file mode 100644 index 0000000..5ffbfbb --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/pdf_small.svg @@ -0,0 +1,64 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0 + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + + +8.5 + + + +9 + + + +9.5 + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/relative_iteration_times_small.svg b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/relative_iteration_times_small.svg new file mode 100644 index 0000000..afd0c90 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/relative_iteration_times_small.svg @@ -0,0 +1,312 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + + + +8.4 + + + +8.5 + + + +8.6 + + + +8.7 + + + +8.8 + + + +8.9 + + + +9.0 + + + +9.1 + + + +9.2 + + + +9.3 + + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/relative_pdf_small.svg b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/relative_pdf_small.svg new file mode 100644 index 0000000..e6b8b99 --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/relative_pdf_small.svg @@ -0,0 +1,42 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + + +8.5 + + + +9 + + + +9.5 + + + + + + + diff --git a/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/typical.svg b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/typical.svg new file mode 100644 index 0000000..8f3342a --- /dev/null +++ b/hcie-engine-api/criterion/composite_scratch_pooling/warm_composite/report/typical.svg @@ -0,0 +1,108 @@ + + +composite_scratch_pooling/warm_composite:typical + + +Density (a.u.) + + +Average time (ms) + + + +2 + + + +4 + + + +6 + + + +8 + + + +10 + + + +12 + + + +14 + + + +16 + + + +18 + + + +20 + + + + +8.83 + + + +8.84 + + + +8.85 + + + +8.86 + + + +8.87 + + + +8.88 + + + +8.89 + + + +8.9 + + + +8.91 + + + +8.92 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/change/estimates.json b/hcie-engine-api/criterion/effects_skip/no_effects_composite/change/estimates.json new file mode 100644 index 0000000..e42dd27 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/change/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":0.034761625278430124,"upper_bound":0.07314775787106842},"point_estimate":0.05371890896960818,"standard_error":0.009051503433003524},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":0.034331467072478694,"upper_bound":0.07675830387455829},"point_estimate":0.05907483992006002,"standard_error":0.012159567075264497}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/gold_standard/benchmark.json b/hcie-engine-api/criterion/effects_skip/no_effects_composite/gold_standard/benchmark.json new file mode 100644 index 0000000..f203c7a --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/gold_standard/benchmark.json @@ -0,0 +1 @@ +{"group_id":"effects_skip","function_id":"no_effects_composite","value_str":null,"throughput":null,"full_id":"effects_skip/no_effects_composite","directory_name":"effects_skip/no_effects_composite","title":"effects_skip/no_effects_composite"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/gold_standard/estimates.json b/hcie-engine-api/criterion/effects_skip/no_effects_composite/gold_standard/estimates.json new file mode 100644 index 0000000..71d45d9 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/gold_standard/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":13937337.61,"upper_bound":14019172.0925},"point_estimate":13977506.8125,"standard_error":20874.99758836791},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":13881978.75,"upper_bound":14003981.5},"point_estimate":13933151.5,"standard_error":30198.865078642986},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":147542.78963059187,"upper_bound":237540.87050780654},"point_estimate":204406.05837106705,"standard_error":23127.60117388614},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":176144.55761927654,"upper_bound":239375.9100021363},"point_estimate":209400.53990165357,"standard_error":16088.127991593521}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/gold_standard/sample.json b/hcie-engine-api/criterion/effects_skip/no_effects_composite/gold_standard/sample.json new file mode 100644 index 0000000..c883783 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/gold_standard/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[56564036.0,56003273.0,55973236.0,57288676.0,55291906.0,56532921.0,55365187.0,55670730.0,58406022.0,55347378.0,56474485.0,55433570.0,55493515.0,56351011.0,56081309.0,56633326.0,57500207.0,54923023.0,55169819.0,56116750.0,55361067.0,55937358.0,56505503.0,55108064.0,55488396.0,55833870.0,56569096.0,56451135.0,56366251.0,55270468.0,55024782.0,55683244.0,56480197.0,56247958.0,57703905.0,56219634.0,57074071.0,55211696.0,56833181.0,55840898.0,56321199.0,55340192.0,55700083.0,55061060.0,55713246.0,54360823.0,54420641.0,55438763.0,56284667.0,55427977.0,54312713.0,56629791.0,55387336.0,54806047.0,55070687.0,55751966.0,55188685.0,55100792.0,56405336.0,54684438.0,57411679.0,56779614.0,55857353.0,55644283.0,56306752.0,56283505.0,57530359.0,55560448.0,56028579.0,55663583.0,55227716.0,56473408.0,56784775.0,55471252.0,55472821.0,55703851.0,54929711.0,54953982.0,56333894.0,55962629.0,57077413.0,56643986.0,55497623.0,55826969.0,55407471.0,56095739.0,55398464.0,58274241.0,54941127.0,57216799.0,55527915.0,55286755.0,54454572.0,55675687.0,54999787.0,56376613.0,55524216.0,55346763.0,57839333.0,55973462.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/gold_standard/tukey.json b/hcie-engine-api/criterion/effects_skip/no_effects_composite/gold_standard/tukey.json new file mode 100644 index 0000000..c182d32 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/gold_standard/tukey.json @@ -0,0 +1 @@ +[13034634.9375,13435720.5,14505282.0,14906367.5625] \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/new/benchmark.json b/hcie-engine-api/criterion/effects_skip/no_effects_composite/new/benchmark.json new file mode 100644 index 0000000..f203c7a --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/new/benchmark.json @@ -0,0 +1 @@ +{"group_id":"effects_skip","function_id":"no_effects_composite","value_str":null,"throughput":null,"full_id":"effects_skip/no_effects_composite","directory_name":"effects_skip/no_effects_composite","title":"effects_skip/no_effects_composite"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/new/estimates.json b/hcie-engine-api/criterion/effects_skip/no_effects_composite/new/estimates.json new file mode 100644 index 0000000..c216338 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/new/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14489359.423990931,"upper_bound":14965903.217063496},"point_estimate":14728363.228582766,"standard_error":122541.98386463229},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14443402.142857144,"upper_bound":14991818.8},"point_estimate":14756250.194444444,"standard_error":168663.20921372937},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14959.211344417596,"upper_bound":706723.9022031426},"point_estimate":349704.1786981772,"standard_error":168844.76233691556},"slope":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14608988.623323616,"upper_bound":14931223.931559743},"point_estimate":14774227.79703154,"standard_error":81469.75428884804},"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":215267.60641111113,"upper_bound":535504.4162481199},"point_estimate":409132.5918545875,"standard_error":83033.2681976765}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/new/sample.json b/hcie-engine-api/criterion/effects_skip/no_effects_composite/new/sample.json new file mode 100644 index 0000000..fc1d453 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/new/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Linear","iters":[7.0,14.0,21.0,28.0,35.0,42.0,49.0,56.0,63.0,70.0],"times":[98090233.0,209619951.0,303311445.0,432586907.0,524713658.0,602268531.0,713855593.0,839575860.0,923965562.0,1039246625.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/new/tukey.json b/hcie-engine-api/criterion/effects_skip/no_effects_composite/new/tukey.json new file mode 100644 index 0000000..d67441c --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/new/tukey.json @@ -0,0 +1 @@ +[12937455.386224488,13706063.682908162,15755685.807397962,16524294.104081636] \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/MAD.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/MAD.svg new file mode 100644 index 0000000..d5cc1d6 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/MAD.svg @@ -0,0 +1,84 @@ + + +effects_skip/no_effects_composite:MAD + + +Density (a.u.) + + +Average time (µs) + + + +5e-4 + + + +0.001 + + + +0.0015 + + + +0.002 + + + +0.0025 + + + +0.003 + + + + +0 + + + +100 + + + +200 + + + +300 + + + +400 + + + +500 + + + +600 + + + +700 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/SD.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/SD.svg new file mode 100644 index 0000000..28ab21c --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/SD.svg @@ -0,0 +1,104 @@ + + +effects_skip/no_effects_composite:SD + + +Density (a.u.) + + +Average time (µs) + + + +5e-4 + + + +0.001 + + + +0.0015 + + + +0.002 + + + +0.0025 + + + +0.003 + + + +0.0035 + + + +0.004 + + + +0.0045 + + + +0.005 + + + +0.0055 + + + + +200 + + + +250 + + + +300 + + + +350 + + + +400 + + + +450 + + + +500 + + + +550 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/both/iteration_times.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/both/iteration_times.svg new file mode 100644 index 0000000..5b62296 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/both/iteration_times.svg @@ -0,0 +1,233 @@ + + +effects_skip/no_effects_composite + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + + + +13.6 + + + +13.8 + + + +14.0 + + + +14.2 + + + +14.4 + + + +14.6 + + + +14.8 + + + +15.0 + + + +15.2 + + + +15.4 + + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Current + + +Base + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/both/pdf.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/both/pdf.svg new file mode 100644 index 0000000..681ebd0 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/both/pdf.svg @@ -0,0 +1,81 @@ + + +effects_skip/no_effects_composite + + +Density (a.u.) + + +Average Time (ms) + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + + +14 + + + +15 + + + +16 + + + + + + + +Base PDF + + +New PDF + + +Base Mean + + +New Mean + + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/change/mean.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/change/mean.svg new file mode 100644 index 0000000..863da01 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/change/mean.svg @@ -0,0 +1,105 @@ + + +effects_skip/no_effects_composite:mean + + +Density (a.u.) + + +Relative change (%) + + + +5 + + + +10 + + + +15 + + + +20 + + + +25 + + + +30 + + + +35 + + + +40 + + + +45 + + + + +0.035 + + + +0.04 + + + +0.045 + + + +0.05 + + + +0.055 + + + +0.06 + + + +0.065 + + + +0.07 + + + +0.075 + + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + +Noise threshold + + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/change/median.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/change/median.svg new file mode 100644 index 0000000..c00250a --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/change/median.svg @@ -0,0 +1,101 @@ + + +effects_skip/no_effects_composite:median + + +Density (a.u.) + + +Relative change (%) + + + +5 + + + +10 + + + +15 + + + +20 + + + +25 + + + +30 + + + + +0.03 + + + +0.035 + + + +0.04 + + + +0.045 + + + +0.05 + + + +0.055 + + + +0.06 + + + +0.065 + + + +0.07 + + + +0.075 + + + +0.08 + + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + +Noise threshold + + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/change/t-test.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/change/t-test.svg new file mode 100644 index 0000000..37b3b79 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/change/t-test.svg @@ -0,0 +1,87 @@ + + +effects_skip/no_effects_composite: Welch t test + + +Density + + +t score + + + +0.0 + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + +0.35 + + + +0.4 + + + + +-8.0 + + + +-6.0 + + + +-4.0 + + + +-2.0 + + + +0.0 + + + +2.0 + + + +4.0 + + + + + +t distribution + + +t statistic + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/index.html b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/index.html new file mode 100644 index 0000000..a65cc05 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/index.html @@ -0,0 +1,279 @@ + + + + + + effects_skip/no_effects_composite - Criterion.rs + + + + +
+

effects_skip/no_effects_composite

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Regression + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
Slope14.609 ms14.774 ms14.931 ms
R²0.99250930.99480650.9927323
Mean14.489 ms14.728 ms14.966 ms
Std. Dev.215.27 µs409.13 µs535.50 µs
Median14.443 ms14.756 ms14.992 ms
MAD14.959 µs349.70 µs706.72 µs
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probability of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the linear regression calculated from the measurements. Each point + represents a sample, though here it shows the total time for the sample rather than time per + iteration. The line is the line of best fit for these measurements.

+

See the + documentation for more details on the additional statistics.

+
+
+
+

Change Since Previous Benchmark

+
+ + + + + + + +
+ + PDF Comparison + + + + Regression Comparison + +
+
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
Change in time+3.4762%+5.3719%+7.3148%(p = 0.00 < + 0.05)
+ Performance has regressed. +
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left shows the probability of the function taking a certain amount of time. The red + curve represents the saved measurements from the last time this benchmark was run, while the blue curve + shows the measurements from this run. The lines represent the mean time per iteration. Click on the + plot for a larger view.

+

The plot on the right shows the two regressions. Again, the red line represents the previous measurement + while the blue line shows the current measurement.

+

See the + documentation for more details on the additional statistics.

+
+
+ + + + \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/iteration_times.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/iteration_times.svg new file mode 100644 index 0000000..d863459 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/iteration_times.svg @@ -0,0 +1,219 @@ + + +effects_skip/no_effects_composite + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + + + +13.6 + + + +13.8 + + + +14.0 + + + +14.2 + + + +14.4 + + + +14.6 + + + +14.8 + + + +15.0 + + + +15.2 + + + +15.4 + + + +15.6 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/iteration_times_small.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/iteration_times_small.svg new file mode 100644 index 0000000..693d0e8 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/iteration_times_small.svg @@ -0,0 +1,212 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + + + +13.6 + + + +13.8 + + + +14.0 + + + +14.2 + + + +14.4 + + + +14.6 + + + +14.8 + + + +15.0 + + + +15.2 + + + +15.4 + + + +15.6 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/mean.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/mean.svg new file mode 100644 index 0000000..b99cde5 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/mean.svg @@ -0,0 +1,80 @@ + + +effects_skip/no_effects_composite:mean + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + + +14.5 + + + +14.6 + + + +14.7 + + + +14.8 + + + +14.9 + + + +15 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/median.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/median.svg new file mode 100644 index 0000000..ca3c91b --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/median.svg @@ -0,0 +1,84 @@ + + +effects_skip/no_effects_composite:median + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + + +14.4 + + + +14.5 + + + +14.6 + + + +14.7 + + + +14.8 + + + +14.9 + + + +15 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/pdf.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/pdf.svg new file mode 100644 index 0000000..7442f50 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/pdf.svg @@ -0,0 +1,135 @@ + + +effects_skip/no_effects_composite + + +Iterations + + +Average Time (ms) + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + + +13.5 + + + +14 + + + +14.5 + + + +15 + + + +15.5 + + + +16 + + + +Density (a.u.) + + + +0 + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/pdf_small.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/pdf_small.svg new file mode 100644 index 0000000..ca22636 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/pdf_small.svg @@ -0,0 +1,64 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0 + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + + +14 + + + +15 + + + +16 + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/regression.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/regression.svg new file mode 100644 index 0000000..7efdc96 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/regression.svg @@ -0,0 +1,122 @@ + + +effects_skip/no_effects_composite + + +Total sample time (s) + + +Iterations + + + + + + + + + + + + + + + + + + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + +1.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + + + + + + + + + + + + + +Sample + + +Linear regression + + +Confidence interval + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/regression_small.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/regression_small.svg new file mode 100644 index 0000000..25a4df1 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/regression_small.svg @@ -0,0 +1,107 @@ + + +Total sample time (s) + + +Iterations + + + + + + + + + + + + + + + + + + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + +1.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/relative_iteration_times_small.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/relative_iteration_times_small.svg new file mode 100644 index 0000000..d84a1c7 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/relative_iteration_times_small.svg @@ -0,0 +1,222 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + + + +13.6 + + + +13.8 + + + +14.0 + + + +14.2 + + + +14.4 + + + +14.6 + + + +14.8 + + + +15.0 + + + +15.2 + + + +15.4 + + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/relative_pdf_small.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/relative_pdf_small.svg new file mode 100644 index 0000000..433fadd --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/relative_pdf_small.svg @@ -0,0 +1,62 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + + +14 + + + +15 + + + +16 + + + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/slope.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/slope.svg new file mode 100644 index 0000000..0d985ed --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/slope.svg @@ -0,0 +1,104 @@ + + +effects_skip/no_effects_composite:slope + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + +4 + + + +4.5 + + + +5 + + + +5.5 + + + + +14.6 + + + +14.65 + + + +14.7 + + + +14.75 + + + +14.8 + + + +14.85 + + + +14.9 + + + +14.95 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/typical.svg b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/typical.svg new file mode 100644 index 0000000..895eaac --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/report/typical.svg @@ -0,0 +1,104 @@ + + +effects_skip/no_effects_composite:typical + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + +4 + + + +4.5 + + + +5 + + + +5.5 + + + + +14.6 + + + +14.65 + + + +14.7 + + + +14.75 + + + +14.8 + + + +14.85 + + + +14.9 + + + +14.95 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/test/benchmark.json b/hcie-engine-api/criterion/effects_skip/no_effects_composite/test/benchmark.json new file mode 100644 index 0000000..f203c7a --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/test/benchmark.json @@ -0,0 +1 @@ +{"group_id":"effects_skip","function_id":"no_effects_composite","value_str":null,"throughput":null,"full_id":"effects_skip/no_effects_composite","directory_name":"effects_skip/no_effects_composite","title":"effects_skip/no_effects_composite"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/test/estimates.json b/hcie-engine-api/criterion/effects_skip/no_effects_composite/test/estimates.json new file mode 100644 index 0000000..20b362b --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/test/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":13882208.7125,"upper_bound":13963853.015},"point_estimate":13921876.4575,"standard_error":20860.886205639155},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":13863436.125,"upper_bound":13951550.75},"point_estimate":13894936.25,"standard_error":20552.49015579248},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":149875.2900391817,"upper_bound":268666.57435521483},"point_estimate":227249.2174655199,"standard_error":30378.928813134175},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":167633.73642587324,"upper_bound":257685.87849330832},"point_estimate":209358.12258573834,"standard_error":23802.1078871056}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/test/sample.json b/hcie-engine-api/criterion/effects_skip/no_effects_composite/test/sample.json new file mode 100644 index 0000000..bf7b2e1 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/test/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[55610135.0,55591982.0,55169520.0,56698105.0,55494686.0,56222967.0,54659744.0,59628081.0,55305491.0,54597486.0,56439735.0,54131393.0,56523199.0,56283845.0,55833798.0,55484657.0,56587242.0,56491354.0,54843943.0,57124643.0,55341984.0,55494640.0,55090092.0,54708491.0,55062740.0,54608203.0,57245695.0,56480370.0,54553430.0,55248571.0,57541850.0,56229539.0,56309185.0,54966804.0,56059782.0,56351069.0,56442216.0,55706097.0,55569895.0,54856580.0,56275658.0,55746671.0,54736182.0,55479466.0,55392229.0,56236604.0,54736632.0,56138892.0,55460531.0,55589595.0,56333510.0,55359009.0,55246157.0,55521148.0,55617005.0,54656407.0,55625871.0,55428023.0,55492584.0,55083250.0,55806203.0,55235753.0,55603956.0,55120765.0,56504797.0,56289295.0,56329282.0,57057992.0,55567487.0,54932667.0,54546327.0,54568407.0,56668468.0,55265101.0,54557389.0,55828080.0,56259253.0,56061083.0,54395045.0,56360887.0,54939099.0,55943034.0,55118551.0,54596182.0,55462438.0,56584549.0,55258024.0,56710693.0,57062787.0,55965909.0,55963026.0,55816190.0,55663395.0,55236105.0,55851967.0,55255408.0,56936377.0,54966466.0,54583165.0,55134318.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/no_effects_composite/test/tukey.json b/hcie-engine-api/criterion/effects_skip/no_effects_composite/test/tukey.json new file mode 100644 index 0000000..da7e4a4 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/no_effects_composite/test/tukey.json @@ -0,0 +1 @@ +[12911932.9375,13345992.90625,14503486.15625,14937546.125] \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/report/index.html b/hcie-engine-api/criterion/effects_skip/report/index.html new file mode 100644 index 0000000..943d9c2 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/report/index.html @@ -0,0 +1,116 @@ + + + + + + effects_skip Summary - Criterion.rs + + + + +
+

effects_skip

+

Violin Plot

+ + Violin Plot + +

This chart shows the relationship between function/parameter and iteration time. The thickness of the shaded + region indicates the probability that a measurement of the given function/parameter would take a particular + length of time.

+
+ +

effects_skip/no_effects_composite

+ + + + + + + + +
+ + PDF of Slope + + + + Regression + +
+
+
+ +

effects_skip/with_one_dropshadow

+ + + + + + + + +
+ + PDF of Slope + + + + Regression + +
+
+
+ + + + \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/report/violin.svg b/hcie-engine-api/criterion/effects_skip/report/violin.svg new file mode 100644 index 0000000..f687a9e --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/report/violin.svg @@ -0,0 +1,61 @@ + + +effects_skip: Violin plot + + +Input + + +Average time (ms) + + + +effects_skip/with_one_dropshadow + + + +effects_skip/no_effects_composite + + + + +0.0 + + + +2.0 + + + +4.0 + + + +6.0 + + + +8.0 + + + +10.0 + + + +12.0 + + + +14.0 + + + +16.0 + + + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/change/estimates.json b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/change/estimates.json new file mode 100644 index 0000000..a3f943e --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/change/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":0.014738607802012346,"upper_bound":0.029620078385296178},"point_estimate":0.022557326823245516,"standard_error":0.003812643028716162},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":0.016293199660087687,"upper_bound":0.03719622272195244},"point_estimate":0.027121229448969553,"standard_error":0.0051023813855230055}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/gold_standard/benchmark.json b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/gold_standard/benchmark.json new file mode 100644 index 0000000..1bc82f5 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/gold_standard/benchmark.json @@ -0,0 +1 @@ +{"group_id":"effects_skip","function_id":"with_one_dropshadow","value_str":null,"throughput":null,"full_id":"effects_skip/with_one_dropshadow","directory_name":"effects_skip/with_one_dropshadow","title":"effects_skip/with_one_dropshadow"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/gold_standard/estimates.json b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/gold_standard/estimates.json new file mode 100644 index 0000000..c976828 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/gold_standard/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":13936193.647312501,"upper_bound":14040430.1665},"point_estimate":13985078.32,"standard_error":26790.880008867774},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":13882190.0,"upper_bound":13985154.75},"point_estimate":13934771.125,"standard_error":30244.327426531272},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":136361.39127910137,"upper_bound":213083.3453670144},"point_estimate":182124.43401664495,"standard_error":19710.390402435474},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":180990.14708343882,"upper_bound":362815.00273752125},"point_estimate":268621.3602391758,"standard_error":48943.25261868776}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/gold_standard/sample.json b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/gold_standard/sample.json new file mode 100644 index 0000000..26c7936 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/gold_standard/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[56258289.0,55612473.0,55163258.0,55244668.0,56441988.0,55528760.0,58379280.0,56407099.0,56139318.0,56547921.0,55303437.0,55836536.0,56161117.0,55576077.0,56141180.0,56286080.0,55964879.0,56668895.0,56049305.0,62357275.0,55431676.0,55516518.0,55911397.0,56309162.0,55155102.0,55172582.0,55722177.0,58337417.0,56039132.0,55200359.0,55535484.0,55709698.0,55541460.0,55370385.0,55781584.0,55147293.0,58823138.0,55798351.0,54816334.0,55190951.0,55387275.0,55333761.0,54789773.0,57936848.0,55523252.0,57021676.0,55136388.0,56811097.0,56114375.0,55027929.0,57000285.0,55296418.0,55030925.0,57876848.0,55488286.0,57131417.0,55940619.0,55379025.0,55531716.0,55543499.0,55213710.0,56269359.0,56451905.0,55250771.0,56063498.0,55416173.0,56213874.0,56891980.0,55026976.0,55443480.0,56257308.0,54485274.0,54090427.0,56239166.0,54895579.0,55767240.0,55125885.0,55448428.0,55755992.0,56104174.0,55292206.0,57117914.0,54786296.0,55852547.0,55584536.0,55354749.0,55905275.0,55499311.0,55810000.0,55977117.0,56160275.0,56284803.0,55089266.0,55108584.0,55311484.0,56740609.0,58291639.0,54605076.0,56577764.0,56391231.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/gold_standard/tukey.json b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/gold_standard/tukey.json new file mode 100644 index 0000000..777c6fc --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/gold_standard/tukey.json @@ -0,0 +1 @@ +[13105889.875,13465655.21875,14425029.46875,14784794.8125] \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/new/benchmark.json b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/new/benchmark.json new file mode 100644 index 0000000..1bc82f5 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/new/benchmark.json @@ -0,0 +1 @@ +{"group_id":"effects_skip","function_id":"with_one_dropshadow","value_str":null,"throughput":null,"full_id":"effects_skip/with_one_dropshadow","directory_name":"effects_skip/with_one_dropshadow","title":"effects_skip/with_one_dropshadow"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/new/estimates.json b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/new/estimates.json new file mode 100644 index 0000000..93777f0 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/new/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14213710.981147958,"upper_bound":14386933.721301023},"point_estimate":14300544.302312925,"standard_error":44431.33043385798},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14177937.214285715,"upper_bound":14425684.357142856},"point_estimate":14312699.25,"standard_error":60917.231422250465},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":10361.344066050226,"upper_bound":271297.8345435011},"point_estimate":168340.38436136037,"standard_error":61749.88381877133},"slope":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14222879.778425656,"upper_bound":14419049.999577345},"point_estimate":14307982.573283859,"standard_error":49214.65666315303},"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":86614.36665301911,"upper_bound":183067.6652700812},"point_estimate":148090.3066843547,"standard_error":24507.697487850717}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/new/sample.json b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/new/sample.json new file mode 100644 index 0000000..929911a --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/new/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Linear","iters":[7.0,14.0,21.0,28.0,35.0,42.0,49.0,56.0,63.0,70.0],"times":[99390174.0,196952344.0,300795187.0,400842272.0,507585927.0,605878743.0,710785645.0,791642840.0,895821894.0,1001672215.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/new/tukey.json b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/new/tukey.json new file mode 100644 index 0000000..8f4e528 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/new/tukey.json @@ -0,0 +1 @@ +[13614708.946428573,13909252.473214287,14694701.87797619,14989245.404761903] \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/MAD.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/MAD.svg new file mode 100644 index 0000000..34493d8 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/MAD.svg @@ -0,0 +1,96 @@ + + +effects_skip/with_one_dropshadow:MAD + + +Density (a.u.) + + +Average time (µs) + + + +0.001 + + + +0.002 + + + +0.003 + + + +0.004 + + + +0.005 + + + +0.006 + + + +0.007 + + + +0.008 + + + +0.009 + + + +0.01 + + + + +0 + + + +50 + + + +100 + + + +150 + + + +200 + + + +250 + + + +300 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/SD.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/SD.svg new file mode 100644 index 0000000..86450dd --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/SD.svg @@ -0,0 +1,88 @@ + + +effects_skip/with_one_dropshadow:SD + + +Density (a.u.) + + +Average time (µs) + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + +0.014 + + + +0.016 + + + +0.018 + + + + +80 + + + +100 + + + +120 + + + +140 + + + +160 + + + +180 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/both/iteration_times.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/both/iteration_times.svg new file mode 100644 index 0000000..4ee6593 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/both/iteration_times.svg @@ -0,0 +1,233 @@ + + +effects_skip/with_one_dropshadow + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + + + +13.6 + + + +13.8 + + + +14.0 + + + +14.2 + + + +14.4 + + + +14.6 + + + +14.8 + + + +15.0 + + + +15.2 + + + +15.4 + + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Current + + +Base + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/both/pdf.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/both/pdf.svg new file mode 100644 index 0000000..1ffa32f --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/both/pdf.svg @@ -0,0 +1,93 @@ + + +effects_skip/with_one_dropshadow + + +Density (a.u.) + + +Average Time (ms) + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + +2 + + + + +13.5 + + + +14 + + + +14.5 + + + +15 + + + +15.5 + + + + + + + +Base PDF + + +New PDF + + +Base Mean + + +New Mean + + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/change/mean.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/change/mean.svg new file mode 100644 index 0000000..2504f23 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/change/mean.svg @@ -0,0 +1,109 @@ + + +effects_skip/with_one_dropshadow:mean + + +Density (a.u.) + + +Relative change (%) + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + +0.014 + + + +0.016 + + + +0.018 + + + +0.02 + + + +0.022 + + + +0.024 + + + +0.026 + + + +0.028 + + + +0.03 + + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + +Noise threshold + + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/change/median.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/change/median.svg new file mode 100644 index 0000000..452125f --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/change/median.svg @@ -0,0 +1,77 @@ + + +effects_skip/with_one_dropshadow:median + + +Density (a.u.) + + +Relative change (%) + + + +20 + + + +40 + + + +60 + + + +80 + + + +100 + + + +120 + + + + +0.015 + + + +0.02 + + + +0.025 + + + +0.03 + + + +0.035 + + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + +Noise threshold + + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/change/t-test.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/change/t-test.svg new file mode 100644 index 0000000..a911bc1 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/change/t-test.svg @@ -0,0 +1,87 @@ + + +effects_skip/with_one_dropshadow: Welch t test + + +Density + + +t score + + + +0.0 + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + +0.35 + + + +0.4 + + + + +-8.0 + + + +-6.0 + + + +-4.0 + + + +-2.0 + + + +0.0 + + + +2.0 + + + +4.0 + + + + + +t distribution + + +t statistic + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/index.html b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/index.html new file mode 100644 index 0000000..79ac003 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/index.html @@ -0,0 +1,279 @@ + + + + + + effects_skip/with_one_dropshadow - Criterion.rs + + + + +
+

effects_skip/with_one_dropshadow

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Regression + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
Slope14.223 ms14.308 ms14.419 ms
R²0.99785270.99852330.9973815
Mean14.214 ms14.301 ms14.387 ms
Std. Dev.86.614 µs148.09 µs183.07 µs
Median14.178 ms14.313 ms14.426 ms
MAD10.361 µs168.34 µs271.30 µs
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probability of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the linear regression calculated from the measurements. Each point + represents a sample, though here it shows the total time for the sample rather than time per + iteration. The line is the line of best fit for these measurements.

+

See the + documentation for more details on the additional statistics.

+
+
+
+

Change Since Previous Benchmark

+
+ + + + + + + +
+ + PDF Comparison + + + + Regression Comparison + +
+
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
Change in time+1.4739%+2.2557%+2.9620%(p = 0.00 < + 0.05)
+ Performance has regressed. +
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left shows the probability of the function taking a certain amount of time. The red + curve represents the saved measurements from the last time this benchmark was run, while the blue curve + shows the measurements from this run. The lines represent the mean time per iteration. Click on the + plot for a larger view.

+

The plot on the right shows the two regressions. Again, the red line represents the previous measurement + while the blue line shows the current measurement.

+

See the + documentation for more details on the additional statistics.

+
+
+ + + + \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/iteration_times.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/iteration_times.svg new file mode 100644 index 0000000..ce2b050 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/iteration_times.svg @@ -0,0 +1,204 @@ + + +effects_skip/with_one_dropshadow + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + +13.7 + + + +13.8 + + + +13.9 + + + +14.0 + + + +14.1 + + + +14.2 + + + +14.3 + + + +14.4 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/iteration_times_small.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/iteration_times_small.svg new file mode 100644 index 0000000..66f8a5d --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/iteration_times_small.svg @@ -0,0 +1,197 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + +13.7 + + + +13.8 + + + +13.9 + + + +14.0 + + + +14.1 + + + +14.2 + + + +14.3 + + + +14.4 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/mean.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/mean.svg new file mode 100644 index 0000000..e845b5b --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/mean.svg @@ -0,0 +1,108 @@ + + +effects_skip/with_one_dropshadow:mean + + +Density (a.u.) + + +Average time (ms) + + + +1 + + + +2 + + + +3 + + + +4 + + + +5 + + + +6 + + + +7 + + + +8 + + + +9 + + + + +14.2 + + + +14.22 + + + +14.24 + + + +14.26 + + + +14.28 + + + +14.3 + + + +14.32 + + + +14.34 + + + +14.36 + + + +14.38 + + + +14.4 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/median.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/median.svg new file mode 100644 index 0000000..8046bd8 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/median.svg @@ -0,0 +1,72 @@ + + +effects_skip/with_one_dropshadow:median + + +Density (a.u.) + + +Average time (ms) + + + +5 + + + +10 + + + +15 + + + +20 + + + +25 + + + + +14.2 + + + +14.25 + + + +14.3 + + + +14.35 + + + +14.4 + + + +14.45 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/pdf.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/pdf.svg new file mode 100644 index 0000000..393e4b3 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/pdf.svg @@ -0,0 +1,163 @@ + + +effects_skip/with_one_dropshadow + + +Iterations + + +Average Time (ms) + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + + +13.8 + + + +13.9 + + + +14 + + + +14.1 + + + +14.2 + + + +14.3 + + + +14.4 + + + +14.5 + + + +14.6 + + + +14.7 + + + +14.8 + + + +Density (a.u.) + + + +0 + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + +2 + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/pdf_small.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/pdf_small.svg new file mode 100644 index 0000000..81ad83c --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/pdf_small.svg @@ -0,0 +1,40 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0 + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + + +14 + + + +14.5 + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/regression.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/regression.svg new file mode 100644 index 0000000..a906666 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/regression.svg @@ -0,0 +1,122 @@ + + +effects_skip/with_one_dropshadow + + +Total sample time (s) + + +Iterations + + + + + + + + + + + + + + + + + + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + +1.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + + + + + + + + + + + + + +Sample + + +Linear regression + + +Confidence interval + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/regression_small.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/regression_small.svg new file mode 100644 index 0000000..b52b878 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/regression_small.svg @@ -0,0 +1,107 @@ + + +Total sample time (s) + + +Iterations + + + + + + + + + + + + + + + + + + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + +1.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/relative_iteration_times_small.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/relative_iteration_times_small.svg new file mode 100644 index 0000000..cb9ebff --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/relative_iteration_times_small.svg @@ -0,0 +1,222 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + + + +13.6 + + + +13.8 + + + +14.0 + + + +14.2 + + + +14.4 + + + +14.6 + + + +14.8 + + + +15.0 + + + +15.2 + + + +15.4 + + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/relative_pdf_small.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/relative_pdf_small.svg new file mode 100644 index 0000000..508a28d --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/relative_pdf_small.svg @@ -0,0 +1,74 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0.2 + + + +0.4 + + + +0.6 + + + +0.8 + + + +1 + + + +1.2 + + + +1.4 + + + +1.6 + + + +1.8 + + + +2 + + + + +13.5 + + + +14 + + + +14.5 + + + +15 + + + +15.5 + + + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/slope.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/slope.svg new file mode 100644 index 0000000..251e3ed --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/slope.svg @@ -0,0 +1,76 @@ + + +effects_skip/with_one_dropshadow:slope + + +Density (a.u.) + + +Average time (ms) + + + +1 + + + +2 + + + +3 + + + +4 + + + +5 + + + +6 + + + +7 + + + +8 + + + +9 + + + + +14.25 + + + +14.3 + + + +14.35 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/typical.svg b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/typical.svg new file mode 100644 index 0000000..c96ec63 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/report/typical.svg @@ -0,0 +1,76 @@ + + +effects_skip/with_one_dropshadow:typical + + +Density (a.u.) + + +Average time (ms) + + + +1 + + + +2 + + + +3 + + + +4 + + + +5 + + + +6 + + + +7 + + + +8 + + + +9 + + + + +14.25 + + + +14.3 + + + +14.35 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/test/benchmark.json b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/test/benchmark.json new file mode 100644 index 0000000..1bc82f5 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/test/benchmark.json @@ -0,0 +1 @@ +{"group_id":"effects_skip","function_id":"with_one_dropshadow","value_str":null,"throughput":null,"full_id":"effects_skip/with_one_dropshadow","directory_name":"effects_skip/with_one_dropshadow","title":"effects_skip/with_one_dropshadow"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/test/estimates.json b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/test/estimates.json new file mode 100644 index 0000000..b96fefd --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/test/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":13946804.4746875,"upper_bound":14054290.858875},"point_estimate":13997072.735,"standard_error":27488.335380942648},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":13940707.5,"upper_bound":14024956.625},"point_estimate":13976480.875,"standard_error":23830.15058547503},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":164664.96607661247,"upper_bound":267261.8108801544},"point_estimate":219068.9721107483,"standard_error":25306.522927077054},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":182796.3896650489,"upper_bound":380956.04433230683},"point_estimate":276599.4233512057,"standard_error":55359.06134229179}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/test/sample.json b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/test/sample.json new file mode 100644 index 0000000..dcada42 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/test/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[54571010.0,56215082.0,56032036.0,54635228.0,56570637.0,55152917.0,55708603.0,56479843.0,56852374.0,55434515.0,55796321.0,56163649.0,53869365.0,55900868.0,56432490.0,55910979.0,55424952.0,57737679.0,56315239.0,56406830.0,56358225.0,55885916.0,56064464.0,56704354.0,55170587.0,56090971.0,54951830.0,55547909.0,56112082.0,55296014.0,55365703.0,56535040.0,57785581.0,55187599.0,56916609.0,56683267.0,55166846.0,55089173.0,56975204.0,56446818.0,57113836.0,56448451.0,56913068.0,56843566.0,55650799.0,56496760.0,56035583.0,55837013.0,55832788.0,55017113.0,55739863.0,54820299.0,56431782.0,56055035.0,56147042.0,55116982.0,54749798.0,56087571.0,54689405.0,55807459.0,54561534.0,55418358.0,55956377.0,55231890.0,56758523.0,56188912.0,56261108.0,56885827.0,59133404.0,55762830.0,63003385.0,54863548.0,58385363.0,56846019.0,56117066.0,55794020.0,55177783.0,55977333.0,55941332.0,56474447.0,54952086.0,55607846.0,55025441.0,56497167.0,55122363.0,54819423.0,55664820.0,54640351.0,55109436.0,56129726.0,55209962.0,56594376.0,55800834.0,55051833.0,55526772.0,57272731.0,55836221.0,56738139.0,55295817.0,55415669.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/test/tukey.json b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/test/tukey.json new file mode 100644 index 0000000..ca59e94 --- /dev/null +++ b/hcie-engine-api/criterion/effects_skip/with_one_dropshadow/test/tukey.json @@ -0,0 +1 @@ +[12885195.5,13345898.75,14574440.75,15035144.0] \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/change/estimates.json b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/change/estimates.json new file mode 100644 index 0000000..fea0326 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/change/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":0.0010149303231903716,"upper_bound":0.013368344713261187},"point_estimate":0.007225817277711322,"standard_error":0.0031393561464098025},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":0.0026009749053149326,"upper_bound":0.016027489129710526},"point_estimate":0.00929866337025853,"standard_error":0.0034736186453839736}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/benchmark.json b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/benchmark.json new file mode 100644 index 0000000..81fb672 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/benchmark.json @@ -0,0 +1 @@ +{"group_id":"stroke_mask_pooling","function_id":"cold_first_stroke","value_str":null,"throughput":null,"full_id":"stroke_mask_pooling/cold_first_stroke","directory_name":"stroke_mask_pooling/cold_first_stroke","title":"stroke_mask_pooling/cold_first_stroke"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/estimates.json b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/estimates.json new file mode 100644 index 0000000..3c56548 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":29504509.65,"upper_bound":29766050.56},"point_estimate":29630905.65,"standard_error":66834.67038227069},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":29298996.0,"upper_bound":29632302.0},"point_estimate":29474505.0,"standard_error":86676.73072107196},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":396681.4837574959,"upper_bound":718483.5145443678},"point_estimate":530890.1398748159,"standard_error":81929.26156496794},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":531310.0663013458,"upper_bound":812131.5079475972},"point_estimate":672017.0362089776,"standard_error":72272.36800948708}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/sample.json b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/sample.json new file mode 100644 index 0000000..a0732a3 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0],"times":[29331196.0,30166926.0,29826620.0,28879923.0,28999472.0,28906370.0,29035426.0,30234923.0,29188076.0,31061781.0,29498990.0,29379919.0,30489723.0,29776542.0,29597975.0,29055081.0,29670049.0,30102412.0,31593917.0,30444015.0,29574788.0,29663255.0,29964099.0,30853338.0,29901116.0,29760501.0,29090917.0,29230246.0,29678931.0,29419972.0,29294845.0,29541609.0,29354017.0,28588062.0,29271535.0,29268873.0,29227847.0,30314298.0,29383719.0,29345177.0,29192873.0,29499658.0,29827814.0,28945254.0,29055377.0,29874883.0,29118725.0,29233929.0,28962569.0,29204822.0,29552245.0,28683441.0,29171496.0,29200839.0,28845021.0,29272811.0,31000636.0,28880974.0,30070464.0,30332767.0,29970629.0,29506207.0,29298996.0,29417134.0,29450020.0,29064878.0,28907440.0,29602923.0,29717578.0,28813011.0,29021294.0,29683405.0,29114949.0,30289222.0,30146985.0,29264573.0,29340173.0,29117900.0,29211090.0,29202808.0,30163315.0,30802866.0,28928777.0,28901021.0,32531793.0,31108538.0,29829032.0,29200739.0,29072315.0,29195942.0,30216697.0,30121525.0,30213382.0,29811021.0,29632302.0,30716450.0,30420788.0,29947582.0,30722015.0,29520171.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/tukey.json b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/tukey.json new file mode 100644 index 0000000..8b7ab57 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/gold_standard/tukey.json @@ -0,0 +1 @@ +[26869500.5,28030587.125,31126818.125,32287904.75] \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/new/benchmark.json b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/new/benchmark.json new file mode 100644 index 0000000..81fb672 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/new/benchmark.json @@ -0,0 +1 @@ +{"group_id":"stroke_mask_pooling","function_id":"cold_first_stroke","value_str":null,"throughput":null,"full_id":"stroke_mask_pooling/cold_first_stroke","directory_name":"stroke_mask_pooling/cold_first_stroke","title":"stroke_mask_pooling/cold_first_stroke"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/new/estimates.json b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/new/estimates.json new file mode 100644 index 0000000..c8e3b82 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/new/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":29733300.32,"upper_bound":29964928.01},"point_estimate":29845013.16,"standard_error":58960.555312314704},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":29638400.0,"upper_bound":29865511.0},"point_estimate":29748578.5,"standard_error":50118.51454191317},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":366446.8224942684,"upper_bound":605366.3256525993},"point_estimate":492642.0257538557,"standard_error":59215.86170306989},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":438093.3006741787,"upper_bound":734806.7986032941},"point_estimate":590633.5425612218,"standard_error":75960.69011748448}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/new/sample.json b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/new/sample.json new file mode 100644 index 0000000..118a5f8 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/new/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0],"times":[29811628.0,29810974.0,29984314.0,29865511.0,30151761.0,29752788.0,29141794.0,29093393.0,30077150.0,29279805.0,29209921.0,29659524.0,29039372.0,29479431.0,30465703.0,29593363.0,29399467.0,29298788.0,29519669.0,29548141.0,29900213.0,29665268.0,29341467.0,28931661.0,29255155.0,30502406.0,32388045.0,30221149.0,29221774.0,29738591.0,29989649.0,29742905.0,29937427.0,29326343.0,29636692.0,29747227.0,29270974.0,30282928.0,30714206.0,29454229.0,30346802.0,29453449.0,29087648.0,29198888.0,29045526.0,29187323.0,29636036.0,29275291.0,30178443.0,30058648.0,29763988.0,32102578.0,31795121.0,30949120.0,30422408.0,29697706.0,30007536.0,29598794.0,29762006.0,29559137.0,29353819.0,30238245.0,30580273.0,30001657.0,30099709.0,29803247.0,29565828.0,29971181.0,29424175.0,29412585.0,29328573.0,29282594.0,29427835.0,30448426.0,30843923.0,29569576.0,29573096.0,29760278.0,29630223.0,29641881.0,29665612.0,29638400.0,29749930.0,30115625.0,30146245.0,29734925.0,30415978.0,30390300.0,30147654.0,29890376.0,29896204.0,30238312.0,30545254.0,29467271.0,29974531.0,29755283.0,29502597.0,30426523.0,30085627.0,30180291.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/new/tukey.json b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/new/tukey.json new file mode 100644 index 0000000..50c34ed --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/new/tukey.json @@ -0,0 +1 @@ +[27446296.0,28450165.0,31127149.0,32131018.0] \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/MAD.svg b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/MAD.svg new file mode 100644 index 0000000..dde629b --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/MAD.svg @@ -0,0 +1,88 @@ + + +stroke_mask_pooling/cold_first_stroke:MAD + + +Density (a.u.) + + +Average time (µs) + + + +0.001 + + + +0.002 + + + +0.003 + + + +0.004 + + + +0.005 + + + +0.006 + + + +0.007 + + + +0.008 + + + +0.009 + + + + +350 + + + +400 + + + +450 + + + +500 + + + +550 + + + +600 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/SD.svg b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/SD.svg new file mode 100644 index 0000000..43af710 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/SD.svg @@ -0,0 +1,100 @@ + + +stroke_mask_pooling/cold_first_stroke:SD + + +Density (a.u.) + + +Average time (µs) + + + +5e-4 + + + +0.001 + + + +0.0015 + + + +0.002 + + + +0.0025 + + + +0.003 + + + +0.0035 + + + +0.004 + + + +0.0045 + + + +0.005 + + + +0.0055 + + + + +450 + + + +500 + + + +550 + + + +600 + + + +650 + + + +700 + + + +750 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/both/iteration_times.svg b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/both/iteration_times.svg new file mode 100644 index 0000000..3d6bf9d --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/both/iteration_times.svg @@ -0,0 +1,313 @@ + + +stroke_mask_pooling/cold_first_stroke + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + +29.0 + + + +29.5 + + + +30.0 + + + +30.5 + + + +31.0 + + + +31.5 + + + +32.0 + + + +32.5 + + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Current + + +Base + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/both/pdf.svg b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/both/pdf.svg new file mode 100644 index 0000000..5f74ddb --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/both/pdf.svg @@ -0,0 +1,73 @@ + + +stroke_mask_pooling/cold_first_stroke + + +Density (a.u.) + + +Average Time (ms) + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + + +28 + + + +30 + + + +32 + + + + + + + +Base PDF + + +New PDF + + +Base Mean + + +New Mean + + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/change/mean.svg b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/change/mean.svg new file mode 100644 index 0000000..15af274 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/change/mean.svg @@ -0,0 +1,89 @@ + + +stroke_mask_pooling/cold_first_stroke:mean + + +Density (a.u.) + + +Relative change (%) + + + +20 + + + +40 + + + +60 + + + +80 + + + +100 + + + +120 + + + + +0 + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + +0.014 + + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + +Noise threshold + + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/change/median.svg b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/change/median.svg new file mode 100644 index 0000000..44bbf3d --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/change/median.svg @@ -0,0 +1,93 @@ + + +stroke_mask_pooling/cold_first_stroke:median + + +Density (a.u.) + + +Relative change (%) + + + +20 + + + +40 + + + +60 + + + +80 + + + +100 + + + +120 + + + +140 + + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + +0.014 + + + +0.016 + + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + +Noise threshold + + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/change/t-test.svg b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/change/t-test.svg new file mode 100644 index 0000000..0a4e1ac --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/change/t-test.svg @@ -0,0 +1,99 @@ + + +stroke_mask_pooling/cold_first_stroke: Welch t test + + +Density + + +t score + + + +0.0 + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + +0.35 + + + +0.4 + + + + +-4.0 + + + +-3.0 + + + +-2.0 + + + +-1.0 + + + +0.0 + + + +1.0 + + + +2.0 + + + +3.0 + + + +4.0 + + + +5.0 + + + + + +t distribution + + +t statistic + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/index.html b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/index.html new file mode 100644 index 0000000..7a63c73 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/index.html @@ -0,0 +1,269 @@ + + + + + + stroke_mask_pooling/cold_first_stroke - Criterion.rs + + + + +
+

stroke_mask_pooling/cold_first_stroke

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
R²0.00313160.00324430.0031151
Mean29.733 ms29.845 ms29.965 ms
Std. Dev.438.09 µs590.63 µs734.81 µs
Median29.638 ms29.749 ms29.866 ms
MAD366.45 µs492.64 µs605.37 µs
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probability of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the average time per iteration for the samples. Each point + represents one sample.

+

See the + documentation for more details on the additional statistics.

+
+
+
+

Change Since Previous Benchmark

+
+ + + + + + + +
+ + PDF Comparison + + + + Iteration Time Comparison + +
+
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
Change in time+0.1015%+0.7226%+1.3368%(p = 0.02 < + 0.05)
+ Change within noise threshold. +
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left shows the probability of the function taking a certain amount of time. The red + curve represents the saved measurements from the last time this benchmark was run, while the blue curve + shows the measurements from this run. The lines represent the mean time per iteration. Click on the + plot for a larger view.

+

The plot on the right shows the iteration times for the two measurements. Again, the red dots represent + the previous measurement while the blue dots show the current measurement.

+

See the + documentation for more details on the additional statistics.

+
+
+ + + + \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/iteration_times.svg b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/iteration_times.svg new file mode 100644 index 0000000..8761a3a --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/iteration_times.svg @@ -0,0 +1,199 @@ + + +stroke_mask_pooling/cold_first_stroke + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + +29.0 + + + +29.5 + + + +30.0 + + + +30.5 + + + +31.0 + + + +31.5 + + + +32.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/iteration_times_small.svg b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/iteration_times_small.svg new file mode 100644 index 0000000..f1193c9 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/iteration_times_small.svg @@ -0,0 +1,192 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + +29.0 + + + +29.5 + + + +30.0 + + + +30.5 + + + +31.0 + + + +31.5 + + + +32.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/mean.svg b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/mean.svg new file mode 100644 index 0000000..6ff7a67 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/mean.svg @@ -0,0 +1,76 @@ + + +stroke_mask_pooling/cold_first_stroke:mean + + +Density (a.u.) + + +Average time (ms) + + + +1 + + + +2 + + + +3 + + + +4 + + + +5 + + + +6 + + + +7 + + + + +29.75 + + + +29.8 + + + +29.85 + + + +29.9 + + + +29.95 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/median.svg b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/median.svg new file mode 100644 index 0000000..82f0ce1 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/median.svg @@ -0,0 +1,68 @@ + + +stroke_mask_pooling/cold_first_stroke:median + + +Density (a.u.) + + +Average time (ms) + + + +5 + + + +10 + + + +15 + + + +20 + + + +25 + + + + +29.65 + + + +29.7 + + + +29.75 + + + +29.8 + + + +29.85 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/pdf.svg b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/pdf.svg new file mode 100644 index 0000000..f914b18 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/pdf.svg @@ -0,0 +1,165 @@ + + +stroke_mask_pooling/cold_first_stroke + + +Iterations + + +Average Time (ms) + + + +0 + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + +0.9 + + + +1 + + + + +28.5 + + + +29 + + + +29.5 + + + +30 + + + +30.5 + + + +31 + + + +31.5 + + + +32 + + + +32.5 + + + +33 + + + +Density (a.u.) + + + +0 + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + + + + + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/pdf_small.svg b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/pdf_small.svg new file mode 100644 index 0000000..77c6119 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/pdf_small.svg @@ -0,0 +1,68 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0 + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + +0.8 + + + + +29 + + + +30 + + + +31 + + + +32 + + + +33 + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/relative_iteration_times_small.svg b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/relative_iteration_times_small.svg new file mode 100644 index 0000000..6848855 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/relative_iteration_times_small.svg @@ -0,0 +1,302 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + + +29.0 + + + +29.5 + + + +30.0 + + + +30.5 + + + +31.0 + + + +31.5 + + + +32.0 + + + +32.5 + + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/relative_pdf_small.svg b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/relative_pdf_small.svg new file mode 100644 index 0000000..5848359 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/relative_pdf_small.svg @@ -0,0 +1,54 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0.1 + + + +0.2 + + + +0.3 + + + +0.4 + + + +0.5 + + + +0.6 + + + +0.7 + + + + +28 + + + +30 + + + +32 + + + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/typical.svg b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/typical.svg new file mode 100644 index 0000000..3102c7c --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/cold_first_stroke/report/typical.svg @@ -0,0 +1,76 @@ + + +stroke_mask_pooling/cold_first_stroke:typical + + +Density (a.u.) + + +Average time (ms) + + + +1 + + + +2 + + + +3 + + + +4 + + + +5 + + + +6 + + + +7 + + + + +29.75 + + + +29.8 + + + +29.85 + + + +29.9 + + + +29.95 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/report/index.html b/hcie-engine-api/criterion/stroke_mask_pooling/report/index.html new file mode 100644 index 0000000..2856b81 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/report/index.html @@ -0,0 +1,116 @@ + + + + + + stroke_mask_pooling Summary - Criterion.rs + + + + +
+

stroke_mask_pooling

+

Violin Plot

+ + Violin Plot + +

This chart shows the relationship between function/parameter and iteration time. The thickness of the shaded + region indicates the probability that a measurement of the given function/parameter would take a particular + length of time.

+
+ +

stroke_mask_pooling/cold_first_stroke

+ + + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+ +

stroke_mask_pooling/warm_10th_stroke

+ + + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+ + + + \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/report/violin.svg b/hcie-engine-api/criterion/stroke_mask_pooling/report/violin.svg new file mode 100644 index 0000000..11460db --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/report/violin.svg @@ -0,0 +1,53 @@ + + +stroke_mask_pooling: Violin plot + + +Input + + +Average time (ms) + + + +stroke_mask_pooling/warm_10th_stroke + + + +stroke_mask_pooling/cold_first_stroke + + + + +0.0 + + + +5.0 + + + +10.0 + + + +15.0 + + + +20.0 + + + +25.0 + + + +30.0 + + + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/change/estimates.json b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/change/estimates.json new file mode 100644 index 0000000..aadd79a --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/change/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":-0.004366201845142312,"upper_bound":0.02328910333764296},"point_estimate":0.009330096376242825,"standard_error":0.0070189056235434024},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":-0.006518766595920544,"upper_bound":0.04137271051250013},"point_estimate":0.019264694782017866,"standard_error":0.012130305122189426}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/benchmark.json b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/benchmark.json new file mode 100644 index 0000000..c115f88 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/benchmark.json @@ -0,0 +1 @@ +{"group_id":"stroke_mask_pooling","function_id":"warm_10th_stroke","value_str":null,"throughput":null,"full_id":"stroke_mask_pooling/warm_10th_stroke","directory_name":"stroke_mask_pooling/warm_10th_stroke","title":"stroke_mask_pooling/warm_10th_stroke"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/estimates.json b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/estimates.json new file mode 100644 index 0000000..f0ab7a6 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14836032.1208125,"upper_bound":15127652.4775},"point_estimate":14979421.0975,"standard_error":74178.21270723695},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14628358.5,"upper_bound":15087602.75},"point_estimate":14837920.0,"standard_error":117077.8418894014},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":549437.8361955285,"upper_bound":1062797.6491178186},"point_estimate":751563.4704820812,"standard_error":132182.0385068363},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":662825.7400382765,"upper_bound":821846.4097245411},"point_estimate":748696.7326672822,"standard_error":40382.09616865474}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/sample.json b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/sample.json new file mode 100644 index 0000000..49c9e56 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[63584201.0,59559439.0,64030737.0,63643032.0,64663500.0,60186864.0,64686429.0,63698762.0,56934693.0,60762651.0,60245774.0,61550705.0,59350976.0,61320472.0,62752383.0,57727463.0,59313279.0,63651447.0,57865761.0,58149384.0,64358735.0,58756725.0,64119421.0,58270807.0,56928550.0,57853342.0,66708218.0,55769369.0,60289693.0,57487349.0,58243265.0,60793674.0,59352384.0,56732895.0,60698024.0,60640244.0,57771396.0,60522515.0,57860702.0,57715402.0,55803584.0,57907989.0,62958049.0,58444458.0,58755106.0,56006945.0,55887809.0,55102257.0,58786332.0,56406008.0,61043301.0,58623089.0,61920935.0,55740157.0,59013180.0,55831499.0,65114002.0,66311020.0,64399191.0,58513434.0,57108066.0,58032635.0,55959094.0,59836447.0,57979879.0,56089693.0,56164806.0,64114462.0,60118825.0,57394908.0,62109619.0,60593361.0,63090805.0,56314072.0,57909556.0,58498783.0,58314182.0,55683026.0,59836608.0,63680839.0,58041550.0,65614419.0,63844581.0,65840418.0,56026200.0,61438269.0,60634690.0,59297180.0,60455048.0,63292822.0,61823531.0,63198776.0,59656654.0,58810635.0,59524910.0,56192019.0,65272924.0,62190916.0,58198147.0,56466077.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/tukey.json b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/tukey.json new file mode 100644 index 0000000..1ef49c2 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/gold_standard/tukey.json @@ -0,0 +1 @@ +[11235398.0625,12846805.96875,17143893.71875,18755301.625] \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/new/benchmark.json b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/new/benchmark.json new file mode 100644 index 0000000..c115f88 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/new/benchmark.json @@ -0,0 +1 @@ +{"group_id":"stroke_mask_pooling","function_id":"warm_10th_stroke","value_str":null,"throughput":null,"full_id":"stroke_mask_pooling/warm_10th_stroke","directory_name":"stroke_mask_pooling/warm_10th_stroke","title":"stroke_mask_pooling/warm_10th_stroke"} \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/new/estimates.json b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/new/estimates.json new file mode 100644 index 0000000..82d6bee --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/new/estimates.json @@ -0,0 +1 @@ +{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14967117.95325,"upper_bound":15270995.7225},"point_estimate":15119180.54,"standard_error":77023.41830944567},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":14865406.0,"upper_bound":15405412.5},"point_estimate":15123768.0,"standard_error":134057.75990641356},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":826387.5112786889,"upper_bound":1205216.267453134},"point_estimate":1044945.7276985049,"standard_error":97807.36190790143},"slope":null,"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":698356.1131332364,"upper_bound":840916.3819017409},"point_estimate":773657.8743099449,"standard_error":36191.42561222772}} \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/new/sample.json b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/new/sample.json new file mode 100644 index 0000000..cd0be30 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/new/sample.json @@ -0,0 +1 @@ +{"sampling_mode":"Flat","iters":[4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0],"times":[57092981.0,55571774.0,55331702.0,60311675.0,63795035.0,56726743.0,63959963.0,61855661.0,64579057.0,57360886.0,64466250.0,62360947.0,61728592.0,63357521.0,57801450.0,64047418.0,56789249.0,56818119.0,58758632.0,59660132.0,56575996.0,59580935.0,58668566.0,59764038.0,56603706.0,56293362.0,58276423.0,56642634.0,55969441.0,62102787.0,62690662.0,57151826.0,64495374.0,58515440.0,60064491.0,60642911.0,57726576.0,60890580.0,59912487.0,62098867.0,61002712.0,62719203.0,60142497.0,60765515.0,61638747.0,63768901.0,57682550.0,59555027.0,64032866.0,61293452.0,64367072.0,59215429.0,65673489.0,63321000.0,64921367.0,56869695.0,63931899.0,63165709.0,58588100.0,68030479.0,59342313.0,63410381.0,59951940.0,57162524.0,56334746.0,62525054.0,57708799.0,63954853.0,61125369.0,55393340.0,63196776.0,56660703.0,64691458.0,57616285.0,55184664.0,60949716.0,61621650.0,62991794.0,64386832.0,61771077.0,56942276.0,65046962.0,56019710.0,58999487.0,56910776.0,64656610.0,58042546.0,63864144.0,60422481.0,64117040.0,60567663.0,57844865.0,64604581.0,55585213.0,63797121.0,58337858.0,61403891.0,59136597.0,64431755.0,63233768.0]} \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/new/tukey.json b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/new/tukey.json new file mode 100644 index 0000000..843c978 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/new/tukey.json @@ -0,0 +1 @@ +[10204639.0625,12315099.125,17942992.625,20053452.6875] \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/MAD.svg b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/MAD.svg new file mode 100644 index 0000000..5b28872 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/MAD.svg @@ -0,0 +1,100 @@ + + +stroke_mask_pooling/warm_10th_stroke:MAD + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + +4 + + + +4.5 + + + + +0.8 + + + +0.85 + + + +0.9 + + + +0.95 + + + +1 + + + +1.05 + + + +1.1 + + + +1.15 + + + +1.2 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/SD.svg b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/SD.svg new file mode 100644 index 0000000..c0b9070 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/SD.svg @@ -0,0 +1,84 @@ + + +stroke_mask_pooling/warm_10th_stroke:SD + + +Density (a.u.) + + +Average time (µs) + + + +0.002 + + + +0.004 + + + +0.006 + + + +0.008 + + + +0.01 + + + +0.012 + + + + +700 + + + +720 + + + +740 + + + +760 + + + +780 + + + +800 + + + +820 + + + +840 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/both/iteration_times.svg b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/both/iteration_times.svg new file mode 100644 index 0000000..a4a79a7 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/both/iteration_times.svg @@ -0,0 +1,308 @@ + + +stroke_mask_pooling/warm_10th_stroke + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + +14.0 + + + +14.5 + + + +15.0 + + + +15.5 + + + +16.0 + + + +16.5 + + + +17.0 + + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Current + + +Base + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/both/pdf.svg b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/both/pdf.svg new file mode 100644 index 0000000..ac95192 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/both/pdf.svg @@ -0,0 +1,89 @@ + + +stroke_mask_pooling/warm_10th_stroke + + +Density (a.u.) + + +Average Time (ms) + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + +0.35 + + + +0.4 + + + +0.45 + + + + +13 + + + +14 + + + +15 + + + +16 + + + +17 + + + + + + + +Base PDF + + +New PDF + + +Base Mean + + +New Mean + + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/change/mean.svg b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/change/mean.svg new file mode 100644 index 0000000..2a0ca29 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/change/mean.svg @@ -0,0 +1,105 @@ + + +stroke_mask_pooling/warm_10th_stroke:mean + + +Density (a.u.) + + +Relative change (%) + + + +5 + + + +10 + + + +15 + + + +20 + + + +25 + + + +30 + + + +35 + + + +40 + + + +45 + + + +50 + + + +55 + + + + +-0.005 + + + +0 + + + +0.005 + + + +0.01 + + + +0.015 + + + +0.02 + + + +0.025 + + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + +Noise threshold + + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/change/median.svg b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/change/median.svg new file mode 100644 index 0000000..3f31a5c --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/change/median.svg @@ -0,0 +1,81 @@ + + +stroke_mask_pooling/warm_10th_stroke:median + + +Density (a.u.) + + +Relative change (%) + + + +5 + + + +10 + + + +15 + + + +20 + + + +25 + + + +30 + + + + +-0.01 + + + +0 + + + +0.01 + + + +0.02 + + + +0.03 + + + +0.04 + + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + +Noise threshold + + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/change/t-test.svg b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/change/t-test.svg new file mode 100644 index 0000000..f206f29 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/change/t-test.svg @@ -0,0 +1,99 @@ + + +stroke_mask_pooling/warm_10th_stroke: Welch t test + + +Density + + +t score + + + +0.0 + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + +0.35 + + + +0.4 + + + + +-5.0 + + + +-4.0 + + + +-3.0 + + + +-2.0 + + + +-1.0 + + + +0.0 + + + +1.0 + + + +2.0 + + + +3.0 + + + +4.0 + + + + + +t distribution + + +t statistic + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/index.html b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/index.html new file mode 100644 index 0000000..623eed1 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/index.html @@ -0,0 +1,269 @@ + + + + + + stroke_mask_pooling/warm_10th_stroke - Criterion.rs + + + + +
+

stroke_mask_pooling/warm_10th_stroke

+
+
+ + + + + + + +
+ + PDF of Slope + + + + Iteration Times + +
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
R²0.00765720.00795370.0076582
Mean14.967 ms15.119 ms15.271 ms
Std. Dev.698.36 µs773.66 µs840.92 µs
Median14.865 ms15.124 ms15.405 ms
MAD826.39 µs1.0449 ms1.2052 ms
+
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left displays the average time per iteration for this benchmark. The shaded region + shows the estimated probability of an iteration taking a certain amount of time, while the line + shows the mean. Click on the plot for a larger view showing the outliers.

+

The plot on the right shows the average time per iteration for the samples. Each point + represents one sample.

+

See the + documentation for more details on the additional statistics.

+
+
+
+

Change Since Previous Benchmark

+
+ + + + + + + +
+ + PDF Comparison + + + + Iteration Time Comparison + +
+
+
+
+
+

Additional Statistics:

+ + + + + + + + + + + + + + + + + + + +
Lower boundEstimateUpper bound
Change in time-0.4366%+0.9330%+2.3289%(p = 0.20 > + 0.05)
+ No change in performance detected. +
+
+

Additional Plots:

+ +
+
+
+

Understanding this report:

+

The plot on the left shows the probability of the function taking a certain amount of time. The red + curve represents the saved measurements from the last time this benchmark was run, while the blue curve + shows the measurements from this run. The lines represent the mean time per iteration. Click on the + plot for a larger view.

+

The plot on the right shows the iteration times for the two measurements. Again, the red dots represent + the previous measurement while the blue dots show the current measurement.

+

See the + documentation for more details on the additional statistics.

+
+
+ + + + \ No newline at end of file diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/iteration_times.svg b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/iteration_times.svg new file mode 100644 index 0000000..07fee42 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/iteration_times.svg @@ -0,0 +1,199 @@ + + +stroke_mask_pooling/warm_10th_stroke + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + +14.0 + + + +14.5 + + + +15.0 + + + +15.5 + + + +16.0 + + + +16.5 + + + +17.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Sample + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/iteration_times_small.svg b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/iteration_times_small.svg new file mode 100644 index 0000000..84f94ef --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/iteration_times_small.svg @@ -0,0 +1,192 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + +14.0 + + + +14.5 + + + +15.0 + + + +15.5 + + + +16.0 + + + +16.5 + + + +17.0 + + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/mean.svg b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/mean.svg new file mode 100644 index 0000000..0b796ef --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/mean.svg @@ -0,0 +1,104 @@ + + +stroke_mask_pooling/warm_10th_stroke:mean + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + +4 + + + +4.5 + + + +5 + + + +5.5 + + + + +14.95 + + + +15 + + + +15.05 + + + +15.1 + + + +15.15 + + + +15.2 + + + +15.25 + + + +15.3 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/median.svg b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/median.svg new file mode 100644 index 0000000..9c46e72 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/median.svg @@ -0,0 +1,76 @@ + + +stroke_mask_pooling/warm_10th_stroke:median + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + + +14.9 + + + +15 + + + +15.1 + + + +15.2 + + + +15.3 + + + +15.4 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/pdf.svg b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/pdf.svg new file mode 100644 index 0000000..1553725 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/pdf.svg @@ -0,0 +1,151 @@ + + +stroke_mask_pooling/warm_10th_stroke + + +Iterations + + +Average Time (ms) + + + +0 + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + +4 + + + + +13 + + + +13.5 + + + +14 + + + +14.5 + + + +15 + + + +15.5 + + + +16 + + + +16.5 + + + +17 + + + +17.5 + + + +Density (a.u.) + + + +0 + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + +0.35 + + + + + + + + + +PDF + + +Mean + + +"Clean" sample + + +Mild outliers + + +Severe outliers + + + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/pdf_small.svg b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/pdf_small.svg new file mode 100644 index 0000000..6b7045b --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/pdf_small.svg @@ -0,0 +1,68 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0 + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + +0.35 + + + +0.4 + + + + +13 + + + +14 + + + +15 + + + +16 + + + +17 + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/relative_iteration_times_small.svg b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/relative_iteration_times_small.svg new file mode 100644 index 0000000..0ceb564 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/relative_iteration_times_small.svg @@ -0,0 +1,297 @@ + + +Average Iteration Time (ms) + + + + + + + + + + + + + + + + + + + + + +14.0 + + + +14.5 + + + +15.0 + + + +15.5 + + + +16.0 + + + +16.5 + + + +17.0 + + + + +0 + + + +10 + + + +20 + + + +30 + + + +40 + + + +50 + + + +60 + + + +70 + + + +80 + + + +90 + + + +100 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/relative_pdf_small.svg b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/relative_pdf_small.svg new file mode 100644 index 0000000..5506e7e --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/relative_pdf_small.svg @@ -0,0 +1,70 @@ + + +Density (a.u.) + + +Average Time (ms) + + + +0.05 + + + +0.1 + + + +0.15 + + + +0.2 + + + +0.25 + + + +0.3 + + + +0.35 + + + +0.4 + + + +0.45 + + + + +13 + + + +14 + + + +15 + + + +16 + + + +17 + + + + + + + diff --git a/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/typical.svg b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/typical.svg new file mode 100644 index 0000000..6095ee2 --- /dev/null +++ b/hcie-engine-api/criterion/stroke_mask_pooling/warm_10th_stroke/report/typical.svg @@ -0,0 +1,104 @@ + + +stroke_mask_pooling/warm_10th_stroke:typical + + +Density (a.u.) + + +Average time (ms) + + + +0.5 + + + +1 + + + +1.5 + + + +2 + + + +2.5 + + + +3 + + + +3.5 + + + +4 + + + +4.5 + + + +5 + + + +5.5 + + + + +14.95 + + + +15 + + + +15.05 + + + +15.1 + + + +15.15 + + + +15.2 + + + +15.25 + + + +15.3 + + + + + + +Bootstrap distribution + + +Confidence interval + + +Point estimate + + + + + diff --git a/hcie-engine-api/src/partial_composite.rs b/hcie-engine-api/src/partial_composite.rs index 6b61724..b01bf0f 100644 --- a/hcie-engine-api/src/partial_composite.rs +++ b/hcie-engine-api/src/partial_composite.rs @@ -25,6 +25,7 @@ use crate::dynamic_loader::vector::render_vector_shapes; use crate::dynamic_loader::{composite_layers, tiled}; use crate::Engine; use hcie_tile::TiledLayer; +use rayon::prelude::*; impl Engine { /// **Purpose:** @@ -196,10 +197,15 @@ impl Engine { "[render_composite_region] CACHE MISS: full composite of all {} layers, dirty_rect=[{},{},{},{}]", self.document.layers.len(), x0, y0, x1, y1 ); - for y in y0..y1 { - let start = (y as usize * wu + x0u) * 4; - let end = start + ((x1 - x0) as usize) * 4; - buf[start..end].fill(0); + let is_full_canvas = x0 == 0 && y0 == 0 && x1 == w && y1 == h; + if is_full_canvas { + buf.par_chunks_mut(65536).for_each(|chunk| chunk.fill(0)); + } else { + for y in y0..y1 { + let start = (y as usize * wu + x0u) * 4; + let end = start + ((x1 - x0) as usize) * 4; + buf[start..end].fill(0); + } } tiled::composite_tiled_into( &self.document.layers, diff --git a/hcie-engine-api/src/stroke_cache.rs b/hcie-engine-api/src/stroke_cache.rs index f5dfc99..6a2ec5b 100644 --- a/hcie-engine-api/src/stroke_cache.rs +++ b/hcie-engine-api/src/stroke_cache.rs @@ -24,6 +24,7 @@ use crate::dynamic_loader::tiled; use crate::Engine; use hcie_protocol::LayerData; use hcie_tile::TiledLayer; +use rayon::prelude::*; /// Wrapper to send a raw pixel pointer to a background thread as a `usize`. /// @@ -543,62 +544,64 @@ impl Engine { if self.tile_layers.len() < lcount { self.tile_layers.resize_with(lcount, || None); } - let mut tiles_built = 0usize; - for (ti, tl) in self.document.layers.iter().enumerate() { - if ti >= active_idx { - break; - } - if !tl.pixels.is_empty() && self.tile_layers[ti].is_none() { - self.tile_layers[ti] = - Some(TiledLayer::from_dense(&tl.pixels, tl.width, tl.height)); - tiles_built += 1; - log::trace!( - "[begin_stroke] built tile for below layer[{}] id={}", - ti, - tl.id - ); - } - } - let mut cache = match self.below_cache.take() { - Some(mut b) if b.len() == buf_size => { - b.fill(0); - b - } - _ => vec![0u8; buf_size], - }; - let tile_slice_len = active_idx.min(self.tile_layers.len()); - let visible_below: Vec<(usize, bool)> = self.document.layers[..active_idx] - .iter() - .enumerate() - .map(|(i, l)| (i, l.visible)) + + let layers_needing_tiles: Vec = (0..active_idx) + .filter(|&ti| !self.document.layers[ti].pixels.is_empty() && self.tile_layers[ti].is_none()) .collect(); - log::trace!( - "[begin_stroke] compositing below_cache: {} below_layers, tile_slice_len={}, visible_below={:?}, tiles_built={}", - active_idx, tile_slice_len, visible_below, tiles_built - ); - tiled::composite_tiled_into( - &self.document.layers[..active_idx], - &self.tile_layers[..tile_slice_len], - cw, - ch, - 0, - 0, - cw, - ch, - &mut cache, - ); - if log::log_enabled!(log::Level::Trace) { - let non_zero = cache.iter().filter(|&&b| b != 0).count(); - log::trace!( - "[begin_stroke] below_cache built: {} bytes, non-zero bytes={}, active_idx={}", - cache.len(), - non_zero, - active_idx - ); + if !layers_needing_tiles.is_empty() { + let tile_data: Vec<(usize, TiledLayer)> = layers_needing_tiles + .par_iter() + .map(|&ti| { + let l = &self.document.layers[ti]; + (ti, TiledLayer::from_dense(&l.pixels, l.width, l.height)) + }) + .collect(); + for (ti, tl) in tile_data { + self.tile_layers[ti] = Some(tl); + log::trace!("[begin_stroke] built tile for below layer[{}] id={}", ti, self.document.layers[ti].id); + } + } + + let top_below = &self.document.layers[active_idx - 1]; + let top_is_opaque_normal = top_below.visible + && top_below.blend_mode == hcie_protocol::BlendMode::Normal + && (top_below.opacity - 1.0).abs() < f32::EPSILON + && top_below.adjustment.is_none() + && top_below.effects.is_empty() + && top_below.styles.is_empty() + && !top_below.clipping_mask + && top_below.width == cw + && top_below.height == ch + && top_below.pixels.len() == buf_size + && top_below.pixels.chunks_exact(4).all(|c| c[3] == 255); + + if top_is_opaque_normal { + let cache = match self.below_cache.take() { + Some(mut b) if b.len() == buf_size => { b.copy_from_slice(&top_below.pixels); b } + _ => top_below.pixels.clone(), + }; + self.below_cache = Some(cache); + self.below_cache_active_idx = Some(active_idx); + self.below_cache_dirty = false; + log::trace!("[begin_stroke] below_cache fast-path: topmost below layer[{}] opaque Normal, skip compositing", active_idx - 1); + } else { + let mut cache = match self.below_cache.take() { + Some(mut b) if b.len() == buf_size => { + b.par_chunks_mut(65536).for_each(|chunk| chunk.fill(0)); + b + } + _ => vec![0u8; buf_size], + }; + let tile_slice_len = active_idx.min(self.tile_layers.len()); + tiled::composite_tiled_into( + &self.document.layers[..active_idx], + &self.tile_layers[..tile_slice_len], + cw, ch, 0, 0, cw, ch, &mut cache, + ); + self.below_cache = Some(cache); + self.below_cache_active_idx = Some(active_idx); + self.below_cache_dirty = false; } - self.below_cache = Some(cache); - self.below_cache_active_idx = Some(active_idx); - self.below_cache_dirty = false; } else { log::trace!("[begin_stroke] active_idx=0 (bottom layer), no below_cache"); self.below_cache = None; diff --git a/line_count_report.txt b/line_count_report.txt index 729dca9..ae56a1a 100644 --- a/line_count_report.txt +++ b/line_count_report.txt @@ -2,7 +2,7 @@ SATIR SAYISI RAPORU Proje: HCIE-Rust v4 Konum: /mnt/extra/00_PROJECTS/hcie-rust-v3.05 -Tarih: 2026-07-21 05:08:37 +Tarih: 2026-07-24 20:30:00 ========================================= ----------------------------------------- @@ -10,24 +10,24 @@ Tarih: 2026-07-21 05:08:37 ----------------------------------------- hcie-ai 2402 satır hcie-blend 530 satır - hcie-brush-engine 4845 satır + hcie-brush-engine 6190 satır hcie-build-info 93 satır hcie-color 85 satır - hcie-composite 1456 satır - hcie-document 761 satır + hcie-composite 1482 satır + hcie-document 879 satır hcie-draw 619 satır - hcie-egui-app 37434 satır - hcie-engine-api 8366 satır + hcie-egui-app 37645 satır + hcie-engine-api 9782 satır hcie-engine-api-orig 3874 satır hcie-filter 3238 satır hcie-fx 5535 satır hcie-history 139 satır - hcie-iced-app 38968 satır + hcie-iced-app 42998 satır hcie-io 12122 satır - hcie-kra 1398 satır - hcie-native 153 satır + hcie-kra 1716 satır + hcie-native 218 satır hcie-protocol 3756 satır - hcie-psd 5120 satır + hcie-psd 5136 satır hcie-psd-saver 1277 satır hcie-selection 392 satır hcie-text 1010 satır @@ -35,7 +35,7 @@ Tarih: 2026-07-21 05:08:37 hcie-vector 2921 satır hcie-vision 3131 satır - TOPLAM RUST: 139986 satır + TOPLAM RUST: 147531 satır ----------------------------------------- C++ / HEADER (.cpp, .h) @@ -86,10 +86,10 @@ Tarih: 2026-07-21 05:08:37 ----------------------------------------- SHELL SCRIPT (.sh) ----------------------------------------- - (kök dizin) 1306 satır + (kök dizin) 1689 satır logs/ 220 satır - TOPLAM SHELL: 1526 satır + TOPLAM SHELL: 1909 satır ----------------------------------------- DOKÜMANTASYON / VERİ DOSYALARI @@ -103,14 +103,14 @@ Tarih: 2026-07-21 05:08:37 MARKDOWN (.md) -------------------------------- - (kök dizin) 17606 satır + (kök dizin) 20147 satır - TOPLAM MARKDOWN: 17606 satır + TOPLAM MARKDOWN: 20147 satır ========================================= KOD SATIRLARI TOPLAMI (GRAND TOTAL) ========================================= - Rust: 139986 satır + Rust: 147531 satır C++ / Header: 5031 satır JavaScript: 0 satır Svelte: 0 satır @@ -118,11 +118,11 @@ Tarih: 2026-07-21 05:08:37 Python: 2267 satır HTML: 0 satır CSS: 0 satır - Shell Script: 1526 satır + Shell Script: 1909 satır ----------------------------------------- - KOD TOPLAMI: 148810 satır + KOD TOPLAMI: 156738 satır - RUST + C++/H TOPLAMI: 145017 satır + RUST + C++/H TOPLAMI: 152562 satır (JSON ve Markdown dosyaları yukarıda ayrı olarak gösterilmiştir) ========================================= diff --git a/notlar.txt b/notlar.txt index 899a5a9..b01b13d 100755 --- a/notlar.txt +++ b/notlar.txt @@ -14,10 +14,13 @@ cargo bench -p hcie-engine-api -- --save-baseline gold_standard # Kaydedilen 'gold_standard' baseline'ı ile karşılaştırma (regresyon testi) yapmak için: cargo bench -p hcie-engine-api -- --baseline gold_standard +cargo bench -p hcie-engine-api --bench below_cache_reuse -- --baseline gold_standard +# Criterion sonuçları ./criterion/ dizinine kaydedilir (CRITERION_HOME=criterion) +# Rapor: ./criterion/report/index.html +#criterion açıklamaları criterion.md - ##test Running the Tests Automatically To run only the new proximity dedup tests: