benchdiff report

wall time, base HEAD~5, threshold 5.0%. Refs: HEAD~5 (eb507ac3), HEAD (d8fa0174).
Violin = density, box = quartiles and median, whiskers = non-outlier range, circles = Tukey outliers (kept in the statistics).

word_freq_bench[words=5000]

HEAD~5outlier 339 usoutlier 374 usoutlier 369 usoutlier 364 usoutlier 375 usoutlier 385 usoutlier 378 usoutlier 330 usoutlier 372 usHEADoutlier 662 usoutlier 667 usoutlier 536 us265 us348 us431 us513 us596 us678 us
RefMedianChange95% CIp (Holm)Cliff dVerdictOutliers
HEAD~5300 usbaseline9
HEAD397 us+32.3%[+30.2%, +34.4%]1.43e-20+0.99slower3

word_freq_bench[words=20000]

HEAD~5outlier 1.43 msoutlier 1.39 msoutlier 1.81 msoutlier 1.45 msoutlier 1.47 msoutlier 1.54 msHEADoutlier 1.93 msoutlier 1.91 msoutlier 2.1 ms1.08 ms1.29 ms1.5 ms1.71 ms1.92 ms2.13 ms
RefMedianChange95% CIp (Holm)Cliff dVerdictOutliers
HEAD~51.18 msbaseline6
HEAD1.61 ms+36.3%[+32.1%, +40.6%]1.01e-19+0.96slower3