fork: brandtbucher
ref: justin_no_externs
machine: windows-amd64
commit hash: 9698931
commit date: 2024-10-24
overall geometric mean: 1.06x slower
HPT reliability: 100.00%
HPT 99th percentile: 1.02x slower
Memory change: unknown
Benchmarks with tag 'apps':
Benchmark
bm-20241022-pythonperf1-amd64-python-34653bba644aa5481613-3.14.0a1+-34653bb
bm-20241024-pythonperf1-amd64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
2to3
246 ms
258 ms: 1.05x slower
docutils
1.91 sec
1.94 sec: 1.02x slower
html5lib
39.2 ms
40.5 ms: 1.03x slower
sphinx
766 ms
798 ms: 1.04x slower
tornado_http
98.7 ms
100 ms: 1.02x slower
Geometric mean
(ref)
1.03x slower
Benchmarks with tag 'asyncio':
Benchmark
bm-20241022-pythonperf1-amd64-python-34653bba644aa5481613-3.14.0a1+-34653bb
bm-20241024-pythonperf1-amd64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
coroutines
14.0 ms
14.1 ms: 1.01x slower
async_tree_io_tg
634 ms
646 ms: 1.02x slower
async_tree_none
217 ms
224 ms: 1.03x slower
async_tree_io
547 ms
564 ms: 1.03x slower
Geometric mean
(ref)
1.01x slower
Benchmark hidden because not significant (6): async_generators, async_tree_memoization_tg, async_tree_none_tg, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_memoization
Benchmarks with tag 'math':
Benchmark
bm-20241022-pythonperf1-amd64-python-34653bba644aa5481613-3.14.0a1+-34653bb
bm-20241024-pythonperf1-amd64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
float
46.5 ms
46.8 ms: 1.01x slower
nbody
53.4 ms
57.3 ms: 1.07x slower
Geometric mean
(ref)
1.03x slower
Benchmark hidden because not significant (1): pidigits
Benchmarks with tag 'regex':
Benchmark
bm-20241022-pythonperf1-amd64-python-34653bba644aa5481613-3.14.0a1+-34653bb
bm-20241024-pythonperf1-amd64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
regex_v8
14.7 ms
15.0 ms: 1.02x slower
regex_effbot
1.55 ms
1.58 ms: 1.02x slower
regex_dna
114 ms
118 ms: 1.03x slower
regex_compile
91.3 ms
98.9 ms: 1.08x slower
Geometric mean
(ref)
1.04x slower
Benchmarks with tag 'serialize':
Benchmark
bm-20241022-pythonperf1-amd64-python-34653bba644aa5481613-3.14.0a1+-34653bb
bm-20241024-pythonperf1-amd64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
json_loads
14.7 us
14.4 us: 1.02x faster
xml_etree_parse
95.6 ms
95.0 ms: 1.01x faster
xml_etree_iterparse
63.1 ms
63.9 ms: 1.01x slower
unpickle_pure_python
145 us
151 us: 1.04x slower
pickle_pure_python
201 us
219 us: 1.09x slower
tomli_loads
1.29 sec
1.41 sec: 1.09x slower
json_dumps
6.13 ms
6.71 ms: 1.09x slower
xml_etree_generate
50.5 ms
55.8 ms: 1.11x slower
xml_etree_process
36.4 ms
40.7 ms: 1.12x slower
Geometric mean
(ref)
1.06x slower
Benchmarks with tag 'startup':
Benchmark
bm-20241022-pythonperf1-amd64-python-34653bba644aa5481613-3.14.0a1+-34653bb
bm-20241024-pythonperf1-amd64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
python_startup_no_site
18.4 ms
18.9 ms: 1.03x slower
python_startup
24.0 ms
24.8 ms: 1.03x slower
Geometric mean
(ref)
1.03x slower
Benchmarks with tag 'template':
Benchmark
bm-20241022-pythonperf1-amd64-python-34653bba644aa5481613-3.14.0a1+-34653bb
bm-20241024-pythonperf1-amd64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
django_template
27.3 ms
28.8 ms: 1.06x slower
genshi_xml
45.9 ms
49.5 ms: 1.08x slower
genshi_text
18.9 ms
20.9 ms: 1.11x slower
mako
5.04 ms
5.60 ms: 1.11x slower
Geometric mean
(ref)
1.09x slower
Benchmark
bm-20241022-pythonperf1-amd64-python-34653bba644aa5481613-3.14.0a1+-34653bb
bm-20241024-pythonperf1-amd64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
dulwich_log
40.3 ms
39.4 ms: 1.02x faster
create_gc_cycles
1.42 ms
1.39 ms: 1.02x faster
json_loads
14.7 us
14.4 us: 1.02x faster
thrift
533 us
529 us: 1.01x faster
xml_etree_parse
95.6 ms
95.0 ms: 1.01x faster
mdp
1.60 sec
1.59 sec: 1.00x faster
coverage
49.8 ms
49.6 ms: 1.00x faster
float
46.5 ms
46.8 ms: 1.01x slower
logging_format
6.62 us
6.68 us: 1.01x slower
coroutines
14.0 ms
14.1 ms: 1.01x slower
xml_etree_iterparse
63.1 ms
63.9 ms: 1.01x slower
tornado_http
98.7 ms
100 ms: 1.02x slower
docutils
1.91 sec
1.94 sec: 1.02x slower
async_tree_io_tg
634 ms
646 ms: 1.02x slower
logging_simple
6.18 us
6.30 us: 1.02x slower
regex_v8
14.7 ms
15.0 ms: 1.02x slower
regex_effbot
1.55 ms
1.58 ms: 1.02x slower
generators
23.1 ms
23.7 ms: 1.03x slower
sympy_expand
328 ms
337 ms: 1.03x slower
python_startup_no_site
18.4 ms
18.9 ms: 1.03x slower
async_tree_none
217 ms
224 ms: 1.03x slower
async_tree_io
547 ms
564 ms: 1.03x slower
regex_dna
114 ms
118 ms: 1.03x slower
html5lib
39.2 ms
40.5 ms: 1.03x slower
sympy_str
193 ms
199 ms: 1.03x slower
python_startup
24.0 ms
24.8 ms: 1.03x slower
sympy_sum
103 ms
107 ms: 1.04x slower
json
2.95 ms
3.06 ms: 1.04x slower
unpickle_pure_python
145 us
151 us: 1.04x slower
sphinx
766 ms
798 ms: 1.04x slower
raytrace
211 ms
221 ms: 1.05x slower
2to3
246 ms
258 ms: 1.05x slower
spectral_norm
53.7 ms
56.3 ms: 1.05x slower
deltablue
2.32 ms
2.43 ms: 1.05x slower
sqlglot_parse
895 us
940 us: 1.05x slower
deepcopy_memo
16.8 us
17.6 us: 1.05x slower
django_template
27.3 ms
28.8 ms: 1.06x slower
pycparser
719 ms
758 ms: 1.06x slower
sympy_integrate
15.5 ms
16.5 ms: 1.06x slower
sqlglot_transpile
1.17 ms
1.25 ms: 1.06x slower
sqlglot_optimize
43.1 ms
46.1 ms: 1.07x slower
typing_runtime_protocols
115 us
123 us: 1.07x slower
telco
4.57 ms
4.90 ms: 1.07x slower
nbody
53.4 ms
57.3 ms: 1.07x slower
genshi_xml
45.9 ms
49.5 ms: 1.08x slower
scimark_sparse_mat_mult
2.21 ms
2.38 ms: 1.08x slower
regex_compile
91.3 ms
98.9 ms: 1.08x slower
fannkuch
233 ms
253 ms: 1.08x slower
deepcopy
193 us
210 us: 1.09x slower
scimark_lu
53.8 ms
58.4 ms: 1.09x slower
meteor_contest
75.2 ms
81.9 ms: 1.09x slower
deepcopy_reduce
1.87 us
2.03 us: 1.09x slower
pickle_pure_python
201 us
219 us: 1.09x slower
tomli_loads
1.29 sec
1.41 sec: 1.09x slower
json_dumps
6.13 ms
6.71 ms: 1.09x slower
sqlglot_normalize
209 ms
228 ms: 1.09x slower
xml_etree_generate
50.5 ms
55.8 ms: 1.11x slower
genshi_text
18.9 ms
20.9 ms: 1.11x slower
scimark_fft
158 ms
175 ms: 1.11x slower
mako
5.04 ms
5.60 ms: 1.11x slower
xml_etree_process
36.4 ms
40.7 ms: 1.12x slower
pyflate
285 ms
324 ms: 1.14x slower
go
89.3 ms
102 ms: 1.14x slower
scimark_sor
62.5 ms
71.8 ms: 1.15x slower
richards_super
36.9 ms
42.5 ms: 1.15x slower
comprehensions
11.7 us
13.5 us: 1.15x slower
hexiom
5.13 ms
5.95 ms: 1.16x slower
nqueens
62.7 ms
72.8 ms: 1.16x slower
chaos
41.0 ms
47.8 ms: 1.17x slower
pprint_safe_repr
458 ms
539 ms: 1.18x slower
richards
32.8 ms
38.6 ms: 1.18x slower
pprint_pformat
936 ms
1.10 sec: 1.18x slower
crypto_pyaes
39.7 ms
47.2 ms: 1.19x slower
scimark_monte_carlo
36.4 ms
45.0 ms: 1.24x slower
logging_silent
53.3 ns
69.4 ns: 1.30x slower
Geometric mean
(ref)
1.06x slower
Benchmark hidden because not significant (12): gc_traversal, pidigits, pathlib, async_generators, async_tree_memoization_tg, bench_mp_pool, async_tree_none_tg, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, bench_thread_pool, pylint, async_tree_memoization
Reliability score: 100.00% likely to be slow
90% likely to have a slowdown of 1.03x
95% likely to have a slowdown of 1.03x
99% likely to have a slowdown of 1.02x