fork: brandtbucher
ref: justin_no_externs
machine: windows-x86
commit hash: 64b198a
commit date: 2024-10-25
overall geometric mean: 1.03x slower
HPT reliability: 100.00%
HPT 99th percentile: 1.01x slower
Memory change: unknown
Benchmarks with tag 'apps':
Benchmark
bm-20241022-pythonperf1_win32-x86-python-34653bba644aa5481613-3.14.0a1+-34653bb
bm-20241025-pythonperf1_win32-x86-brandtbucher-justin_no_externs-3.14.0a1+-64b198a
2to3
265 ms
270 ms: 1.02x slower
docutils
2.04 sec
2.08 sec: 1.02x slower
html5lib
46.4 ms
45.9 ms: 1.01x faster
sphinx
846 ms
860 ms: 1.02x slower
Geometric mean
(ref)
1.01x slower
Benchmark hidden because not significant (1): tornado_http
Benchmarks with tag 'asyncio':
Benchmark
bm-20241022-pythonperf1_win32-x86-python-34653bba644aa5481613-3.14.0a1+-34653bb
bm-20241025-pythonperf1_win32-x86-brandtbucher-justin_no_externs-3.14.0a1+-64b198a
async_generators
339 ms
332 ms: 1.02x faster
coroutines
17.4 ms
17.3 ms: 1.01x faster
async_tree_io_tg
545 ms
551 ms: 1.01x slower
async_tree_io
516 ms
525 ms: 1.02x slower
async_tree_none_tg
199 ms
203 ms: 1.02x slower
async_tree_memoization
275 ms
281 ms: 1.02x slower
async_tree_none
217 ms
223 ms: 1.03x slower
Geometric mean
(ref)
1.01x slower
Benchmark hidden because not significant (3): async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_memoization_tg
Benchmarks with tag 'math':
Benchmark
bm-20241022-pythonperf1_win32-x86-python-34653bba644aa5481613-3.14.0a1+-34653bb
bm-20241025-pythonperf1_win32-x86-brandtbucher-justin_no_externs-3.14.0a1+-64b198a
nbody
67.5 ms
63.0 ms: 1.07x faster
pidigits
204 ms
203 ms: 1.00x faster
float
45.9 ms
49.6 ms: 1.08x slower
Geometric mean
(ref)
1.00x slower
Benchmarks with tag 'regex':
Benchmark
bm-20241022-pythonperf1_win32-x86-python-34653bba644aa5481613-3.14.0a1+-34653bb
bm-20241025-pythonperf1_win32-x86-brandtbucher-justin_no_externs-3.14.0a1+-64b198a
regex_effbot
1.84 ms
1.77 ms: 1.04x faster
regex_dna
125 ms
120 ms: 1.04x faster
regex_compile
106 ms
110 ms: 1.03x slower
regex_v8
14.8 ms
15.9 ms: 1.07x slower
Geometric mean
(ref)
1.01x slower
Benchmarks with tag 'serialize':
Benchmark
bm-20241022-pythonperf1_win32-x86-python-34653bba644aa5481613-3.14.0a1+-34653bb
bm-20241025-pythonperf1_win32-x86-brandtbucher-justin_no_externs-3.14.0a1+-64b198a
pickle_pure_python
240 us
245 us: 1.02x slower
json_loads
20.7 us
21.2 us: 1.02x slower
tomli_loads
1.54 sec
1.59 sec: 1.04x slower
xml_etree_iterparse
64.8 ms
67.7 ms: 1.04x slower
xml_etree_generate
55.5 ms
58.2 ms: 1.05x slower
unpickle_pure_python
158 us
169 us: 1.07x slower
xml_etree_process
42.2 ms
45.4 ms: 1.08x slower
Geometric mean
(ref)
1.03x slower
Benchmark hidden because not significant (2): json_dumps, xml_etree_parse
Benchmarks with tag 'startup':
Benchmark
bm-20241022-pythonperf1_win32-x86-python-34653bba644aa5481613-3.14.0a1+-34653bb
bm-20241025-pythonperf1_win32-x86-brandtbucher-justin_no_externs-3.14.0a1+-64b198a
python_startup
26.4 ms
26.6 ms: 1.01x slower
Geometric mean
(ref)
1.00x slower
Benchmark hidden because not significant (1): python_startup_no_site
Benchmarks with tag 'template':
Benchmark
bm-20241022-pythonperf1_win32-x86-python-34653bba644aa5481613-3.14.0a1+-34653bb
bm-20241025-pythonperf1_win32-x86-brandtbucher-justin_no_externs-3.14.0a1+-64b198a
django_template
32.0 ms
33.0 ms: 1.03x slower
mako
5.79 ms
6.44 ms: 1.11x slower
Geometric mean
(ref)
1.03x slower
Benchmark hidden because not significant (2): genshi_xml, genshi_text
Benchmark
bm-20241022-pythonperf1_win32-x86-python-34653bba644aa5481613-3.14.0a1+-34653bb
bm-20241025-pythonperf1_win32-x86-brandtbucher-justin_no_externs-3.14.0a1+-64b198a
nbody
67.5 ms
63.0 ms: 1.07x faster
regex_effbot
1.84 ms
1.77 ms: 1.04x faster
regex_dna
125 ms
120 ms: 1.04x faster
raytrace
266 ms
256 ms: 1.04x faster
richards
36.8 ms
35.9 ms: 1.03x faster
richards_super
42.0 ms
41.0 ms: 1.02x faster
async_generators
339 ms
332 ms: 1.02x faster
html5lib
46.4 ms
45.9 ms: 1.01x faster
coverage
54.3 ms
53.8 ms: 1.01x faster
thrift
773 us
766 us: 1.01x faster
coroutines
17.4 ms
17.3 ms: 1.01x faster
pidigits
204 ms
203 ms: 1.00x faster
bench_mp_pool
94.0 ms
94.4 ms: 1.00x slower
sqlglot_parse
1.03 ms
1.04 ms: 1.01x slower
meteor_contest
73.0 ms
73.6 ms: 1.01x slower
logging_simple
7.71 us
7.78 us: 1.01x slower
python_startup
26.4 ms
26.6 ms: 1.01x slower
async_tree_io_tg
545 ms
551 ms: 1.01x slower
logging_format
8.34 us
8.45 us: 1.01x slower
typing_runtime_protocols
141 us
143 us: 1.01x slower
sympy_expand
399 ms
406 ms: 1.02x slower
docutils
2.04 sec
2.08 sec: 1.02x slower
sphinx
846 ms
860 ms: 1.02x slower
sympy_sum
117 ms
119 ms: 1.02x slower
sqlglot_transpile
1.34 ms
1.36 ms: 1.02x slower
async_tree_io
516 ms
525 ms: 1.02x slower
2to3
265 ms
270 ms: 1.02x slower
pickle_pure_python
240 us
245 us: 1.02x slower
dulwich_log
49.2 ms
50.2 ms: 1.02x slower
pycparser
829 ms
845 ms: 1.02x slower
async_tree_none_tg
199 ms
203 ms: 1.02x slower
sympy_str
231 ms
236 ms: 1.02x slower
async_tree_memoization
275 ms
281 ms: 1.02x slower
json_loads
20.7 us
21.2 us: 1.02x slower
sqlglot_optimize
49.6 ms
50.8 ms: 1.02x slower
deepcopy_reduce
2.47 us
2.53 us: 1.03x slower
async_tree_none
217 ms
223 ms: 1.03x slower
django_template
32.0 ms
33.0 ms: 1.03x slower
deepcopy
238 us
245 us: 1.03x slower
sympy_integrate
17.4 ms
18.0 ms: 1.03x slower
sqlglot_normalize
102 ms
105 ms: 1.03x slower
regex_compile
106 ms
110 ms: 1.03x slower
mdp
1.70 sec
1.76 sec: 1.04x slower
tomli_loads
1.54 sec
1.59 sec: 1.04x slower
pyflate
319 ms
330 ms: 1.04x slower
telco
5.78 ms
6.01 ms: 1.04x slower
pprint_pformat
1.18 sec
1.23 sec: 1.04x slower
go
96.4 ms
101 ms: 1.04x slower
generators
24.5 ms
25.5 ms: 1.04x slower
pprint_safe_repr
578 ms
603 ms: 1.04x slower
xml_etree_iterparse
64.8 ms
67.7 ms: 1.04x slower
xml_etree_generate
55.5 ms
58.2 ms: 1.05x slower
comprehensions
13.4 us
14.2 us: 1.06x slower
unpickle_pure_python
158 us
169 us: 1.07x slower
regex_v8
14.8 ms
15.9 ms: 1.07x slower
scimark_sparse_mat_mult
2.46 ms
2.65 ms: 1.07x slower
fannkuch
238 ms
256 ms: 1.07x slower
xml_etree_process
42.2 ms
45.4 ms: 1.08x slower
crypto_pyaes
50.2 ms
54.0 ms: 1.08x slower
hexiom
5.50 ms
5.94 ms: 1.08x slower
float
45.9 ms
49.6 ms: 1.08x slower
nqueens
77.2 ms
83.7 ms: 1.08x slower
scimark_lu
60.1 ms
65.2 ms: 1.08x slower
deltablue
2.51 ms
2.73 ms: 1.09x slower
scimark_fft
177 ms
195 ms: 1.10x slower
deepcopy_memo
16.4 us
18.0 us: 1.10x slower
mako
5.79 ms
6.44 ms: 1.11x slower
scimark_sor
67.8 ms
76.9 ms: 1.13x slower
spectral_norm
58.1 ms
67.5 ms: 1.16x slower
scimark_monte_carlo
39.5 ms
47.7 ms: 1.21x slower
logging_silent
53.7 ns
64.9 ns: 1.21x slower
Geometric mean
(ref)
1.03x slower
Benchmark hidden because not significant (16): create_gc_cycles, pathlib, chaos, json_dumps, genshi_xml, python_startup_no_site, gc_traversal, xml_etree_parse, genshi_text, async_tree_cpu_io_mixed, tornado_http, async_tree_cpu_io_mixed_tg, json, async_tree_memoization_tg, pylint, bench_thread_pool
Reliability score: 100.00% likely to be slow
90% likely to have a slowdown of 1.01x
95% likely to have a slowdown of 1.01x
99% likely to have a slowdown of 1.01x