fork: python
ref: 34653bba644aa5481613
machine: linux-x86_64
commit hash: 34653bb
commit date: 2024-10-22
overall geometric mean: 1.02x slower
HPT reliability: 64.10%
HPT 99th percentile: 1.00x slower
Memory change: 1.18x
Benchmarks with tag 'apps':
Benchmark
bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5
bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
2to3
265 ms
278 ms: 1.05x slower
docutils
2.58 sec
2.95 sec: 1.14x slower
html5lib
64.5 ms
66.2 ms: 1.03x slower
tornado_http
91.5 ms
94.5 ms: 1.03x slower
Geometric mean
(ref)
1.06x slower
Benchmarks with tag 'asyncio':
Benchmark
bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5
bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
async_tree_memoization_tg
465 ms
378 ms: 1.23x faster
async_tree_memoization
442 ms
416 ms: 1.06x faster
async_tree_none
354 ms
336 ms: 1.05x faster
async_tree_cpu_io_mixed_tg
543 ms
556 ms: 1.02x slower
coroutines
22.5 ms
23.3 ms: 1.04x slower
async_generators
433 ms
456 ms: 1.05x slower
async_tree_io_tg
825 ms
974 ms: 1.18x slower
Geometric mean
(ref)
1.00x faster
Benchmark hidden because not significant (4): async_tree_cpu_io_mixed, asyncio_websockets, async_tree_none_tg, async_tree_io
Benchmarks with tag 'math':
Benchmark
bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5
bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
nbody
85.7 ms
82.5 ms: 1.04x faster
float
78.5 ms
76.3 ms: 1.03x faster
pidigits
186 ms
187 ms: 1.00x slower
Geometric mean
(ref)
1.02x faster
Benchmarks with tag 'regex':
Benchmark
bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5
bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
regex_effbot
3.88 ms
3.76 ms: 1.03x faster
regex_v8
25.3 ms
25.1 ms: 1.01x faster
regex_dna
220 ms
221 ms: 1.00x slower
regex_compile
131 ms
137 ms: 1.05x slower
Geometric mean
(ref)
1.00x slower
Benchmarks with tag 'serialize':
Benchmark
bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5
bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
tomli_loads
2.11 sec
1.90 sec: 1.11x faster
xml_etree_generate
87.0 ms
78.6 ms: 1.11x faster
xml_etree_process
60.4 ms
55.4 ms: 1.09x faster
xml_etree_parse
156 ms
147 ms: 1.06x faster
xml_etree_iterparse
102 ms
100 ms: 1.02x faster
unpickle_pure_python
213 us
215 us: 1.01x slower
pickle_pure_python
300 us
316 us: 1.05x slower
json_dumps
10.4 ms
11.2 ms: 1.08x slower
Geometric mean
(ref)
1.03x faster
Benchmark hidden because not significant (1): json_loads
Benchmarks with tag 'startup':
Benchmark
bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5
bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
python_startup_no_site
6.99 ms
7.12 ms: 1.02x slower
python_startup
10.6 ms
11.9 ms: 1.12x slower
Geometric mean
(ref)
1.07x slower
Benchmarks with tag 'template':
Benchmark
bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5
bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
mako
11.1 ms
10.2 ms: 1.09x faster
django_template
34.4 ms
36.2 ms: 1.05x slower
genshi_text
22.9 ms
25.6 ms: 1.12x slower
genshi_xml
50.3 ms
60.1 ms: 1.19x slower
Geometric mean
(ref)
1.07x slower
Benchmark
bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5
bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
deepcopy
352 us
267 us: 1.32x faster
deepcopy_memo
38.0 us
29.1 us: 1.31x faster
async_tree_memoization_tg
465 ms
378 ms: 1.23x faster
richards_super
54.4 ms
45.4 ms: 1.20x faster
deepcopy_reduce
3.17 us
2.72 us: 1.17x faster
scimark_fft
369 ms
321 ms: 1.15x faster
richards
48.1 ms
42.4 ms: 1.13x faster
tomli_loads
2.11 sec
1.90 sec: 1.11x faster
xml_etree_generate
87.0 ms
78.6 ms: 1.11x faster
telco
8.45 ms
7.67 ms: 1.10x faster
mako
11.1 ms
10.2 ms: 1.09x faster
xml_etree_process
60.4 ms
55.4 ms: 1.09x faster
scimark_sparse_mat_mult
5.03 ms
4.63 ms: 1.09x faster
mdp
2.74 sec
2.56 sec: 1.07x faster
go
142 ms
132 ms: 1.07x faster
pathlib
17.1 ms
16.0 ms: 1.07x faster
crypto_pyaes
73.0 ms
68.5 ms: 1.06x faster
async_tree_memoization
442 ms
416 ms: 1.06x faster
xml_etree_parse
156 ms
147 ms: 1.06x faster
async_tree_none
354 ms
336 ms: 1.05x faster
bpe_tokeniser
4.69 sec
4.46 sec: 1.05x faster
json
5.20 ms
4.99 ms: 1.04x faster
nbody
85.7 ms
82.5 ms: 1.04x faster
pycparser
1.19 sec
1.15 sec: 1.04x faster
regex_effbot
3.88 ms
3.76 ms: 1.03x faster
pprint_pformat
1.51 sec
1.47 sec: 1.03x faster
float
78.5 ms
76.3 ms: 1.03x faster
scimark_sor
122 ms
119 ms: 1.03x faster
scimark_monte_carlo
66.3 ms
64.5 ms: 1.03x faster
pprint_safe_repr
744 ms
725 ms: 1.03x faster
logging_simple
5.66 us
5.54 us: 1.02x faster
xml_etree_iterparse
102 ms
100 ms: 1.02x faster
scimark_lu
115 ms
113 ms: 1.02x faster
logging_format
6.25 us
6.15 us: 1.02x faster
thrift
796 us
787 us: 1.01x faster
pyflate
460 ms
455 ms: 1.01x faster
regex_v8
25.3 ms
25.1 ms: 1.01x faster
pidigits
186 ms
187 ms: 1.00x slower
regex_dna
220 ms
221 ms: 1.00x slower
meteor_contest
108 ms
108 ms: 1.01x slower
unpickle_pure_python
213 us
215 us: 1.01x slower
chaos
58.4 ms
59.4 ms: 1.02x slower
python_startup_no_site
6.99 ms
7.12 ms: 1.02x slower
async_tree_cpu_io_mixed_tg
543 ms
556 ms: 1.02x slower
deltablue
3.15 ms
3.23 ms: 1.03x slower
html5lib
64.5 ms
66.2 ms: 1.03x slower
logging_silent
102 ns
105 ns: 1.03x slower
tornado_http
91.5 ms
94.5 ms: 1.03x slower
coroutines
22.5 ms
23.3 ms: 1.04x slower
comprehensions
16.4 us
17.1 us: 1.04x slower
2to3
265 ms
278 ms: 1.05x slower
regex_compile
131 ms
137 ms: 1.05x slower
typing_runtime_protocols
159 us
167 us: 1.05x slower
sqlglot_parse
1.27 ms
1.33 ms: 1.05x slower
django_template
34.4 ms
36.2 ms: 1.05x slower
async_generators
433 ms
456 ms: 1.05x slower
pickle_pure_python
300 us
316 us: 1.05x slower
dulwich_log
63.0 ms
66.4 ms: 1.05x slower
sqlglot_normalize
107 ms
113 ms: 1.06x slower
sqlglot_transpile
1.57 ms
1.69 ms: 1.08x slower
json_dumps
10.4 ms
11.2 ms: 1.08x slower
bench_thread_pool
815 us
881 us: 1.08x slower
nqueens
80.6 ms
87.4 ms: 1.08x slower
raytrace
262 ms
284 ms: 1.08x slower
sympy_expand
462 ms
502 ms: 1.09x slower
sqlglot_optimize
53.9 ms
59.6 ms: 1.11x slower
sympy_str
274 ms
303 ms: 1.11x slower
genshi_text
22.9 ms
25.6 ms: 1.12x slower
python_startup
10.6 ms
11.9 ms: 1.12x slower
pylint
313 ms
356 ms: 1.14x slower
hexiom
6.13 ms
6.98 ms: 1.14x slower
docutils
2.58 sec
2.95 sec: 1.14x slower
sympy_sum
150 ms
176 ms: 1.18x slower
sympy_integrate
19.9 ms
23.4 ms: 1.18x slower
async_tree_io_tg
825 ms
974 ms: 1.18x slower
genshi_xml
50.3 ms
60.1 ms: 1.19x slower
generators
28.8 ms
35.2 ms: 1.22x slower
gc_traversal
3.81 ms
4.81 ms: 1.26x slower
create_gc_cycles
1.61 ms
2.70 ms: 1.68x slower
bench_mp_pool
24.0 ms
84.4 ms: 3.52x slower
Geometric mean
(ref)
1.02x slower
Benchmark hidden because not significant (8): async_tree_cpu_io_mixed, asyncio_websockets, fannkuch, json_loads, coverage, async_tree_none_tg, spectral_norm, async_tree_io
Ignored benchmarks (16) of results/bm-20241007-3.13.0-60403a5/bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, djangocms, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, sqlite_synth, unpack_sequence, unpickle, unpickle_list
Ignored benchmarks (1) of results/bm-20241022-3.14.0a1+-34653bb-JIT/bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb.json: sphinx
Reliability score: 64.10% likely to be slow
90% likely to have a slowdown of 1.00x
95% likely to have a slowdown of 1.00x
99% likely to have a slowdown of 1.00x