Skip to content

Latest commit

 

History

History
197 lines (174 loc) · 22.7 KB

bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb-vs-3.13.0.md

File metadata and controls

197 lines (174 loc) · 22.7 KB
Raw

Results vs. 3.13.0

  • fork: python
  • ref: 34653bba644aa5481613
  • machine: linux-x86_64
  • commit hash: 34653bb
  • commit date: 2024-10-22
  • overall geometric mean: 1.02x slower
  • HPT reliability: 64.10%
  • HPT 99th percentile: 1.00x slower
  • Memory change: 1.18x

Benchmarks with tag 'apps':

Benchmark bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
2to3 265 ms 278 ms: 1.05x slower
docutils 2.58 sec 2.95 sec: 1.14x slower
html5lib 64.5 ms 66.2 ms: 1.03x slower
tornado_http 91.5 ms 94.5 ms: 1.03x slower
Geometric mean (ref) 1.06x slower

Benchmarks with tag 'asyncio':

Benchmark bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
async_tree_memoization_tg 465 ms 378 ms: 1.23x faster
async_tree_memoization 442 ms 416 ms: 1.06x faster
async_tree_none 354 ms 336 ms: 1.05x faster
async_tree_cpu_io_mixed_tg 543 ms 556 ms: 1.02x slower
coroutines 22.5 ms 23.3 ms: 1.04x slower
async_generators 433 ms 456 ms: 1.05x slower
async_tree_io_tg 825 ms 974 ms: 1.18x slower
Geometric mean (ref) 1.00x faster

Benchmark hidden because not significant (4): async_tree_cpu_io_mixed, asyncio_websockets, async_tree_none_tg, async_tree_io

Benchmarks with tag 'math':

Benchmark bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
nbody 85.7 ms 82.5 ms: 1.04x faster
float 78.5 ms 76.3 ms: 1.03x faster
pidigits 186 ms 187 ms: 1.00x slower
Geometric mean (ref) 1.02x faster

Benchmarks with tag 'regex':

Benchmark bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
regex_effbot 3.88 ms 3.76 ms: 1.03x faster
regex_v8 25.3 ms 25.1 ms: 1.01x faster
regex_dna 220 ms 221 ms: 1.00x slower
regex_compile 131 ms 137 ms: 1.05x slower
Geometric mean (ref) 1.00x slower

Benchmarks with tag 'serialize':

Benchmark bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
tomli_loads 2.11 sec 1.90 sec: 1.11x faster
xml_etree_generate 87.0 ms 78.6 ms: 1.11x faster
xml_etree_process 60.4 ms 55.4 ms: 1.09x faster
xml_etree_parse 156 ms 147 ms: 1.06x faster
xml_etree_iterparse 102 ms 100 ms: 1.02x faster
unpickle_pure_python 213 us 215 us: 1.01x slower
pickle_pure_python 300 us 316 us: 1.05x slower
json_dumps 10.4 ms 11.2 ms: 1.08x slower
Geometric mean (ref) 1.03x faster

Benchmark hidden because not significant (1): json_loads

Benchmarks with tag 'startup':

Benchmark bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
python_startup_no_site 6.99 ms 7.12 ms: 1.02x slower
python_startup 10.6 ms 11.9 ms: 1.12x slower
Geometric mean (ref) 1.07x slower

Benchmarks with tag 'template':

Benchmark bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
mako 11.1 ms 10.2 ms: 1.09x faster
django_template 34.4 ms 36.2 ms: 1.05x slower
genshi_text 22.9 ms 25.6 ms: 1.12x slower
genshi_xml 50.3 ms 60.1 ms: 1.19x slower
Geometric mean (ref) 1.07x slower

All benchmarks:

Benchmark bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
deepcopy 352 us 267 us: 1.32x faster
deepcopy_memo 38.0 us 29.1 us: 1.31x faster
async_tree_memoization_tg 465 ms 378 ms: 1.23x faster
richards_super 54.4 ms 45.4 ms: 1.20x faster
deepcopy_reduce 3.17 us 2.72 us: 1.17x faster
scimark_fft 369 ms 321 ms: 1.15x faster
richards 48.1 ms 42.4 ms: 1.13x faster
tomli_loads 2.11 sec 1.90 sec: 1.11x faster
xml_etree_generate 87.0 ms 78.6 ms: 1.11x faster
telco 8.45 ms 7.67 ms: 1.10x faster
mako 11.1 ms 10.2 ms: 1.09x faster
xml_etree_process 60.4 ms 55.4 ms: 1.09x faster
scimark_sparse_mat_mult 5.03 ms 4.63 ms: 1.09x faster
mdp 2.74 sec 2.56 sec: 1.07x faster
go 142 ms 132 ms: 1.07x faster
pathlib 17.1 ms 16.0 ms: 1.07x faster
crypto_pyaes 73.0 ms 68.5 ms: 1.06x faster
async_tree_memoization 442 ms 416 ms: 1.06x faster
xml_etree_parse 156 ms 147 ms: 1.06x faster
async_tree_none 354 ms 336 ms: 1.05x faster
bpe_tokeniser 4.69 sec 4.46 sec: 1.05x faster
json 5.20 ms 4.99 ms: 1.04x faster
nbody 85.7 ms 82.5 ms: 1.04x faster
pycparser 1.19 sec 1.15 sec: 1.04x faster
regex_effbot 3.88 ms 3.76 ms: 1.03x faster
pprint_pformat 1.51 sec 1.47 sec: 1.03x faster
float 78.5 ms 76.3 ms: 1.03x faster
scimark_sor 122 ms 119 ms: 1.03x faster
scimark_monte_carlo 66.3 ms 64.5 ms: 1.03x faster
pprint_safe_repr 744 ms 725 ms: 1.03x faster
logging_simple 5.66 us 5.54 us: 1.02x faster
xml_etree_iterparse 102 ms 100 ms: 1.02x faster
scimark_lu 115 ms 113 ms: 1.02x faster
logging_format 6.25 us 6.15 us: 1.02x faster
thrift 796 us 787 us: 1.01x faster
pyflate 460 ms 455 ms: 1.01x faster
regex_v8 25.3 ms 25.1 ms: 1.01x faster
pidigits 186 ms 187 ms: 1.00x slower
regex_dna 220 ms 221 ms: 1.00x slower
meteor_contest 108 ms 108 ms: 1.01x slower
unpickle_pure_python 213 us 215 us: 1.01x slower
chaos 58.4 ms 59.4 ms: 1.02x slower
python_startup_no_site 6.99 ms 7.12 ms: 1.02x slower
async_tree_cpu_io_mixed_tg 543 ms 556 ms: 1.02x slower
deltablue 3.15 ms 3.23 ms: 1.03x slower
html5lib 64.5 ms 66.2 ms: 1.03x slower
logging_silent 102 ns 105 ns: 1.03x slower
tornado_http 91.5 ms 94.5 ms: 1.03x slower
coroutines 22.5 ms 23.3 ms: 1.04x slower
comprehensions 16.4 us 17.1 us: 1.04x slower
2to3 265 ms 278 ms: 1.05x slower
regex_compile 131 ms 137 ms: 1.05x slower
typing_runtime_protocols 159 us 167 us: 1.05x slower
sqlglot_parse 1.27 ms 1.33 ms: 1.05x slower
django_template 34.4 ms 36.2 ms: 1.05x slower
async_generators 433 ms 456 ms: 1.05x slower
pickle_pure_python 300 us 316 us: 1.05x slower
dulwich_log 63.0 ms 66.4 ms: 1.05x slower
sqlglot_normalize 107 ms 113 ms: 1.06x slower
sqlglot_transpile 1.57 ms 1.69 ms: 1.08x slower
json_dumps 10.4 ms 11.2 ms: 1.08x slower
bench_thread_pool 815 us 881 us: 1.08x slower
nqueens 80.6 ms 87.4 ms: 1.08x slower
raytrace 262 ms 284 ms: 1.08x slower
sympy_expand 462 ms 502 ms: 1.09x slower
sqlglot_optimize 53.9 ms 59.6 ms: 1.11x slower
sympy_str 274 ms 303 ms: 1.11x slower
genshi_text 22.9 ms 25.6 ms: 1.12x slower
python_startup 10.6 ms 11.9 ms: 1.12x slower
pylint 313 ms 356 ms: 1.14x slower
hexiom 6.13 ms 6.98 ms: 1.14x slower
docutils 2.58 sec 2.95 sec: 1.14x slower
sympy_sum 150 ms 176 ms: 1.18x slower
sympy_integrate 19.9 ms 23.4 ms: 1.18x slower
async_tree_io_tg 825 ms 974 ms: 1.18x slower
genshi_xml 50.3 ms 60.1 ms: 1.19x slower
generators 28.8 ms 35.2 ms: 1.22x slower
gc_traversal 3.81 ms 4.81 ms: 1.26x slower
create_gc_cycles 1.61 ms 2.70 ms: 1.68x slower
bench_mp_pool 24.0 ms 84.4 ms: 3.52x slower
Geometric mean (ref) 1.02x slower

Benchmark hidden because not significant (8): async_tree_cpu_io_mixed, asyncio_websockets, fannkuch, json_loads, coverage, async_tree_none_tg, spectral_norm, async_tree_io Ignored benchmarks (16) of results/bm-20241007-3.13.0-60403a5/bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, djangocms, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, sqlite_synth, unpack_sequence, unpickle, unpickle_list Ignored benchmarks (1) of results/bm-20241022-3.14.0a1+-34653bb-JIT/bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb.json: sphinx

HPT report

  • Reliability score: 64.10% likely to be slow
  • 90% likely to have a slowdown of 1.00x
  • 95% likely to have a slowdown of 1.00x
  • 99% likely to have a slowdown of 1.00x

Memory

  • memory change: 1.18x