Skip to content

Latest commit

 

History

History
195 lines (172 loc) · 23.9 KB

bm-20241022-pythonperf2-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb-vs-3.12.0.md

File metadata and controls

195 lines (172 loc) · 23.9 KB
Raw

Results vs. 3.12.0

  • fork: python
  • ref: 34653bba644aa5481613
  • machine: linux-x86_64
  • commit hash: 34653bb
  • commit date: 2024-10-22
  • overall geometric mean: 1.09x slower
  • HPT reliability: 72.08%
  • HPT 99th percentile: 1.00x slower
  • Memory change: 1.10x

Benchmarks with tag 'apps':

Benchmark bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 bm-20241022-pythonperf2-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
2to3 285 ms 319 ms: 1.12x slower
docutils 2.87 sec 3.21 sec: 1.12x slower
Geometric mean (ref) 1.08x slower

Benchmark hidden because not significant (1): tornado_http

Benchmarks with tag 'asyncio':

Benchmark bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 bm-20241022-pythonperf2-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
async_tree_memoization_tg 540 ms 379 ms: 1.43x faster
async_tree_none_tg 431 ms 324 ms: 1.33x faster
async_tree_none 452 ms 342 ms: 1.32x faster
async_tree_memoization 544 ms 414 ms: 1.31x faster
async_tree_cpu_io_mixed_tg 697 ms 563 ms: 1.24x faster
async_tree_io 1.04 sec 848 ms: 1.23x faster
async_tree_io_tg 1.05 sec 869 ms: 1.21x faster
async_tree_cpu_io_mixed 696 ms 579 ms: 1.20x faster
Geometric mean (ref) 1.28x faster

Benchmarks with tag 'math':

Benchmark bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 bm-20241022-pythonperf2-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
pidigits 265 ms 251 ms: 1.06x faster
nbody 88.0 ms 84.3 ms: 1.04x faster
float 76.6 ms 78.8 ms: 1.03x slower
Geometric mean (ref) 1.02x faster

Benchmarks with tag 'regex':

Benchmark bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 bm-20241022-pythonperf2-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
regex_effbot 3.57 ms 3.53 ms: 1.01x faster
regex_dna 239 ms 242 ms: 1.01x slower
regex_compile 144 ms 146 ms: 1.01x slower
regex_v8 23.6 ms 25.1 ms: 1.06x slower
Geometric mean (ref) 1.02x slower

Benchmarks with tag 'serialize':

Benchmark bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 bm-20241022-pythonperf2-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
xml_etree_generate 86.1 ms 80.7 ms: 1.07x faster
xml_etree_iterparse 103 ms 99.1 ms: 1.04x faster
xml_etree_parse 144 ms 142 ms: 1.01x faster
tomli_loads 2.16 sec 2.14 sec: 1.01x faster
json_loads 24.4 us 24.6 us: 1.01x slower
pickle_pure_python 318 us 335 us: 1.05x slower
unpickle_pure_python 210 us 221 us: 1.06x slower
json_dumps 10.2 ms 11.5 ms: 1.12x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (1): xml_etree_process

Benchmarks with tag 'startup':

Benchmark bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 bm-20241022-pythonperf2-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
python_startup_no_site 8.64 ms 8.99 ms: 1.04x slower
python_startup 11.6 ms 14.9 ms: 1.28x slower
Geometric mean (ref) 1.15x slower

Benchmarks with tag 'template':

Benchmark bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 bm-20241022-pythonperf2-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
mako 10.0 ms 9.57 ms: 1.04x faster
django_template 38.2 ms 43.6 ms: 1.14x slower
Geometric mean (ref) 1.05x slower

All benchmarks:

Benchmark bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 bm-20241022-pythonperf2-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb
async_tree_memoization_tg 540 ms 379 ms: 1.43x faster
async_tree_none_tg 431 ms 324 ms: 1.33x faster
async_tree_none 452 ms 342 ms: 1.32x faster
async_tree_memoization 544 ms 414 ms: 1.31x faster
async_tree_cpu_io_mixed_tg 697 ms 563 ms: 1.24x faster
async_tree_io 1.04 sec 848 ms: 1.23x faster
deepcopy_memo 36.8 us 30.2 us: 1.22x faster
async_tree_io_tg 1.05 sec 869 ms: 1.21x faster
async_tree_cpu_io_mixed 696 ms 579 ms: 1.20x faster
deepcopy 368 us 313 us: 1.18x faster
pathlib 18.9 ms 16.1 ms: 1.17x faster
comprehensions 21.9 us 19.1 us: 1.15x faster
deepcopy_reduce 3.37 us 3.03 us: 1.11x faster
coroutines 23.0 ms 21.0 ms: 1.09x faster
crypto_pyaes 80.3 ms 74.1 ms: 1.08x faster
xml_etree_generate 86.1 ms 80.7 ms: 1.07x faster
logging_format 7.48 us 7.06 us: 1.06x faster
pidigits 265 ms 251 ms: 1.06x faster
scimark_sor 109 ms 103 ms: 1.06x faster
scimark_fft 301 ms 287 ms: 1.05x faster
mako 10.0 ms 9.57 ms: 1.04x faster
nbody 88.0 ms 84.3 ms: 1.04x faster
scimark_lu 98.8 ms 95.0 ms: 1.04x faster
xml_etree_iterparse 103 ms 99.1 ms: 1.04x faster
dulwich_log 65.4 ms 63.1 ms: 1.04x faster
logging_simple 6.71 us 6.55 us: 1.02x faster
pprint_safe_repr 807 ms 792 ms: 1.02x faster
xml_etree_parse 144 ms 142 ms: 1.01x faster
sqlalchemy_imperative 18.7 ms 18.5 ms: 1.01x faster
asyncio_websockets 387 ms 382 ms: 1.01x faster
regex_effbot 3.57 ms 3.53 ms: 1.01x faster
async_generators 390 ms 386 ms: 1.01x faster
pprint_pformat 1.65 sec 1.64 sec: 1.01x faster
tomli_loads 2.16 sec 2.14 sec: 1.01x faster
json 5.12 ms 5.16 ms: 1.01x slower
scimark_monte_carlo 69.0 ms 69.6 ms: 1.01x slower
deltablue 3.24 ms 3.27 ms: 1.01x slower
json_loads 24.4 us 24.6 us: 1.01x slower
regex_dna 239 ms 242 ms: 1.01x slower
regex_compile 144 ms 146 ms: 1.01x slower
go 150 ms 152 ms: 1.01x slower
mdp 2.57 sec 2.61 sec: 1.02x slower
richards 45.7 ms 46.6 ms: 1.02x slower
spectral_norm 91.6 ms 93.6 ms: 1.02x slower
richards_super 51.3 ms 52.7 ms: 1.03x slower
float 76.6 ms 78.8 ms: 1.03x slower
meteor_contest 128 ms 132 ms: 1.03x slower
scimark_sparse_mat_mult 4.21 ms 4.37 ms: 1.04x slower
python_startup_no_site 8.64 ms 8.99 ms: 1.04x slower
fannkuch 350 ms 365 ms: 1.04x slower
pyflate 439 ms 458 ms: 1.04x slower
logging_silent 94.4 ns 98.6 ns: 1.04x slower
generators 37.4 ms 39.2 ms: 1.05x slower
pickle_pure_python 318 us 335 us: 1.05x slower
unpickle_pure_python 210 us 221 us: 1.06x slower
chaos 64.0 ms 67.7 ms: 1.06x slower
regex_v8 23.6 ms 25.1 ms: 1.06x slower
sqlalchemy_declarative 159 ms 169 ms: 1.06x slower
pycparser 1.23 sec 1.32 sec: 1.07x slower
sympy_str 302 ms 324 ms: 1.07x slower
sympy_sum 162 ms 176 ms: 1.09x slower
sqlglot_parse 1.38 ms 1.51 ms: 1.09x slower
raytrace 298 ms 329 ms: 1.10x slower
sympy_expand 484 ms 537 ms: 1.11x slower
2to3 285 ms 319 ms: 1.12x slower
docutils 2.87 sec 3.21 sec: 1.12x slower
sqlglot_transpile 1.78 ms 1.99 ms: 1.12x slower
json_dumps 10.2 ms 11.5 ms: 1.12x slower
telco 6.96 ms 7.83 ms: 1.13x slower
django_template 38.2 ms 43.6 ms: 1.14x slower
sympy_integrate 23.9 ms 27.5 ms: 1.15x slower
nqueens 89.9 ms 104 ms: 1.15x slower
sqlglot_normalize 116 ms 135 ms: 1.17x slower
coverage 66.7 ms 78.4 ms: 1.18x slower
hexiom 5.96 ms 7.16 ms: 1.20x slower
typing_runtime_protocols 152 us 183 us: 1.21x slower
sqlglot_optimize 57.5 ms 69.8 ms: 1.21x slower
python_startup 11.6 ms 14.9 ms: 1.28x slower
gc_traversal 3.48 ms 5.21 ms: 1.50x slower
create_gc_cycles 1.59 ms 2.89 ms: 1.82x slower
bench_mp_pool 4.76 ms 1.94 sec: 407.53x slower
Geometric mean (ref) 1.09x slower

Benchmark hidden because not significant (3): xml_etree_process, tornado_http, bench_thread_pool Ignored benchmarks (14) of results/bm-20231002-3.12.0-0fb18b0/bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, gunicorn, mypy2, pickle, pickle_dict, pickle_list, sqlite_synth, unpack_sequence, unpickle, unpickle_list Ignored benchmarks (7) of results/bm-20241022-3.14.0a1+-34653bb-JIT/bm-20241022-pythonperf2-x86_64-python-34653bba644aa5481613-3.14.0a1+-34653bb.json: bpe_tokeniser, genshi_text, genshi_xml, html5lib, pylint, sphinx, thrift

HPT report

  • Reliability score: 72.08% likely to be slow
  • 90% likely to have a slowdown of 1.00x
  • 95% likely to have a slowdown of 1.00x
  • 99% likely to have a slowdown of 1.00x

Memory

  • memory change: 1.10x