Skip to content

Latest commit

 

History

History
185 lines (157 loc) · 22.2 KB

bm-20241024-arminc-aarch64-brandtbucher-justin_no_externs-3.14.0a1+-9698931-vs-base.md

File metadata and controls

185 lines (157 loc) · 22.2 KB

Results vs. base

  • fork: brandtbucher
  • ref: justin_no_externs
  • machine: linux-aarch64
  • commit hash: 9698931
  • commit date: 2024-10-24
  • overall geometric mean: 1.05x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.01x slower
  • Memory change: 1.01x

Benchmarks with tag 'apps':

Benchmark bm-20241022-arminc-aarch64-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241024-arminc-aarch64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
2to3 385 ms 401 ms: 1.04x slower
docutils 3.64 sec 3.74 sec: 1.03x slower
html5lib 71.3 ms 73.0 ms: 1.02x slower
tornado_http 147 ms 152 ms: 1.03x slower
Geometric mean (ref) 1.03x slower

Benchmark hidden because not significant (1): sphinx

Benchmarks with tag 'asyncio':

Benchmark bm-20241022-arminc-aarch64-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241024-arminc-aarch64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
async_generators 510 ms 505 ms: 1.01x faster
async_tree_none 468 ms 473 ms: 1.01x slower
async_tree_cpu_io_mixed 755 ms 768 ms: 1.02x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (8): async_tree_memoization_tg, async_tree_cpu_io_mixed_tg, async_tree_io_tg, asyncio_websockets, coroutines, async_tree_none_tg, async_tree_memoization, async_tree_io

Benchmarks with tag 'math':

Benchmark bm-20241022-arminc-aarch64-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241024-arminc-aarch64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
float 97.1 ms 98.7 ms: 1.02x slower
nbody 114 ms 132 ms: 1.16x slower
Geometric mean (ref) 1.06x slower

Benchmark hidden because not significant (1): pidigits

Benchmarks with tag 'regex':

Benchmark bm-20241022-arminc-aarch64-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241024-arminc-aarch64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
regex_v8 30.6 ms 30.9 ms: 1.01x slower
regex_compile 171 ms 183 ms: 1.07x slower
Geometric mean (ref) 1.02x slower

Benchmark hidden because not significant (2): regex_dna, regex_effbot

Benchmarks with tag 'serialize':

Benchmark bm-20241022-arminc-aarch64-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241024-arminc-aarch64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
xml_etree_iterparse 150 ms 151 ms: 1.01x slower
json_loads 31.5 us 31.8 us: 1.01x slower
xml_etree_parse 186 ms 189 ms: 1.01x slower
unpickle_pure_python 269 us 275 us: 1.02x slower
xml_etree_generate 112 ms 117 ms: 1.05x slower
xml_etree_process 81.1 ms 86.3 ms: 1.06x slower
pickle_pure_python 386 us 411 us: 1.06x slower
tomli_loads 2.61 sec 2.93 sec: 1.12x slower
Geometric mean (ref) 1.04x slower

Benchmark hidden because not significant (1): json_dumps

Benchmarks with tag 'startup':

Benchmark bm-20241022-arminc-aarch64-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241024-arminc-aarch64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
python_startup 14.8 ms 14.6 ms: 1.02x faster
Geometric mean (ref) 1.01x faster

Benchmark hidden because not significant (1): python_startup_no_site

Benchmarks with tag 'template':

Benchmark bm-20241022-arminc-aarch64-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241024-arminc-aarch64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
genshi_xml 84.0 ms 86.4 ms: 1.03x slower
mako 13.2 ms 14.2 ms: 1.07x slower
django_template 51.4 ms 55.3 ms: 1.08x slower
Geometric mean (ref) 1.04x slower

Benchmark hidden because not significant (1): genshi_text

All benchmarks:

Benchmark bm-20241022-arminc-aarch64-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241024-arminc-aarch64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
generators 59.0 ms 55.2 ms: 1.07x faster
gc_traversal 6.47 ms 6.16 ms: 1.05x faster
create_gc_cycles 3.75 ms 3.67 ms: 1.02x faster
python_startup 14.8 ms 14.6 ms: 1.02x faster
async_generators 510 ms 505 ms: 1.01x faster
xml_etree_iterparse 150 ms 151 ms: 1.01x slower
regex_v8 30.6 ms 30.9 ms: 1.01x slower
coverage 98.0 ms 98.8 ms: 1.01x slower
json_loads 31.5 us 31.8 us: 1.01x slower
async_tree_none 468 ms 473 ms: 1.01x slower
xml_etree_parse 186 ms 189 ms: 1.01x slower
float 97.1 ms 98.7 ms: 1.02x slower
async_tree_cpu_io_mixed 755 ms 768 ms: 1.02x slower
sqlalchemy_declarative 190 ms 193 ms: 1.02x slower
unpickle_pure_python 269 us 275 us: 1.02x slower
logging_format 8.16 us 8.34 us: 1.02x slower
sympy_integrate 29.6 ms 30.3 ms: 1.02x slower
deepcopy 383 us 392 us: 1.02x slower
html5lib 71.3 ms 73.0 ms: 1.02x slower
sympy_str 362 ms 370 ms: 1.02x slower
logging_simple 7.45 us 7.63 us: 1.02x slower
sympy_expand 589 ms 603 ms: 1.02x slower
sympy_sum 217 ms 222 ms: 1.03x slower
json 5.57 ms 5.72 ms: 1.03x slower
docutils 3.64 sec 3.74 sec: 1.03x slower
genshi_xml 84.0 ms 86.4 ms: 1.03x slower
tornado_http 147 ms 152 ms: 1.03x slower
typing_runtime_protocols 214 us 221 us: 1.04x slower
2to3 385 ms 401 ms: 1.04x slower
deepcopy_reduce 4.02 us 4.19 us: 1.04x slower
scimark_lu 151 ms 158 ms: 1.04x slower
logging_silent 147 ns 153 ns: 1.05x slower
telco 9.57 ms 10.0 ms: 1.05x slower
xml_etree_generate 112 ms 117 ms: 1.05x slower
raytrace 351 ms 368 ms: 1.05x slower
sqlglot_normalize 156 ms 163 ms: 1.05x slower
sqlglot_optimize 81.8 ms 86.1 ms: 1.05x slower
bpe_tokeniser 5.96 sec 6.29 sec: 1.05x slower
pycparser 1.49 sec 1.58 sec: 1.06x slower
scimark_fft 453 ms 481 ms: 1.06x slower
xml_etree_process 81.1 ms 86.3 ms: 1.06x slower
pickle_pure_python 386 us 411 us: 1.06x slower
sqlglot_parse 1.71 ms 1.82 ms: 1.07x slower
regex_compile 171 ms 183 ms: 1.07x slower
scimark_sparse_mat_mult 7.20 ms 7.70 ms: 1.07x slower
scimark_sor 154 ms 166 ms: 1.07x slower
sqlglot_transpile 2.18 ms 2.33 ms: 1.07x slower
mako 13.2 ms 14.2 ms: 1.07x slower
django_template 51.4 ms 55.3 ms: 1.08x slower
deltablue 4.48 ms 4.83 ms: 1.08x slower
meteor_contest 123 ms 133 ms: 1.08x slower
fannkuch 505 ms 547 ms: 1.08x slower
comprehensions 25.1 us 27.3 us: 1.08x slower
spectral_norm 154 ms 167 ms: 1.09x slower
deepcopy_memo 38.8 us 42.3 us: 1.09x slower
go 183 ms 203 ms: 1.11x slower
crypto_pyaes 89.4 ms 99.1 ms: 1.11x slower
hexiom 10.3 ms 11.5 ms: 1.11x slower
chaos 85.4 ms 95.6 ms: 1.12x slower
tomli_loads 2.61 sec 2.93 sec: 1.12x slower
nqueens 124 ms 139 ms: 1.12x slower
pprint_pformat 2.54 sec 2.85 sec: 1.12x slower
scimark_monte_carlo 88.9 ms 101 ms: 1.14x slower
pprint_safe_repr 1.20 sec 1.37 sec: 1.14x slower
richards_super 70.6 ms 80.8 ms: 1.14x slower
nbody 114 ms 132 ms: 1.16x slower
pyflate 618 ms 725 ms: 1.17x slower
richards 65.8 ms 79.8 ms: 1.21x slower
bench_mp_pool 1.01 sec 2.46 sec: 2.44x slower
Geometric mean (ref) 1.05x slower

Benchmark hidden because not significant (22): pathlib, regex_dna, pylint, python_startup_no_site, bench_thread_pool, async_tree_memoization_tg, pidigits, async_tree_cpu_io_mixed_tg, async_tree_io_tg, sqlalchemy_imperative, genshi_text, regex_effbot, mdp, asyncio_websockets, coroutines, async_tree_none_tg, json_dumps, thrift, sphinx, async_tree_memoization, async_tree_io, dulwich_log

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.02x
  • 95% likely to have a slowdown of 1.02x
  • 99% likely to have a slowdown of 1.01x

Memory

  • memory change: 1.01x