Skip to content

Latest commit

 

History

History
188 lines (165 loc) · 24.7 KB

bm-20241024-pythonperf1-amd64-brandtbucher-justin_no_externs-3.14.0a1+-9698931-vs-base.md

File metadata and controls

188 lines (165 loc) · 24.7 KB
Raw

Results vs. base

  • fork: brandtbucher
  • ref: justin_no_externs
  • machine: windows-amd64
  • commit hash: 9698931
  • commit date: 2024-10-24
  • overall geometric mean: 1.06x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.02x slower
  • Memory change: unknown

Benchmarks with tag 'apps':

Benchmark bm-20241022-pythonperf1-amd64-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241024-pythonperf1-amd64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
2to3 246 ms 258 ms: 1.05x slower
docutils 1.91 sec 1.94 sec: 1.02x slower
html5lib 39.2 ms 40.5 ms: 1.03x slower
sphinx 766 ms 798 ms: 1.04x slower
tornado_http 98.7 ms 100 ms: 1.02x slower
Geometric mean (ref) 1.03x slower

Benchmarks with tag 'asyncio':

Benchmark bm-20241022-pythonperf1-amd64-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241024-pythonperf1-amd64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
coroutines 14.0 ms 14.1 ms: 1.01x slower
async_tree_io_tg 634 ms 646 ms: 1.02x slower
async_tree_none 217 ms 224 ms: 1.03x slower
async_tree_io 547 ms 564 ms: 1.03x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (6): async_generators, async_tree_memoization_tg, async_tree_none_tg, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_memoization

Benchmarks with tag 'math':

Benchmark bm-20241022-pythonperf1-amd64-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241024-pythonperf1-amd64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
float 46.5 ms 46.8 ms: 1.01x slower
nbody 53.4 ms 57.3 ms: 1.07x slower
Geometric mean (ref) 1.03x slower

Benchmark hidden because not significant (1): pidigits

Benchmarks with tag 'regex':

Benchmark bm-20241022-pythonperf1-amd64-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241024-pythonperf1-amd64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
regex_v8 14.7 ms 15.0 ms: 1.02x slower
regex_effbot 1.55 ms 1.58 ms: 1.02x slower
regex_dna 114 ms 118 ms: 1.03x slower
regex_compile 91.3 ms 98.9 ms: 1.08x slower
Geometric mean (ref) 1.04x slower

Benchmarks with tag 'serialize':

Benchmark bm-20241022-pythonperf1-amd64-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241024-pythonperf1-amd64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
json_loads 14.7 us 14.4 us: 1.02x faster
xml_etree_parse 95.6 ms 95.0 ms: 1.01x faster
xml_etree_iterparse 63.1 ms 63.9 ms: 1.01x slower
unpickle_pure_python 145 us 151 us: 1.04x slower
pickle_pure_python 201 us 219 us: 1.09x slower
tomli_loads 1.29 sec 1.41 sec: 1.09x slower
json_dumps 6.13 ms 6.71 ms: 1.09x slower
xml_etree_generate 50.5 ms 55.8 ms: 1.11x slower
xml_etree_process 36.4 ms 40.7 ms: 1.12x slower
Geometric mean (ref) 1.06x slower

Benchmarks with tag 'startup':

Benchmark bm-20241022-pythonperf1-amd64-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241024-pythonperf1-amd64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
python_startup_no_site 18.4 ms 18.9 ms: 1.03x slower
python_startup 24.0 ms 24.8 ms: 1.03x slower
Geometric mean (ref) 1.03x slower

Benchmarks with tag 'template':

Benchmark bm-20241022-pythonperf1-amd64-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241024-pythonperf1-amd64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
django_template 27.3 ms 28.8 ms: 1.06x slower
genshi_xml 45.9 ms 49.5 ms: 1.08x slower
genshi_text 18.9 ms 20.9 ms: 1.11x slower
mako 5.04 ms 5.60 ms: 1.11x slower
Geometric mean (ref) 1.09x slower

All benchmarks:

Benchmark bm-20241022-pythonperf1-amd64-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241024-pythonperf1-amd64-brandtbucher-justin_no_externs-3.14.0a1+-9698931
dulwich_log 40.3 ms 39.4 ms: 1.02x faster
create_gc_cycles 1.42 ms 1.39 ms: 1.02x faster
json_loads 14.7 us 14.4 us: 1.02x faster
thrift 533 us 529 us: 1.01x faster
xml_etree_parse 95.6 ms 95.0 ms: 1.01x faster
mdp 1.60 sec 1.59 sec: 1.00x faster
coverage 49.8 ms 49.6 ms: 1.00x faster
float 46.5 ms 46.8 ms: 1.01x slower
logging_format 6.62 us 6.68 us: 1.01x slower
coroutines 14.0 ms 14.1 ms: 1.01x slower
xml_etree_iterparse 63.1 ms 63.9 ms: 1.01x slower
tornado_http 98.7 ms 100 ms: 1.02x slower
docutils 1.91 sec 1.94 sec: 1.02x slower
async_tree_io_tg 634 ms 646 ms: 1.02x slower
logging_simple 6.18 us 6.30 us: 1.02x slower
regex_v8 14.7 ms 15.0 ms: 1.02x slower
regex_effbot 1.55 ms 1.58 ms: 1.02x slower
generators 23.1 ms 23.7 ms: 1.03x slower
sympy_expand 328 ms 337 ms: 1.03x slower
python_startup_no_site 18.4 ms 18.9 ms: 1.03x slower
async_tree_none 217 ms 224 ms: 1.03x slower
async_tree_io 547 ms 564 ms: 1.03x slower
regex_dna 114 ms 118 ms: 1.03x slower
html5lib 39.2 ms 40.5 ms: 1.03x slower
sympy_str 193 ms 199 ms: 1.03x slower
python_startup 24.0 ms 24.8 ms: 1.03x slower
sympy_sum 103 ms 107 ms: 1.04x slower
json 2.95 ms 3.06 ms: 1.04x slower
unpickle_pure_python 145 us 151 us: 1.04x slower
sphinx 766 ms 798 ms: 1.04x slower
raytrace 211 ms 221 ms: 1.05x slower
2to3 246 ms 258 ms: 1.05x slower
spectral_norm 53.7 ms 56.3 ms: 1.05x slower
deltablue 2.32 ms 2.43 ms: 1.05x slower
sqlglot_parse 895 us 940 us: 1.05x slower
deepcopy_memo 16.8 us 17.6 us: 1.05x slower
django_template 27.3 ms 28.8 ms: 1.06x slower
pycparser 719 ms 758 ms: 1.06x slower
sympy_integrate 15.5 ms 16.5 ms: 1.06x slower
sqlglot_transpile 1.17 ms 1.25 ms: 1.06x slower
sqlglot_optimize 43.1 ms 46.1 ms: 1.07x slower
typing_runtime_protocols 115 us 123 us: 1.07x slower
telco 4.57 ms 4.90 ms: 1.07x slower
nbody 53.4 ms 57.3 ms: 1.07x slower
genshi_xml 45.9 ms 49.5 ms: 1.08x slower
scimark_sparse_mat_mult 2.21 ms 2.38 ms: 1.08x slower
regex_compile 91.3 ms 98.9 ms: 1.08x slower
fannkuch 233 ms 253 ms: 1.08x slower
deepcopy 193 us 210 us: 1.09x slower
scimark_lu 53.8 ms 58.4 ms: 1.09x slower
meteor_contest 75.2 ms 81.9 ms: 1.09x slower
deepcopy_reduce 1.87 us 2.03 us: 1.09x slower
pickle_pure_python 201 us 219 us: 1.09x slower
tomli_loads 1.29 sec 1.41 sec: 1.09x slower
json_dumps 6.13 ms 6.71 ms: 1.09x slower
sqlglot_normalize 209 ms 228 ms: 1.09x slower
xml_etree_generate 50.5 ms 55.8 ms: 1.11x slower
genshi_text 18.9 ms 20.9 ms: 1.11x slower
scimark_fft 158 ms 175 ms: 1.11x slower
mako 5.04 ms 5.60 ms: 1.11x slower
xml_etree_process 36.4 ms 40.7 ms: 1.12x slower
pyflate 285 ms 324 ms: 1.14x slower
go 89.3 ms 102 ms: 1.14x slower
scimark_sor 62.5 ms 71.8 ms: 1.15x slower
richards_super 36.9 ms 42.5 ms: 1.15x slower
comprehensions 11.7 us 13.5 us: 1.15x slower
hexiom 5.13 ms 5.95 ms: 1.16x slower
nqueens 62.7 ms 72.8 ms: 1.16x slower
chaos 41.0 ms 47.8 ms: 1.17x slower
pprint_safe_repr 458 ms 539 ms: 1.18x slower
richards 32.8 ms 38.6 ms: 1.18x slower
pprint_pformat 936 ms 1.10 sec: 1.18x slower
crypto_pyaes 39.7 ms 47.2 ms: 1.19x slower
scimark_monte_carlo 36.4 ms 45.0 ms: 1.24x slower
logging_silent 53.3 ns 69.4 ns: 1.30x slower
Geometric mean (ref) 1.06x slower

Benchmark hidden because not significant (12): gc_traversal, pidigits, pathlib, async_generators, async_tree_memoization_tg, bench_mp_pool, async_tree_none_tg, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, bench_thread_pool, pylint, async_tree_memoization

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.03x
  • 95% likely to have a slowdown of 1.03x
  • 99% likely to have a slowdown of 1.02x

Memory

  • memory change: unknown