Skip to content

Latest commit

 

History

History
188 lines (162 loc) · 24.8 KB

bm-20241025-pythonperf1_win32-x86-brandtbucher-justin_no_externs-3.14.0a1+-64b198a-vs-base.md

File metadata and controls

188 lines (162 loc) · 24.8 KB
Raw

Results vs. base

  • fork: brandtbucher
  • ref: justin_no_externs
  • machine: windows-x86
  • commit hash: 64b198a
  • commit date: 2024-10-25
  • overall geometric mean: 1.03x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.01x slower
  • Memory change: unknown

Benchmarks with tag 'apps':

Benchmark bm-20241022-pythonperf1_win32-x86-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241025-pythonperf1_win32-x86-brandtbucher-justin_no_externs-3.14.0a1+-64b198a
2to3 265 ms 270 ms: 1.02x slower
docutils 2.04 sec 2.08 sec: 1.02x slower
html5lib 46.4 ms 45.9 ms: 1.01x faster
sphinx 846 ms 860 ms: 1.02x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (1): tornado_http

Benchmarks with tag 'asyncio':

Benchmark bm-20241022-pythonperf1_win32-x86-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241025-pythonperf1_win32-x86-brandtbucher-justin_no_externs-3.14.0a1+-64b198a
async_generators 339 ms 332 ms: 1.02x faster
coroutines 17.4 ms 17.3 ms: 1.01x faster
async_tree_io_tg 545 ms 551 ms: 1.01x slower
async_tree_io 516 ms 525 ms: 1.02x slower
async_tree_none_tg 199 ms 203 ms: 1.02x slower
async_tree_memoization 275 ms 281 ms: 1.02x slower
async_tree_none 217 ms 223 ms: 1.03x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (3): async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_memoization_tg

Benchmarks with tag 'math':

Benchmark bm-20241022-pythonperf1_win32-x86-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241025-pythonperf1_win32-x86-brandtbucher-justin_no_externs-3.14.0a1+-64b198a
nbody 67.5 ms 63.0 ms: 1.07x faster
pidigits 204 ms 203 ms: 1.00x faster
float 45.9 ms 49.6 ms: 1.08x slower
Geometric mean (ref) 1.00x slower

Benchmarks with tag 'regex':

Benchmark bm-20241022-pythonperf1_win32-x86-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241025-pythonperf1_win32-x86-brandtbucher-justin_no_externs-3.14.0a1+-64b198a
regex_effbot 1.84 ms 1.77 ms: 1.04x faster
regex_dna 125 ms 120 ms: 1.04x faster
regex_compile 106 ms 110 ms: 1.03x slower
regex_v8 14.8 ms 15.9 ms: 1.07x slower
Geometric mean (ref) 1.01x slower

Benchmarks with tag 'serialize':

Benchmark bm-20241022-pythonperf1_win32-x86-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241025-pythonperf1_win32-x86-brandtbucher-justin_no_externs-3.14.0a1+-64b198a
pickle_pure_python 240 us 245 us: 1.02x slower
json_loads 20.7 us 21.2 us: 1.02x slower
tomli_loads 1.54 sec 1.59 sec: 1.04x slower
xml_etree_iterparse 64.8 ms 67.7 ms: 1.04x slower
xml_etree_generate 55.5 ms 58.2 ms: 1.05x slower
unpickle_pure_python 158 us 169 us: 1.07x slower
xml_etree_process 42.2 ms 45.4 ms: 1.08x slower
Geometric mean (ref) 1.03x slower

Benchmark hidden because not significant (2): json_dumps, xml_etree_parse

Benchmarks with tag 'startup':

Benchmark bm-20241022-pythonperf1_win32-x86-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241025-pythonperf1_win32-x86-brandtbucher-justin_no_externs-3.14.0a1+-64b198a
python_startup 26.4 ms 26.6 ms: 1.01x slower
Geometric mean (ref) 1.00x slower

Benchmark hidden because not significant (1): python_startup_no_site

Benchmarks with tag 'template':

Benchmark bm-20241022-pythonperf1_win32-x86-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241025-pythonperf1_win32-x86-brandtbucher-justin_no_externs-3.14.0a1+-64b198a
django_template 32.0 ms 33.0 ms: 1.03x slower
mako 5.79 ms 6.44 ms: 1.11x slower
Geometric mean (ref) 1.03x slower

Benchmark hidden because not significant (2): genshi_xml, genshi_text

All benchmarks:

Benchmark bm-20241022-pythonperf1_win32-x86-python-34653bba644aa5481613-3.14.0a1+-34653bb bm-20241025-pythonperf1_win32-x86-brandtbucher-justin_no_externs-3.14.0a1+-64b198a
nbody 67.5 ms 63.0 ms: 1.07x faster
regex_effbot 1.84 ms 1.77 ms: 1.04x faster
regex_dna 125 ms 120 ms: 1.04x faster
raytrace 266 ms 256 ms: 1.04x faster
richards 36.8 ms 35.9 ms: 1.03x faster
richards_super 42.0 ms 41.0 ms: 1.02x faster
async_generators 339 ms 332 ms: 1.02x faster
html5lib 46.4 ms 45.9 ms: 1.01x faster
coverage 54.3 ms 53.8 ms: 1.01x faster
thrift 773 us 766 us: 1.01x faster
coroutines 17.4 ms 17.3 ms: 1.01x faster
pidigits 204 ms 203 ms: 1.00x faster
bench_mp_pool 94.0 ms 94.4 ms: 1.00x slower
sqlglot_parse 1.03 ms 1.04 ms: 1.01x slower
meteor_contest 73.0 ms 73.6 ms: 1.01x slower
logging_simple 7.71 us 7.78 us: 1.01x slower
python_startup 26.4 ms 26.6 ms: 1.01x slower
async_tree_io_tg 545 ms 551 ms: 1.01x slower
logging_format 8.34 us 8.45 us: 1.01x slower
typing_runtime_protocols 141 us 143 us: 1.01x slower
sympy_expand 399 ms 406 ms: 1.02x slower
docutils 2.04 sec 2.08 sec: 1.02x slower
sphinx 846 ms 860 ms: 1.02x slower
sympy_sum 117 ms 119 ms: 1.02x slower
sqlglot_transpile 1.34 ms 1.36 ms: 1.02x slower
async_tree_io 516 ms 525 ms: 1.02x slower
2to3 265 ms 270 ms: 1.02x slower
pickle_pure_python 240 us 245 us: 1.02x slower
dulwich_log 49.2 ms 50.2 ms: 1.02x slower
pycparser 829 ms 845 ms: 1.02x slower
async_tree_none_tg 199 ms 203 ms: 1.02x slower
sympy_str 231 ms 236 ms: 1.02x slower
async_tree_memoization 275 ms 281 ms: 1.02x slower
json_loads 20.7 us 21.2 us: 1.02x slower
sqlglot_optimize 49.6 ms 50.8 ms: 1.02x slower
deepcopy_reduce 2.47 us 2.53 us: 1.03x slower
async_tree_none 217 ms 223 ms: 1.03x slower
django_template 32.0 ms 33.0 ms: 1.03x slower
deepcopy 238 us 245 us: 1.03x slower
sympy_integrate 17.4 ms 18.0 ms: 1.03x slower
sqlglot_normalize 102 ms 105 ms: 1.03x slower
regex_compile 106 ms 110 ms: 1.03x slower
mdp 1.70 sec 1.76 sec: 1.04x slower
tomli_loads 1.54 sec 1.59 sec: 1.04x slower
pyflate 319 ms 330 ms: 1.04x slower
telco 5.78 ms 6.01 ms: 1.04x slower
pprint_pformat 1.18 sec 1.23 sec: 1.04x slower
go 96.4 ms 101 ms: 1.04x slower
generators 24.5 ms 25.5 ms: 1.04x slower
pprint_safe_repr 578 ms 603 ms: 1.04x slower
xml_etree_iterparse 64.8 ms 67.7 ms: 1.04x slower
xml_etree_generate 55.5 ms 58.2 ms: 1.05x slower
comprehensions 13.4 us 14.2 us: 1.06x slower
unpickle_pure_python 158 us 169 us: 1.07x slower
regex_v8 14.8 ms 15.9 ms: 1.07x slower
scimark_sparse_mat_mult 2.46 ms 2.65 ms: 1.07x slower
fannkuch 238 ms 256 ms: 1.07x slower
xml_etree_process 42.2 ms 45.4 ms: 1.08x slower
crypto_pyaes 50.2 ms 54.0 ms: 1.08x slower
hexiom 5.50 ms 5.94 ms: 1.08x slower
float 45.9 ms 49.6 ms: 1.08x slower
nqueens 77.2 ms 83.7 ms: 1.08x slower
scimark_lu 60.1 ms 65.2 ms: 1.08x slower
deltablue 2.51 ms 2.73 ms: 1.09x slower
scimark_fft 177 ms 195 ms: 1.10x slower
deepcopy_memo 16.4 us 18.0 us: 1.10x slower
mako 5.79 ms 6.44 ms: 1.11x slower
scimark_sor 67.8 ms 76.9 ms: 1.13x slower
spectral_norm 58.1 ms 67.5 ms: 1.16x slower
scimark_monte_carlo 39.5 ms 47.7 ms: 1.21x slower
logging_silent 53.7 ns 64.9 ns: 1.21x slower
Geometric mean (ref) 1.03x slower

Benchmark hidden because not significant (16): create_gc_cycles, pathlib, chaos, json_dumps, genshi_xml, python_startup_no_site, gc_traversal, xml_etree_parse, genshi_text, async_tree_cpu_io_mixed, tornado_http, async_tree_cpu_io_mixed_tg, json, async_tree_memoization_tg, pylint, bench_thread_pool

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.01x
  • 95% likely to have a slowdown of 1.01x
  • 99% likely to have a slowdown of 1.01x

Memory

  • memory change: unknown