Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: 🤖 Apply BestieTemplate v0.7.2 #163

Merged
merged 8 commits into from
Jul 7, 2024
Merged

Conversation

abelsiqueira
Copy link
Member

Applied the template and made some manual changes, such as changing the
docs names, fixing the README and removing some older workflows.

Closes: #143

Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmarks:
    • Target: 31 May 2024 - 15:29
    • Baseline: 31 May 2024 - 15:30
  • Package commits:
    • Target: fc75d8
    • Baseline: 9c4eda
  • Julia commits:
    • Target: 0b4590
    • Baseline: 0b4590
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Target

Julia Version 1.10.3
Commit 0b4590a5507 (2024-04-30 10:59 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3233 MHz       1519 s          0 s        125 s       2342 s          0 s
       #2  2957 MHz       1905 s          0 s        136 s       1947 s          0 s
       #3  3242 MHz       1731 s          0 s        133 s       2114 s          0 s
       #4  2445 MHz       1457 s          0 s        131 s       2394 s          0 s
  Memory: 15.606502532958984 GB (13948.73828125 MB free)
  Uptime: 401.36 sec
  Load Avg:  2.34  1.82  0.85
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.3
Commit 0b4590a5507 (2024-04-30 10:59 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3243 MHz       1721 s          0 s        134 s       2616 s          0 s
       #2  2939 MHz       2054 s          0 s        144 s       2276 s          0 s
       #3  2792 MHz       1860 s          0 s        142 s       2462 s          0 s
       #4  3219 MHz       1470 s          0 s        138 s       2859 s          0 s
  Memory: 15.606502532958984 GB (13886.16015625 MB free)
  Uptime: 450.01 sec
  Load Avg:  1.69  1.72  0.86
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 31 May 2024 - 15:29
  • Package commit: fc75d8
  • Julia commit: 0b4590
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 37.620 μs (5%) 17.65 KiB (1%) 422
["solvers", "Percival"] 63.248 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 214.401 μs (5%) 90.98 KiB (1%) 5489
["solvers", "TRON"] 60.714 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 33.923 μs (5%) 27.95 KiB (1%) 277

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.3
Commit 0b4590a5507 (2024-04-30 10:59 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3233 MHz       1519 s          0 s        125 s       2342 s          0 s
       #2  2957 MHz       1905 s          0 s        136 s       1947 s          0 s
       #3  3242 MHz       1731 s          0 s        133 s       2114 s          0 s
       #4  2445 MHz       1457 s          0 s        131 s       2394 s          0 s
  Memory: 15.606502532958984 GB (13948.73828125 MB free)
  Uptime: 401.36 sec
  Load Avg:  2.34  1.82  0.85
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 31 May 2024 - 15:30
  • Package commit: 9c4eda
  • Julia commit: 0b4590
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 37.190 μs (5%) 17.65 KiB (1%) 422
["solvers", "Percival"] 63.279 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 208.941 μs (5%) 90.98 KiB (1%) 5489
["solvers", "TRON"] 59.732 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 33.572 μs (5%) 27.95 KiB (1%) 277

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.3
Commit 0b4590a5507 (2024-04-30 10:59 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3243 MHz       1721 s          0 s        134 s       2616 s          0 s
       #2  2939 MHz       2054 s          0 s        144 s       2276 s          0 s
       #3  2792 MHz       1860 s          0 s        142 s       2462 s          0 s
       #4  3219 MHz       1470 s          0 s        138 s       2859 s          0 s
  Memory: 15.606502532958984 GB (13886.16015625 MB free)
  Uptime: 450.01 sec
  Load Avg:  1.69  1.72  0.86
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.85
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@abelsiqueira
Copy link
Member Author

I suggest dropping Cirrus CI @tmigot, what do you think?

Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmarks:
    • Target: 31 May 2024 - 19:35
    • Baseline: 31 May 2024 - 19:35
  • Package commits:
    • Target: f0dd6b
    • Baseline: 9c4eda
  • Julia commits:
    • Target: 0b4590
    • Baseline: 0b4590
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["solvers", "R2"] 0.95 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Target

Julia Version 1.10.3
Commit 0b4590a5507 (2024-04-30 10:59 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3243 MHz       1668 s          0 s        135 s       2763 s          0 s
       #2  3242 MHz       1800 s          0 s        134 s       2630 s          0 s
       #3  2843 MHz       1448 s          0 s        136 s       2968 s          0 s
       #4  2895 MHz       1653 s          0 s        128 s       2786 s          0 s
  Memory: 15.606498718261719 GB (13951.9296875 MB free)
  Uptime: 458.97 sec
  Load Avg:  1.72  1.57  0.73
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.3
Commit 0b4590a5507 (2024-04-30 10:59 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3242 MHz       1693 s          0 s        142 s       3210 s          0 s
       #2  3243 MHz       1881 s          0 s        142 s       3020 s          0 s
       #3  2590 MHz       1476 s          0 s        142 s       3412 s          0 s
       #4  2445 MHz       2005 s          0 s        137 s       2905 s          0 s
  Memory: 15.606498718261719 GB (13880.83984375 MB free)
  Uptime: 506.99 sec
  Load Avg:  1.47  1.51  0.75
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 31 May 2024 - 19:35
  • Package commit: f0dd6b
  • Julia commit: 0b4590
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 37.880 μs (5%) 17.65 KiB (1%) 422
["solvers", "Percival"] 63.699 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 207.488 μs (5%) 90.98 KiB (1%) 5489
["solvers", "TRON"] 59.601 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 33.483 μs (5%) 27.95 KiB (1%) 277

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.3
Commit 0b4590a5507 (2024-04-30 10:59 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3243 MHz       1668 s          0 s        135 s       2763 s          0 s
       #2  3242 MHz       1800 s          0 s        134 s       2630 s          0 s
       #3  2843 MHz       1448 s          0 s        136 s       2968 s          0 s
       #4  2895 MHz       1653 s          0 s        128 s       2786 s          0 s
  Memory: 15.606498718261719 GB (13951.9296875 MB free)
  Uptime: 458.97 sec
  Load Avg:  1.72  1.57  0.73
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 31 May 2024 - 19:35
  • Package commit: 9c4eda
  • Julia commit: 0b4590
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 37.450 μs (5%) 17.65 KiB (1%) 422
["solvers", "Percival"] 63.649 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 218.549 μs (5%) 90.98 KiB (1%) 5489
["solvers", "TRON"] 59.081 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 33.062 μs (5%) 27.95 KiB (1%) 277

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.3
Commit 0b4590a5507 (2024-04-30 10:59 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3242 MHz       1693 s          0 s        142 s       3210 s          0 s
       #2  3243 MHz       1881 s          0 s        142 s       3020 s          0 s
       #3  2590 MHz       1476 s          0 s        142 s       3412 s          0 s
       #4  2445 MHz       2005 s          0 s        137 s       2905 s          0 s
  Memory: 15.606498718261719 GB (13880.83984375 MB free)
  Uptime: 506.99 sec
  Load Avg:  1.47  1.51  0.75
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.86
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@tmigot
Copy link
Member

tmigot commented Jun 1, 2024

I suggest dropping Cirrus CI @tmigot, what do you think?

I personally agree. What do you think @amontoison ?

@amontoison
Copy link
Member

amontoison commented Jun 1, 2024

@tmigot I opened #166 to fix CirrusCI. Can you rebase this branch?

@abelsiqueira
Copy link
Member Author

Thanks, @amontoison. I still think we should delete Cirrus CI testing from this package. I don't think the main use case of this package requires testing on FreeBSD or a specific Mac that GH doesn't already provide. This is essentially an interface, so the underlying packages should be more thoroughly tested, but this doesn't need to.
@tmigot, let me know if you still agree, I'll open an issue then. I will rebase this.

@amontoison
Copy link
Member

The issue was that MacOS silicon was not supported by GHA until a very recent update.

I think that Cirrus is relevant for packages that depend on Artifact (JLL packages) but we can remove it otherwise.

Copy link
Contributor

github-actions bot commented Jun 1, 2024

Benchmark result

Judge result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmarks:
    • Target: 1 Jun 2024 - 18:47
    • Baseline: 1 Jun 2024 - 18:48
  • Package commits:
    • Target: bbd1bb
    • Baseline: b8d062
  • Julia commits:
    • Target: 0b4590
    • Baseline: 0b4590
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Target

Julia Version 1.10.3
Commit 0b4590a5507 (2024-04-30 10:59 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2670 MHz       1545 s          0 s        132 s       2723 s          0 s
       #2  3244 MHz       1524 s          0 s        136 s       2736 s          0 s
       #3  2445 MHz       1693 s          0 s        144 s       2555 s          0 s
       #4  2580 MHz       1859 s          0 s        120 s       2426 s          0 s
  Memory: 15.606502532958984 GB (13944.10546875 MB free)
  Uptime: 443.2 sec
  Load Avg:  1.83  1.75  0.83
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.3
Commit 0b4590a5507 (2024-04-30 10:59 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3233 MHz       1552 s          0 s        139 s       3184 s          0 s
       #2  3243 MHz       1587 s          0 s        146 s       3138 s          0 s
       #3  2445 MHz       1903 s          0 s        151 s       2814 s          0 s
       #4  2930 MHz       2062 s          0 s        128 s       2692 s          0 s
  Memory: 15.606502532958984 GB (13895.16796875 MB free)
  Uptime: 490.85 sec
  Load Avg:  1.36  1.63  0.84
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 1 Jun 2024 - 18:47
  • Package commit: bbd1bb
  • Julia commit: 0b4590
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 37.100 μs (5%) 17.65 KiB (1%) 422
["solvers", "Percival"] 62.858 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 212.121 μs (5%) 90.98 KiB (1%) 5489
["solvers", "TRON"] 59.903 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 33.453 μs (5%) 27.95 KiB (1%) 277

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.3
Commit 0b4590a5507 (2024-04-30 10:59 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2670 MHz       1545 s          0 s        132 s       2723 s          0 s
       #2  3244 MHz       1524 s          0 s        136 s       2736 s          0 s
       #3  2445 MHz       1693 s          0 s        144 s       2555 s          0 s
       #4  2580 MHz       1859 s          0 s        120 s       2426 s          0 s
  Memory: 15.606502532958984 GB (13944.10546875 MB free)
  Uptime: 443.2 sec
  Load Avg:  1.83  1.75  0.83
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 1 Jun 2024 - 18:48
  • Package commit: b8d062
  • Julia commit: 0b4590
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 36.970 μs (5%) 17.65 KiB (1%) 422
["solvers", "Percival"] 63.911 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 216.649 μs (5%) 90.98 KiB (1%) 5489
["solvers", "TRON"] 59.673 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 33.453 μs (5%) 27.95 KiB (1%) 277

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.3
Commit 0b4590a5507 (2024-04-30 10:59 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3233 MHz       1552 s          0 s        139 s       3184 s          0 s
       #2  3243 MHz       1587 s          0 s        146 s       3138 s          0 s
       #3  2445 MHz       1903 s          0 s        151 s       2814 s          0 s
       #4  2930 MHz       2062 s          0 s        128 s       2692 s          0 s
  Memory: 15.606502532958984 GB (13895.16796875 MB free)
  Uptime: 490.85 sec
  Load Avg:  1.36  1.63  0.84
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.86
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@tmigot
Copy link
Member

tmigot commented Jun 6, 2024

The issue was that MacOS silicon was not supported by GHA until a very recent update.

I think that Cirrus is relevant for packages that depend on Artifact (JLL packages) but we can remove it otherwise.

Thanks! So, still good to me to remove cirrus for this package.

@amontoison
Copy link
Member

The issue was that MacOS silicon was not supported by GHA until a very recent update.
I think that Cirrus is relevant for packages that depend on Artifact (JLL packages) but we can remove it otherwise.

Thanks! So, still good to me to remove cirrus for this package.

Yes, we just need to update GHA to test on two architectures (x64 and aarch64). macos-13 is the last release of Mac that supports this architecture. macos-lastest is only working on aarch64 now.

@abelsiqueira abelsiqueira changed the title chore: 🤖 Apply COPIERTemplate v0.4.0 chore: 🤖 Apply COPIERTemplate v0.5.3 Jun 10, 2024
@abelsiqueira abelsiqueira force-pushed the 143-copiertemplate branch 2 times, most recently from a262f90 to 1fb0288 Compare June 10, 2024 16:47
Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmarks:
    • Target: 10 Jun 2024 - 16:52
    • Baseline: 10 Jun 2024 - 16:53
  • Package commits:
    • Target: 86e131
    • Baseline: d61de9
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["solvers", "LBFGS"] 0.91 (5%) ✅ 1.00 (1%)
["solvers", "Percival"] 1.13 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3190 MHz       1586 s          0 s        135 s       2986 s          0 s
       #2  2445 MHz       1932 s          0 s        126 s       2641 s          0 s
       #3  3244 MHz       1555 s          0 s        153 s       2991 s          0 s
       #4  3222 MHz       1723 s          0 s        144 s       2830 s          0 s
  Memory: 15.606502532958984 GB (13733.28125 MB free)
  Uptime: 473.6 sec
  Load Avg:  1.91  1.7  0.82
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       1633 s          0 s        142 s       3435 s          0 s
       #2  2445 MHz       1963 s          0 s        131 s       3109 s          0 s
       #3  3243 MHz       1807 s          0 s        168 s       3227 s          0 s
       #4  3237 MHz       1897 s          0 s        155 s       3149 s          0 s
  Memory: 15.606502532958984 GB (13746.5234375 MB free)
  Uptime: 524.05 sec
  Load Avg:  1.39  1.59  0.83
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 10 Jun 2024 - 16:52
  • Package commit: 86e131
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 37.179 μs (5%) 17.65 KiB (1%) 422
["solvers", "Percival"] 69.279 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 208.188 μs (5%) 90.98 KiB (1%) 5489
["solvers", "TRON"] 60.493 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 34.354 μs (5%) 27.95 KiB (1%) 277

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3190 MHz       1586 s          0 s        135 s       2986 s          0 s
       #2  2445 MHz       1932 s          0 s        126 s       2641 s          0 s
       #3  3244 MHz       1555 s          0 s        153 s       2991 s          0 s
       #4  3222 MHz       1723 s          0 s        144 s       2830 s          0 s
  Memory: 15.606502532958984 GB (13733.28125 MB free)
  Uptime: 473.6 sec
  Load Avg:  1.91  1.7  0.82
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 10 Jun 2024 - 16:53
  • Package commit: d61de9
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 41.007 μs (5%) 17.65 KiB (1%) 422
["solvers", "Percival"] 61.405 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 215.201 μs (5%) 90.98 KiB (1%) 5489
["solvers", "TRON"] 60.513 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 33.553 μs (5%) 27.95 KiB (1%) 277

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       1633 s          0 s        142 s       3435 s          0 s
       #2  2445 MHz       1963 s          0 s        131 s       3109 s          0 s
       #3  3243 MHz       1807 s          0 s        168 s       3227 s          0 s
       #4  3237 MHz       1897 s          0 s        155 s       3149 s          0 s
  Memory: 15.606502532958984 GB (13746.5234375 MB free)
  Uptime: 524.05 sec
  Load Avg:  1.39  1.59  0.83
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.85
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@abelsiqueira
Copy link
Member Author

I've updated the PR with the latest version of the template. I've removed CirrusCI. If we apply the template to other packages in JSO that use CirrusCI, we can update the template with the latest file.

As for the extra tests, I also don't see the benefit of adding them now, in this package.

The Lint failures are due to broken links. After merging, most or all should be fixed.

@dpo
Copy link
Member

dpo commented Jun 11, 2024

I've removed CirrusCI.

Why?

@abelsiqueira
Copy link
Member Author

Thanks, @amontoison. I still think we should delete Cirrus CI testing from this package. I don't think the main use case of this package requires testing on FreeBSD or a specific Mac that GH doesn't already provide. This is essentially an interface, so the underlying packages should be more thoroughly tested, but this doesn't need to. @tmigot, let me know if you still agree, I'll open an issue then. I will rebase this.

@dpo, ☝️

@dpo
Copy link
Member

dpo commented Jun 11, 2024

The issue was that MacOS silicon was not supported by GHA until a very recent update.

I think that Cirrus is relevant for packages that depend on Artifact (JLL packages) but we can remove it otherwise.

With that logic, there's no need to test on Windows or macOS either. I disagree. Do the FreeBSD tests not pass? The more platforms we cover, the more robust our code.

@abelsiqueira
Copy link
Member Author

I think the cost-benefit of adding FreeBSD is not good enough, but it is for Mac and Windows. That being said, if it makes it easier to adopt COPIERTemplate, I'm glad to reintroduce it. The file in the template is the following: https://github.com/abelsiqueira/COPIERTemplate.jl/blob/main/template/%7B%25%20if%20UseCirrusCI%20%25%7D.cirrus.yml%7B%25%20endif%20%25%7D.jinja
I've added the file there because JSO uses Cirrus CI, so can you update that file to something that makes sense for JSO?
I can also remove from there so it is used directly here.

My arguments for not having FreeBSD in this package are:

  • 1% of Julia Users are on FreeBSD, and who knows how many of those will be using JSOSuite.
  • Most likely we'll pick those errors on earlier packages, and if we do find an error with FreeBSD that no other package upstream had, then we can't properly test it.
  • it is a separate build script to maintain.
  • the building hours are shared among all JSO packages, so this is just wasting those.

@abelsiqueira
Copy link
Member Author

@dpo @tmigot can we have a conclusion on this?

@dpo
Copy link
Member

dpo commented Jun 16, 2024

I just find it arbitrary to remove Cirrus from here while we use it everywhere else. I've found issues with code before because errors were triggered on a Cirrus VM. If we can cover another OS, why not? Predicting the effects of a change in one of the dependent packages is very hard, so the more coverage, the better, in my opinion.

@abelsiqueira
Copy link
Member Author

@dpo can you fit in your schedule maintaining the template's Cirrus file?

@dpo
Copy link
Member

dpo commented Jun 16, 2024

Sure. there's really nothing to it.

@abelsiqueira
Copy link
Member Author

Great, I'll update this then

Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmarks:
    • Target: 16 Jun 2024 - 14:53
    • Baseline: 16 Jun 2024 - 14:54
  • Package commits:
    • Target: d2bdb9
    • Baseline: 836590
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["solvers", "Percival"] 1.06 (5%) ❌ 1.00 (1%)
["solvers", "TRUNK"] 1.09 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2742 MHz       1452 s          0 s        122 s       2309 s          0 s
       #2  2445 MHz       1486 s          0 s        129 s       2272 s          0 s
       #3  3242 MHz       2115 s          0 s        148 s       1629 s          0 s
       #4  2445 MHz       1660 s          0 s        126 s       2104 s          0 s
  Memory: 15.606502532958984 GB (13744.6953125 MB free)
  Uptime: 391.47 sec
  Load Avg:  1.98  1.67  0.77
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3242 MHz       1572 s          0 s        132 s       2706 s          0 s
       #2  3263 MHz       1497 s          0 s        138 s       2778 s          0 s
       #3  2594 MHz       2274 s          0 s        157 s       1987 s          0 s
       #4  2445 MHz       1899 s          0 s        137 s       2381 s          0 s
  Memory: 15.606502532958984 GB (13754.58984375 MB free)
  Uptime: 444.29 sec
  Load Avg:  1.42  1.57  0.78
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 16 Jun 2024 - 14:53
  • Package commit: d2bdb9
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 48.100 μs (5%) 22.15 KiB (1%) 584
["solvers", "Percival"] 65.863 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 494.462 μs (5%) 234.58 KiB (1%) 10848
["solvers", "TRON"] 59.751 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 40.536 μs (5%) 30.39 KiB (1%) 367

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2742 MHz       1452 s          0 s        122 s       2309 s          0 s
       #2  2445 MHz       1486 s          0 s        129 s       2272 s          0 s
       #3  3242 MHz       2115 s          0 s        148 s       1629 s          0 s
       #4  2445 MHz       1660 s          0 s        126 s       2104 s          0 s
  Memory: 15.606502532958984 GB (13744.6953125 MB free)
  Uptime: 391.47 sec
  Load Avg:  1.98  1.67  0.77
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 16 Jun 2024 - 14:54
  • Package commit: 836590
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 48.401 μs (5%) 22.15 KiB (1%) 584
["solvers", "Percival"] 62.156 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 479.474 μs (5%) 234.58 KiB (1%) 10848
["solvers", "TRON"] 60.322 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 37.259 μs (5%) 30.39 KiB (1%) 367

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3242 MHz       1572 s          0 s        132 s       2706 s          0 s
       #2  3263 MHz       1497 s          0 s        138 s       2778 s          0 s
       #3  2594 MHz       2274 s          0 s        157 s       1987 s          0 s
       #4  2445 MHz       1899 s          0 s        137 s       2381 s          0 s
  Memory: 15.606502532958984 GB (13754.58984375 MB free)
  Uptime: 444.29 sec
  Load Avg:  1.42  1.57  0.78
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.85
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

Copy link
Member

@tmigot tmigot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @abelsiqueira ! Sorry for the delay, but this is a massive PR^^. Are the modification to the code generated or some of them manually modified?
Feel free to let me know if you prefer that I open issues directly to COPIERTemplate

Please, before submitting, make sure that:

- There is not an [existing issue](https://github.com/JuliaSmoothOptimizers/JSOSuite.jl/issues) with the same question
- You have read the [contributing guide](https://github.com/JuliaSmoothOptimizers/JSOSuite.jl/blob/main/docs/src/90-contributing.md/)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should the link point to the documentation in the end?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will update the template.

- You have read the [contributing guide](https://github.com/JuliaSmoothOptimizers/JSOSuite.jl/blob/main/docs/src/90-contributing.md/)
- You are following the [code of conduct](https://github.com/JuliaSmoothOptimizers/JSOSuite.jl/blob/main/CODE_OF_CONDUCT.md)

The form below should help you in filling out this issue.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should more directly ask for a Minimal reproducible example. From what I've seen 75% of the first comment from a question is "Do you have a MWE?"

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will update the template. There is a question for reproduction steps, I will add more info there.

.github/ISSUE_TEMPLATE/20-feature-request.yml Show resolved Hide resolved
- type: markdown
attributes:
value: |
Thanks for taking the time to fill out this bug report!
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Thanks for taking the time to fill out this bug report!
Thanks for taking the time to fill out this feature request report!

- You have read the [contributing guide](https://github.com/JuliaSmoothOptimizers/JSOSuite.jl/blob/main/docs/src/90-contributing.md/)
- You are following the [code of conduct](https://github.com/JuliaSmoothOptimizers/JSOSuite.jl/blob/main/CODE_OF_CONDUCT.md)

The form below should help you in filling out this issue.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We could also suggest to explain ways to test the new request?

- [ ] Tests are passing
- [ ] Lint workflow is passing
- [ ] Docs were updated and workflow is passing
<!-- - [ ] [CHANGELOG.md](https://github.com/JuliaSmoothOptimizers/JSOSuite.jl/blob/main/CHANGELOG.md) was updated -->
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

remove?

.github/dependabot.yml Show resolved Hide resolved
[release-url]: https://github.com/JuliaSmoothOptimizers/JSOSuite.jl/releases

One stop solutions for all things optimization.
# JSOSuite
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is probably worth adding somewhere adding that we use the COPIERTemplate in case somebody tries to update CI and stuff. what do you think?

README.md Show resolved Hide resolved
docs/src/index.md Show resolved Hide resolved
Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmarks:
    • Target: 21 Jun 2024 - 16:24
    • Baseline: 21 Jun 2024 - 16:24
  • Package commits:
    • Target: fb77fc
    • Baseline: 836590
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["solvers", "Percival"] 0.95 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       1611 s          0 s        126 s       2647 s          0 s
       #2  2445 MHz       1587 s          0 s        143 s       2670 s          0 s
       #3  3217 MHz       1911 s          0 s        132 s       2340 s          0 s
       #4  3243 MHz       1785 s          0 s        131 s       2474 s          0 s
  Memory: 15.606491088867188 GB (13698.12109375 MB free)
  Uptime: 442.12 sec
  Load Avg:  1.89  1.81  0.87
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3243 MHz       1640 s          0 s        134 s       3141 s          0 s
       #2  3280 MHz       1604 s          0 s        151 s       3176 s          0 s
       #3  2445 MHz       2086 s          0 s        140 s       2691 s          0 s
       #4  2445 MHz       2097 s          0 s        146 s       2680 s          0 s
  Memory: 15.606491088867188 GB (13669.51953125 MB free)
  Uptime: 495.52 sec
  Load Avg:  1.42  1.7  0.88
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 21 Jun 2024 - 16:24
  • Package commit: fb77fc
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 47.589 μs (5%) 22.15 KiB (1%) 584
["solvers", "Percival"] 61.945 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 485.474 μs (5%) 234.58 KiB (1%) 10848
["solvers", "TRON"] 60.443 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 40.215 μs (5%) 30.39 KiB (1%) 367

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       1611 s          0 s        126 s       2647 s          0 s
       #2  2445 MHz       1587 s          0 s        143 s       2670 s          0 s
       #3  3217 MHz       1911 s          0 s        132 s       2340 s          0 s
       #4  3243 MHz       1785 s          0 s        131 s       2474 s          0 s
  Memory: 15.606491088867188 GB (13698.12109375 MB free)
  Uptime: 442.12 sec
  Load Avg:  1.89  1.81  0.87
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 21 Jun 2024 - 16:24
  • Package commit: 836590
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 46.858 μs (5%) 22.15 KiB (1%) 584
["solvers", "Percival"] 65.522 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 490.078 μs (5%) 234.58 KiB (1%) 10848
["solvers", "TRON"] 60.213 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 38.722 μs (5%) 30.39 KiB (1%) 367

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3243 MHz       1640 s          0 s        134 s       3141 s          0 s
       #2  3280 MHz       1604 s          0 s        151 s       3176 s          0 s
       #3  2445 MHz       2086 s          0 s        140 s       2691 s          0 s
       #4  2445 MHz       2097 s          0 s        146 s       2680 s          0 s
  Memory: 15.606491088867188 GB (13669.51953125 MB free)
  Uptime: 495.52 sec
  Load Avg:  1.42  1.7  0.88
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.87
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmarks:
    • Target: 28 Jun 2024 - 14:11
    • Baseline: 28 Jun 2024 - 14:12
  • Package commits:
    • Target: 11d876
    • Baseline: 5a32e9
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       1637 s          0 s        119 s       1924 s          0 s
       #2  2445 MHz       2087 s          0 s        130 s       1463 s          0 s
       #3  3216 MHz       1719 s          0 s        144 s       1807 s          0 s
       #4  3242 MHz       1395 s          0 s        137 s       2138 s          0 s
  Memory: 15.606487274169922 GB (13731.2578125 MB free)
  Uptime: 370.66 sec
  Load Avg:  1.92  1.75  0.82
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       1872 s          0 s        132 s       2203 s          0 s
       #2  2564 MHz       2310 s          0 s        140 s       1756 s          0 s
       #3  2445 MHz       1738 s          0 s        156 s       2302 s          0 s
       #4  3242 MHz       1446 s          0 s        144 s       2607 s          0 s
  Memory: 15.606487274169922 GB (13786.9453125 MB free)
  Uptime: 423.36 sec
  Load Avg:  1.37  1.62  0.83
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 28 Jun 2024 - 14:11
  • Package commit: 11d876
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 48.421 μs (5%) 22.15 KiB (1%) 584
["solvers", "Percival"] 63.059 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 494.224 μs (5%) 234.58 KiB (1%) 10848
["solvers", "TRON"] 60.584 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 40.216 μs (5%) 30.39 KiB (1%) 367

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       1637 s          0 s        119 s       1924 s          0 s
       #2  2445 MHz       2087 s          0 s        130 s       1463 s          0 s
       #3  3216 MHz       1719 s          0 s        144 s       1807 s          0 s
       #4  3242 MHz       1395 s          0 s        137 s       2138 s          0 s
  Memory: 15.606487274169922 GB (13731.2578125 MB free)
  Uptime: 370.66 sec
  Load Avg:  1.92  1.75  0.82
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 28 Jun 2024 - 14:12
  • Package commit: 5a32e9
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 46.678 μs (5%) 22.15 KiB (1%) 584
["solvers", "Percival"] 63.560 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 490.556 μs (5%) 234.58 KiB (1%) 10848
["solvers", "TRON"] 60.885 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 39.665 μs (5%) 30.39 KiB (1%) 367

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       1872 s          0 s        132 s       2203 s          0 s
       #2  2564 MHz       2310 s          0 s        140 s       1756 s          0 s
       #3  2445 MHz       1738 s          0 s        156 s       2302 s          0 s
       #4  3242 MHz       1446 s          0 s        144 s       2607 s          0 s
  Memory: 15.606487274169922 GB (13786.9453125 MB free)
  Uptime: 423.36 sec
  Load Avg:  1.37  1.62  0.83
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.87
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@abelsiqueira abelsiqueira changed the title chore: 🤖 Apply COPIERTemplate v0.5.3 chore: 🤖 Apply BestieTemplate v0.7.1 Jul 3, 2024
@abelsiqueira
Copy link
Member Author

I've updated to BestieTemplate (it has been renamed) version 0.7.1.
The Cirrus CI is failing right now, so I don't know how you want to proceed @dpo

Copy link
Contributor

github-actions bot commented Jul 3, 2024

Benchmark result

Judge result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmarks:
    • Target: 3 Jul 2024 - 18:17
    • Baseline: 3 Jul 2024 - 18:18
  • Package commits:
    • Target: ddf030
    • Baseline: 88535e
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3243 MHz       1592 s          0 s        121 s       2606 s          0 s
       #2  3262 MHz       1912 s          0 s        128 s       2287 s          0 s
       #3  2606 MHz       1633 s          0 s        146 s       2545 s          0 s
       #4  2445 MHz       1495 s          0 s        137 s       2682 s          0 s
  Memory: 15.606491088867188 GB (13748.4453125 MB free)
  Uptime: 434.67 sec
  Load Avg:  1.54  1.56  0.73
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3241 MHz       1650 s          0 s        131 s       3060 s          0 s
       #2  2445 MHz       1926 s          0 s        136 s       2787 s          0 s
       #3  3050 MHz       1698 s          0 s        153 s       2995 s          0 s
       #4  2445 MHz       1883 s          0 s        152 s       2800 s          0 s
  Memory: 15.606491088867188 GB (13744.9765625 MB free)
  Uptime: 486.93 sec
  Load Avg:  1.3  1.48  0.75
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 3 Jul 2024 - 18:17
  • Package commit: ddf030
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 47.429 μs (5%) 22.15 KiB (1%) 584
["solvers", "Percival"] 62.968 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 493.719 μs (5%) 234.58 KiB (1%) 10848
["solvers", "TRON"] 61.115 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 40.046 μs (5%) 30.39 KiB (1%) 367

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3243 MHz       1592 s          0 s        121 s       2606 s          0 s
       #2  3262 MHz       1912 s          0 s        128 s       2287 s          0 s
       #3  2606 MHz       1633 s          0 s        146 s       2545 s          0 s
       #4  2445 MHz       1495 s          0 s        137 s       2682 s          0 s
  Memory: 15.606491088867188 GB (13748.4453125 MB free)
  Uptime: 434.67 sec
  Load Avg:  1.54  1.56  0.73
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 3 Jul 2024 - 18:18
  • Package commit: 88535e
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 47.740 μs (5%) 22.15 KiB (1%) 584
["solvers", "Percival"] 61.626 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 494.120 μs (5%) 234.58 KiB (1%) 10848
["solvers", "TRON"] 60.103 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 39.004 μs (5%) 30.39 KiB (1%) 367

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3241 MHz       1650 s          0 s        131 s       3060 s          0 s
       #2  2445 MHz       1926 s          0 s        136 s       2787 s          0 s
       #3  3050 MHz       1698 s          0 s        153 s       2995 s          0 s
       #4  2445 MHz       1883 s          0 s        152 s       2800 s          0 s
  Memory: 15.606491088867188 GB (13744.9765625 MB free)
  Uptime: 486.93 sec
  Load Avg:  1.3  1.48  0.75
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.85
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@amontoison
Copy link
Member

CirrusCI changed the rules recently and we only have a (very) limited number of credits now.
We should drop it after this update

@abelsiqueira
Copy link
Member Author

If we're dropping it, it should be here so we can squash merge this, and because it is one of the question of the template and if we drop it we simplify the application more.

@abelsiqueira
Copy link
Member Author

@amontoison can you explain more on the changes or the limitation? @dpo had arguments to maintain, but if the limitation is too severe I imagine it might affect using Cirrus CI on other packages as well.
Here's the original message:

I just find it arbitrary to remove Cirrus from here while we use it everywhere else. I've found issues with code before because errors were triggered on a Cirrus VM. If we can cover another OS, why not? Predicting the effects of a change in one of the dependent packages is very hard, so the more coverage, the better, in my opinion.

Copy link
Member

@tmigot tmigot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @abelsiqueira ! It looks good to me overall. I think it is a good place to have some experience on BestieTemplate.jl + it is quite easy to update with the template.

I would say just two things before merge:

  • fix the DOI (see my comment)
  • clarify cirrus

Thanks!!

README.md Outdated Show resolved Hide resolved
Co-authored-by: Tangi Migot <[email protected]>
Copy link
Contributor

github-actions bot commented Jul 7, 2024

Benchmark result

Judge result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmarks:
    • Target: 7 Jul 2024 - 12:18
    • Baseline: 7 Jul 2024 - 12:19
  • Package commits:
    • Target: 896f94
    • Baseline: 88535e
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       1946 s          0 s        132 s       2296 s          0 s
       #2  2445 MHz       1747 s          0 s        110 s       2487 s          0 s
       #3  3242 MHz       1677 s          0 s        144 s       2474 s          0 s
       #4  3252 MHz       1356 s          0 s        152 s       2774 s          0 s
  Memory: 15.606487274169922 GB (13744.83203125 MB free)
  Uptime: 450.92 sec
  Load Avg:  1.65  1.82  0.91
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3267 MHz       2079 s          0 s        143 s       2671 s          0 s
       #2  3243 MHz       2021 s          0 s        124 s       2719 s          0 s
       #3  2445 MHz       1728 s          0 s        153 s       2932 s          0 s
       #4  2607 MHz       1416 s          0 s        161 s       3224 s          0 s
  Memory: 15.606487274169922 GB (13679.4921875 MB free)
  Uptime: 502.9 sec
  Load Avg:  1.28  1.69  0.92
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 7 Jul 2024 - 12:18
  • Package commit: 896f94
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 47.168 μs (5%) 22.15 KiB (1%) 584
["solvers", "Percival"] 62.546 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 490.833 μs (5%) 234.58 KiB (1%) 10848
["solvers", "TRON"] 60.412 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 39.754 μs (5%) 30.39 KiB (1%) 367

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       1946 s          0 s        132 s       2296 s          0 s
       #2  2445 MHz       1747 s          0 s        110 s       2487 s          0 s
       #3  3242 MHz       1677 s          0 s        144 s       2474 s          0 s
       #4  3252 MHz       1356 s          0 s        152 s       2774 s          0 s
  Memory: 15.606487274169922 GB (13744.83203125 MB free)
  Uptime: 450.92 sec
  Load Avg:  1.65  1.82  0.91
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 7 Jul 2024 - 12:19
  • Package commit: 88535e
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 47.318 μs (5%) 22.15 KiB (1%) 584
["solvers", "Percival"] 63.287 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 494.801 μs (5%) 234.58 KiB (1%) 10848
["solvers", "TRON"] 61.023 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 40.054 μs (5%) 30.39 KiB (1%) 367

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3267 MHz       2079 s          0 s        143 s       2671 s          0 s
       #2  3243 MHz       2021 s          0 s        124 s       2719 s          0 s
       #3  2445 MHz       1728 s          0 s        153 s       2932 s          0 s
       #4  2607 MHz       1416 s          0 s        161 s       3224 s          0 s
  Memory: 15.606487274169922 GB (13679.4921875 MB free)
  Uptime: 502.9 sec
  Load Avg:  1.28  1.69  0.92
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.85
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@dpo
Copy link
Member

dpo commented Jul 7, 2024

CirrusCI gives us 10,000 minutes (= 7 x 24 hours) per month for Linux VMs and 500 minutes for macOS VMs [1]. Is that such a limitation??? I'm a bit bummed by these discussions.

The failure in this PR is unrelated to time limits.

[1] https://cirrus-ci.org/faq/#are-there-any-limits

.cirrus.yml Outdated
@@ -2,14 +2,14 @@ task:
matrix:
- name: FreeBSD
freebsd_instance:
image_family: freebsd-13-3
image_family: freebsd-13-2
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
image_family: freebsd-13-2
image_family: freebsd-13-3

.cirrus.yml Outdated
env:
matrix:
- JULIA_VERSION: 1.6
- JULIA_VERSION: 1
- name: MacOS M1
macos_instance:
image: ghcr.io/cirruslabs/macos-ventura-base:latest
image: ghcr.io/cirruslabs/macos-monterey-base:latest
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
image: ghcr.io/cirruslabs/macos-monterey-base:latest
image: ghcr.io/cirruslabs/macos-sonoma-base:latest

@abelsiqueira
Copy link
Member Author

Can you submit a RP to update https://github.com/abelsiqueira/BestieTemplate.jl/? Otherwise it defeats the purpose of having Cirrus it on the template.

Copy link
Contributor

github-actions bot commented Jul 7, 2024

Benchmark result

Judge result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmarks:
    • Target: 7 Jul 2024 - 15:21
    • Baseline: 7 Jul 2024 - 15:22
  • Package commits:
    • Target: 2285a7
    • Baseline: 88535e
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       1668 s          0 s        132 s       2572 s          0 s
       #2  2589 MHz       1707 s          0 s        124 s       2542 s          0 s
       #3  3242 MHz       1601 s          0 s        140 s       2636 s          0 s
       #4  2445 MHz       1785 s          0 s        133 s       2462 s          0 s
  Memory: 15.606491088867188 GB (13727.8046875 MB free)
  Uptime: 440.55 sec
  Load Avg:  1.58  1.64  0.79
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2857 MHz       1896 s          0 s        143 s       2858 s          0 s
       #2  3244 MHz       1832 s          0 s        138 s       2929 s          0 s
       #3  2607 MHz       1752 s          0 s        149 s       3001 s          0 s
       #4  3220 MHz       1806 s          0 s        141 s       2957 s          0 s
  Memory: 15.606491088867188 GB (13729.40234375 MB free)
  Uptime: 493.19 sec
  Load Avg:  1.27  1.54  0.81
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 7 Jul 2024 - 15:21
  • Package commit: 2285a7
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 48.972 μs (5%) 22.15 KiB (1%) 584
["solvers", "Percival"] 63.830 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 490.126 μs (5%) 234.58 KiB (1%) 10848
["solvers", "TRON"] 61.455 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 40.726 μs (5%) 30.39 KiB (1%) 367

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       1668 s          0 s        132 s       2572 s          0 s
       #2  2589 MHz       1707 s          0 s        124 s       2542 s          0 s
       #3  3242 MHz       1601 s          0 s        140 s       2636 s          0 s
       #4  2445 MHz       1785 s          0 s        133 s       2462 s          0 s
  Memory: 15.606491088867188 GB (13727.8046875 MB free)
  Uptime: 440.55 sec
  Load Avg:  1.58  1.64  0.79
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JSOSuite.jl/JSOSuite.jl

Job Properties

  • Time of benchmark: 7 Jul 2024 - 15:22
  • Package commit: 88535e
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["solvers", "LBFGS"] 48.060 μs (5%) 22.15 KiB (1%) 584
["solvers", "Percival"] 64.070 μs (5%) 28.12 KiB (1%) 385
["solvers", "R2"] 492.090 μs (5%) 234.58 KiB (1%) 10848
["solvers", "TRON"] 59.681 μs (5%) 58.62 KiB (1%) 571
["solvers", "TRUNK"] 39.363 μs (5%) 30.39 KiB (1%) 367

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["solvers"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1022-azure #23~22.04.1-Ubuntu SMP Thu May  9 17:59:24 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2857 MHz       1896 s          0 s        143 s       2858 s          0 s
       #2  3244 MHz       1832 s          0 s        138 s       2929 s          0 s
       #3  2607 MHz       1752 s          0 s        149 s       3001 s          0 s
       #4  3220 MHz       1806 s          0 s        141 s       2957 s          0 s
  Memory: 15.606491088867188 GB (13729.40234375 MB free)
  Uptime: 493.19 sec
  Load Avg:  1.27  1.54  0.81
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.86
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@abelsiqueira
Copy link
Member Author

I've updated to 0.7.2 which includes @dpo's changes for Cirrus, and I merged @tmigot's suggestion, so it is done and I will merge now. Thanks everyone for their time and input.

@abelsiqueira abelsiqueira changed the title chore: 🤖 Apply BestieTemplate v0.7.1 chore: 🤖 Apply BestieTemplate v0.7.2 Jul 7, 2024
@abelsiqueira abelsiqueira merged commit eea5852 into main Jul 7, 2024
6 of 7 checks passed
@abelsiqueira abelsiqueira deleted the 143-copiertemplate branch July 7, 2024 15:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add best practices as suggested in COPIERTemplate.jl
4 participants