Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix JET issues #155

Merged
merged 2 commits into from
Jul 17, 2023
Merged

fix JET issues #155

merged 2 commits into from
Jul 17, 2023

Conversation

Krastanov
Copy link
Member

No description provided.

@codecov
Copy link

codecov bot commented Jul 17, 2023 •
edited
Loading

Codecov Report

Merging #155 (faeca6e) into master (5ab1f0f) will increase coverage by 0.14%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master     #155      +/-   ##
==========================================
+ Coverage   86.79%   86.94%   +0.14%     
==========================================
  Files          37       37              
  Lines        3158     3163       +5     
==========================================
+ Hits         2741     2750       +9     
+ Misses        417      413       -4
Impacted Files Coverage Δ
src/QuantumClifford.jl 90.17% <100.00%> (ø)
src/dense_cliffords.jl 91.50% <100.00%> (+1.88%) ⬆️
src/ecc/ECC.jl 84.48% <100.00%> (ø)
src/mctrajectory.jl 77.77% <100.00%> (ø)
src/pauli_operator.jl 98.59% <100.00%> (+0.10%) ⬆️
src/project_trace_reset.jl 95.04% <100.00%> (ø)

... and 1 file with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@github-actions
Copy link
Contributor

github-actions bot commented Jul 17, 2023 •
edited
Loading

Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 17 Jul 2023 - 01:12
  • Baseline: 17 Jul 2023 - 01:17
  • Package commits:
  • Target: 326533
  • Baseline: 5ab1f0
  • Julia commits:
  • Target: c22b1c
  • Baseline: c22b1c
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["clifford", "dense", "cnot_on_dense500_destab"] 1.06 (5%) ❌ 1.00 (1%)
["pauli", "mul", "1000"] 1.06 (5%) ❌ 1.00 (1%)
["stabilizer", "trace", "stabilizer"] 0.93 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.11.0-DEV.103
Commit c22b1c1393d (2023-07-16 12:05 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 643 s 0 s 147 s 7398 s 0 s
 #2 2793 MHz 7401 s 0 s 188 s 595 s 0 s
 Memory: 6.769481658935547 GB (5127.9453125 MB free)
 Uptime: 826.49 sec
 Load Avg: 1.0 1.0 0.7
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.11.0-DEV.103
Commit c22b1c1393d (2023-07-16 12:05 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 903 s 0 s 156 s 10042 s 0 s
 #2 2793 MHz 10057 s 0 s 194 s 854 s 0 s
 Memory: 6.769481658935547 GB (5092.05859375 MB free)
 Uptime: 1118.66 sec
 Load Avg: 1.0 1.0 0.79
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 17 Jul 2023 - 1:12
  • Package commit: 326533
  • Julia commit: c22b1c
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 23.164 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 249.595 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 22.391 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 174.501 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 22.358 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 172.600 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 70.801 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 207.901 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.369 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 7.250 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 41.500 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 177.200 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.336 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 10.082 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.243 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 27.500 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 161.900 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.320 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.822 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 15.332 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 8.350 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 1.292 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 730.302 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 59.101 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 27.500 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 31.300 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 15.700 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 15.333 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 8.376 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 1.063 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 731.002 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.142 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.059 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.761 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 863.003 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 6.900 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 3.312 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 6.860 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 3.300 μs (5%)
["pauli", "mul", "100"] 16.132 ns (5%)
["pauli", "mul", "1000"] 30.754 ns (5%)
["pauli", "mul", "100000"] 950.000 ns (5%)
["pauli", "mul", "20000000"] 386.801 μs (5%)
["stabilizer", "canon", "cano500"] 4.567 ms (5%)
["stabilizer", "canon", "diag_cano500"] 1.074 ms (5%)
["stabilizer", "canon", "diag_gott500"] 11.260 ms (5%) 5.27 MiB (1%) 24557
["stabilizer", "canon", "diag_rref500"] 1.101 ms (5%)
["stabilizer", "canon", "gott500"] 14.974 ms (5%) 5.27 MiB (1%) 24608
["stabilizer", "canon", "md_cano500"] 1.890 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.905 ms (5%)
["stabilizer", "canon", "rref500"] 4.552 ms (5%)
["stabilizer", "project", "destabilizer"] 23.000 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 10.700 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 2.168 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 3.763 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 35.700 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 10.800 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.11.0-DEV.103
Commit c22b1c1393d (2023-07-16 12:05 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 643 s 0 s 147 s 7398 s 0 s
 #2 2793 MHz 7401 s 0 s 188 s 595 s 0 s
 Memory: 6.769481658935547 GB (5127.9453125 MB free)
 Uptime: 826.49 sec
 Load Avg: 1.0 1.0 0.7
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 17 Jul 2023 - 1:17
  • Package commit: 5ab1f0
  • Julia commit: c22b1c
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 23.091 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 245.901 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 22.352 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 174.301 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 22.326 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 172.902 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 73.701 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 209.201 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.369 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 7.475 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 41.401 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 176.701 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.337 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 10.076 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.257 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 27.401 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 162.003 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.321 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.822 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 15.238 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 8.307 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 1.260 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 719.912 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 55.501 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 27.500 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 31.501 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 15.900 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 15.207 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 8.235 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 1.064 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 722.811 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.146 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.056 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.763 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 861.711 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 6.900 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 3.312 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 6.860 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 3.300 μs (5%)
["pauli", "mul", "100"] 16.232 ns (5%)
["pauli", "mul", "1000"] 29.045 ns (5%)
["pauli", "mul", "100000"] 954.591 ns (5%)
["pauli", "mul", "20000000"] 396.105 μs (5%)
["stabilizer", "canon", "cano500"] 4.603 ms (5%)
["stabilizer", "canon", "diag_cano500"] 1.073 ms (5%)
["stabilizer", "canon", "diag_gott500"] 11.064 ms (5%) 5.27 MiB (1%) 24557
["stabilizer", "canon", "diag_rref500"] 1.102 ms (5%)
["stabilizer", "canon", "gott500"] 14.775 ms (5%) 5.27 MiB (1%) 24608
["stabilizer", "canon", "md_cano500"] 1.875 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.903 ms (5%)
["stabilizer", "canon", "rref500"] 4.569 ms (5%)
["stabilizer", "project", "destabilizer"] 23.200 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 10.700 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 2.163 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 3.663 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 34.701 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 11.660 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.11.0-DEV.103
Commit c22b1c1393d (2023-07-16 12:05 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 903 s 0 s 156 s 10042 s 0 s
 #2 2793 MHz 10057 s 0 s 194 s 854 s 0 s
 Memory: 6.769481658935547 GB (5092.05859375 MB free)
 Uptime: 1118.66 sec
 Load Avg: 1.0 1.0 0.79
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
CPU family: 6
Model: 106
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 6
BogoMIPS: 5586.87
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 96 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 2.5 MiB (2 instances)
L3 cache: 48 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Vendor :Intel
Architecture :UnknownIntel
Model Family: 0x06, Model: 0x6a, Stepping: 0x06, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (48, 1280, 49152) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 17 Jul 2023 - 04:53
  • Baseline: 17 Jul 2023 - 04:58
  • Package commits:
  • Target: a0ff43
  • Baseline: 5ab1f0
  • Julia commits:
  • Target: c22b1c
  • Baseline: c22b1c
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories", "q1001_r1"] 0.90 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r100"] 1.07 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r10000"] 1.11 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories", "q101_r1"] 0.90 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 1.11 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.12 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories_union", "q1001_r100"] 1.11 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.12 (5%) ❌ 1.00 (1%)
["clifford", "dense", "cnot_on_diag500_destab"] 1.06 (5%) ❌ 1.00 (1%)
["pauli", "mul", "20000000"] 0.94 (5%) ✅ 1.00 (1%)
["stabilizer", "canon", "diag_rref500"] 1.07 (5%) ❌ 1.00 (1%)
["stabilizer", "tensor", "diag_pow5_20"] 1.13 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.11.0-DEV.103
Commit c22b1c1393d (2023-07-16 12:05 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 5917 s 0 s 180 s 2898 s 0 s
 #2 2793 MHz 2119 s 0 s 151 s 6711 s 0 s
 Memory: 6.7694854736328125 GB (5117.0390625 MB free)
 Uptime: 907.19 sec
 Load Avg: 1.01 1.0 0.68
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.11.0-DEV.103
Commit c22b1c1393d (2023-07-16 12:05 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 8820 s 0 s 190 s 2932 s 0 s
 #2 2793 MHz 2159 s 0 s 157 s 9604 s 0 s
 Memory: 6.7694854736328125 GB (5058.34375 MB free)
 Uptime: 1201.93 sec
 Load Avg: 1.0 1.0 0.78
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 17 Jul 2023 - 4:53
  • Package commit: a0ff43
  • Julia commit: c22b1c
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 23.222 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 253.000 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 22.393 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 175.000 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 22.348 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 173.300 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 70.799 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 231.200 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.528 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 7.200 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 41.400 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 194.399 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.490 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 10.096 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.229 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 27.499 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 179.100 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.476 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.822 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 15.227 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 8.230 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 1.259 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 633.201 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 56.400 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 27.700 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 32.900 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 15.800 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 15.219 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 8.228 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 1.064 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 633.200 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.147 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.056 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.762 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 868.001 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 6.880 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 3.325 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 6.840 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 3.300 μs (5%)
["pauli", "mul", "100"] 16.333 ns (5%)
["pauli", "mul", "1000"] 29.607 ns (5%)
["pauli", "mul", "100000"] 937.500 ns (5%)
["pauli", "mul", "20000000"] 392.100 μs (5%)
["stabilizer", "canon", "cano500"] 4.567 ms (5%)
["stabilizer", "canon", "diag_cano500"] 1.073 ms (5%)
["stabilizer", "canon", "diag_gott500"] 11.147 ms (5%) 5.27 MiB (1%) 24557
["stabilizer", "canon", "diag_rref500"] 1.100 ms (5%)
["stabilizer", "canon", "gott500"] 14.873 ms (5%) 5.27 MiB (1%) 24608
["stabilizer", "canon", "md_cano500"] 1.872 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.893 ms (5%)
["stabilizer", "canon", "rref500"] 4.565 ms (5%)
["stabilizer", "project", "destabilizer"] 22.700 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 10.600 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 2.473 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 3.825 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 34.800 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 10.860 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.11.0-DEV.103
Commit c22b1c1393d (2023-07-16 12:05 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 5917 s 0 s 180 s 2898 s 0 s
 #2 2793 MHz 2119 s 0 s 151 s 6711 s 0 s
 Memory: 6.7694854736328125 GB (5117.0390625 MB free)
 Uptime: 907.19 sec
 Load Avg: 1.01 1.0 0.68
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 17 Jul 2023 - 4:58
  • Package commit: 5ab1f0
  • Julia commit: c22b1c
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 23.170 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 244.700 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 22.348 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 174.700 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 22.422 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 173.400 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 78.300 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 216.100 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.379 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 8.025 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 40.400 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 175.600 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.335 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 10.054 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.114 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 27.400 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 161.900 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.321 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.811 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 15.272 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 8.142 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 1.259 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 634.501 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 54.900 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 27.500 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 31.000 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 16.000 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 15.260 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 8.187 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 1.066 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 634.401 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.133 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.057 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.764 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 867.102 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 6.880 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 3.288 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 6.920 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 3.300 μs (5%)
["pauli", "mul", "100"] 16.232 ns (5%)
["pauli", "mul", "1000"] 29.204 ns (5%)
["pauli", "mul", "100000"] 941.667 ns (5%)
["pauli", "mul", "20000000"] 419.100 μs (5%)
["stabilizer", "canon", "cano500"] 4.577 ms (5%)
["stabilizer", "canon", "diag_cano500"] 1.073 ms (5%)
["stabilizer", "canon", "diag_gott500"] 11.159 ms (5%) 5.27 MiB (1%) 24557
["stabilizer", "canon", "diag_rref500"] 1.030 ms (5%)
["stabilizer", "canon", "gott500"] 14.725 ms (5%) 5.27 MiB (1%) 24608
["stabilizer", "canon", "md_cano500"] 1.902 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.923 ms (5%)
["stabilizer", "canon", "rref500"] 4.581 ms (5%)
["stabilizer", "project", "destabilizer"] 22.900 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 10.700 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 2.192 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 3.775 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 35.200 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 10.720 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.11.0-DEV.103
Commit c22b1c1393d (2023-07-16 12:05 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 8820 s 0 s 190 s 2932 s 0 s
 #2 2793 MHz 2159 s 0 s 157 s 9604 s 0 s
 Memory: 6.7694854736328125 GB (5058.34375 MB free)
 Uptime: 1201.93 sec
 Load Avg: 1.0 1.0 0.78
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
CPU family: 6
Model: 106
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 6
BogoMIPS: 5586.87
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 96 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 2.5 MiB (2 instances)
L3 cache: 48 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Vendor :Intel
Architecture :UnknownIntel
Model Family: 0x06, Model: 0x6a, Stepping: 0x06, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (48, 1280, 49152) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 17 Jul 2023 - 04:53
  • Baseline: 17 Jul 2023 - 04:58
  • Package commits:
  • Target: a0ff43
  • Baseline: 5ab1f0
  • Julia commits:
  • Target: c22b1c
  • Baseline: c22b1c
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories", "q1001_r1"] 0.90 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r100"] 1.07 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r10000"] 1.11 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories", "q101_r1"] 0.90 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 1.11 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.12 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories_union", "q1001_r100"] 1.11 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.12 (5%) ❌ 1.00 (1%)
["clifford", "dense", "cnot_on_diag500_destab"] 1.06 (5%) ❌ 1.00 (1%)
["pauli", "mul", "20000000"] 0.94 (5%) ✅ 1.00 (1%)
["stabilizer", "canon", "diag_rref500"] 1.07 (5%) ❌ 1.00 (1%)
["stabilizer", "tensor", "diag_pow5_20"] 1.13 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.11.0-DEV.103
Commit c22b1c1393d (2023-07-16 12:05 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 5917 s 0 s 180 s 2898 s 0 s
 #2 2793 MHz 2119 s 0 s 151 s 6711 s 0 s
 Memory: 6.7694854736328125 GB (5117.0390625 MB free)
 Uptime: 907.19 sec
 Load Avg: 1.01 1.0 0.68
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.11.0-DEV.103
Commit c22b1c1393d (2023-07-16 12:05 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 8820 s 0 s 190 s 2932 s 0 s
 #2 2793 MHz 2159 s 0 s 157 s 9604 s 0 s
 Memory: 6.7694854736328125 GB (5058.34375 MB free)
 Uptime: 1201.93 sec
 Load Avg: 1.0 1.0 0.78
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 17 Jul 2023 - 4:53
  • Package commit: a0ff43
  • Julia commit: c22b1c
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 23.222 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 253.000 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 22.393 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 175.000 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 22.348 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 173.300 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 70.799 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 231.200 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.528 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 7.200 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 41.400 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 194.399 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.490 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 10.096 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.229 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 27.499 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 179.100 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.476 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.822 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 15.227 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 8.230 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 1.259 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 633.201 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 56.400 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 27.700 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 32.900 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 15.800 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 15.219 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 8.228 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 1.064 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 633.200 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.147 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.056 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.762 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 868.001 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 6.880 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 3.325 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 6.840 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 3.300 μs (5%)
["pauli", "mul", "100"] 16.333 ns (5%)
["pauli", "mul", "1000"] 29.607 ns (5%)
["pauli", "mul", "100000"] 937.500 ns (5%)
["pauli", "mul", "20000000"] 392.100 μs (5%)
["stabilizer", "canon", "cano500"] 4.567 ms (5%)
["stabilizer", "canon", "diag_cano500"] 1.073 ms (5%)
["stabilizer", "canon", "diag_gott500"] 11.147 ms (5%) 5.27 MiB (1%) 24557
["stabilizer", "canon", "diag_rref500"] 1.100 ms (5%)
["stabilizer", "canon", "gott500"] 14.873 ms (5%) 5.27 MiB (1%) 24608
["stabilizer", "canon", "md_cano500"] 1.872 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.893 ms (5%)
["stabilizer", "canon", "rref500"] 4.565 ms (5%)
["stabilizer", "project", "destabilizer"] 22.700 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 10.600 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 2.473 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 3.825 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 34.800 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 10.860 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.11.0-DEV.103
Commit c22b1c1393d (2023-07-16 12:05 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 5917 s 0 s 180 s 2898 s 0 s
 #2 2793 MHz 2119 s 0 s 151 s 6711 s 0 s
 Memory: 6.7694854736328125 GB (5117.0390625 MB free)
 Uptime: 907.19 sec
 Load Avg: 1.01 1.0 0.68
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 17 Jul 2023 - 4:58
  • Package commit: 5ab1f0
  • Julia commit: c22b1c
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 23.170 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 244.700 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 22.348 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 174.700 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 22.422 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 173.400 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 78.300 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 216.100 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.379 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 8.025 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 40.400 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 175.600 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.335 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 10.054 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.114 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 27.400 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 161.900 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.321 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.811 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 15.272 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 8.142 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 1.259 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 634.501 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 54.900 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 27.500 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 31.000 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 16.000 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 15.260 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 8.187 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 1.066 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 634.401 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.133 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.057 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.764 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 867.102 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 6.880 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 3.288 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 6.920 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 3.300 μs (5%)
["pauli", "mul", "100"] 16.232 ns (5%)
["pauli", "mul", "1000"] 29.204 ns (5%)
["pauli", "mul", "100000"] 941.667 ns (5%)
["pauli", "mul", "20000000"] 419.100 μs (5%)
["stabilizer", "canon", "cano500"] 4.577 ms (5%)
["stabilizer", "canon", "diag_cano500"] 1.073 ms (5%)
["stabilizer", "canon", "diag_gott500"] 11.159 ms (5%) 5.27 MiB (1%) 24557
["stabilizer", "canon", "diag_rref500"] 1.030 ms (5%)
["stabilizer", "canon", "gott500"] 14.725 ms (5%) 5.27 MiB (1%) 24608
["stabilizer", "canon", "md_cano500"] 1.902 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.923 ms (5%)
["stabilizer", "canon", "rref500"] 4.581 ms (5%)
["stabilizer", "project", "destabilizer"] 22.900 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 10.700 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 2.192 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 3.775 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 35.200 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 10.720 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.11.0-DEV.103
Commit c22b1c1393d (2023-07-16 12:05 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 8820 s 0 s 190 s 2932 s 0 s
 #2 2793 MHz 2159 s 0 s 157 s 9604 s 0 s
 Memory: 6.7694854736328125 GB (5058.34375 MB free)
 Uptime: 1201.93 sec
 Load Avg: 1.0 1.0 0.78
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
CPU family: 6
Model: 106
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 6
BogoMIPS: 5586.87
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 96 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 2.5 MiB (2 instances)
L3 cache: 48 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Vendor :Intel
Architecture :UnknownIntel
Model Family: 0x06, Model: 0x6a, Stepping: 0x06, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (48, 1280, 49152) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 17 Jul 2023 - 04:53
  • Baseline: 17 Jul 2023 - 04:58
  • Package commits:
  • Target: a0ff43
  • Baseline: 5ab1f0
  • Julia commits:
  • Target: c22b1c
  • Baseline: c22b1c
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories", "q1001_r1"] 0.90 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r100"] 1.07 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r10000"] 1.11 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories", "q101_r1"] 0.90 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 1.11 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.12 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories_union", "q1001_r100"] 1.11 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.12 (5%) ❌ 1.00 (1%)
["clifford", "dense", "cnot_on_diag500_destab"] 1.06 (5%) ❌ 1.00 (1%)
["pauli", "mul", "20000000"] 0.94 (5%) ✅ 1.00 (1%)
["stabilizer", "canon", "diag_rref500"] 1.07 (5%) ❌ 1.00 (1%)
["stabilizer", "tensor", "diag_pow5_20"] 1.13 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.11.0-DEV.103
Commit c22b1c1393d (2023-07-16 12:05 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 5917 s 0 s 180 s 2898 s 0 s
 #2 2793 MHz 2119 s 0 s 151 s 6711 s 0 s
 Memory: 6.7694854736328125 GB (5117.0390625 MB free)
 Uptime: 907.19 sec
 Load Avg: 1.01 1.0 0.68
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.11.0-DEV.103
Commit c22b1c1393d (2023-07-16 12:05 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 8820 s 0 s 190 s 2932 s 0 s
 #2 2793 MHz 2159 s 0 s 157 s 9604 s 0 s
 Memory: 6.7694854736328125 GB (5058.34375 MB free)
 Uptime: 1201.93 sec
 Load Avg: 1.0 1.0 0.78
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icela

@Krastanov Krastanov merged commit 0ee56f3 into master Jul 17, 2023
@Krastanov Krastanov deleted the jet branch July 17, 2023 05:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@Krastanov