Skip to content

Add crud and tls benchmarks for aleph#673

Open
ruroru wants to merge 1 commit intoMDA2AV:mainfrom
ruroru:main
Open

Add crud and tls benchmarks for aleph#673
ruroru wants to merge 1 commit intoMDA2AV:mainfrom
ruroru:main

Conversation

@ruroru
Copy link
Copy Markdown
Contributor

@ruroru ruroru commented Apr 29, 2026

No description provided.

@ruroru
Copy link
Copy Markdown
Contributor Author

ruroru commented Apr 29, 2026

/benchmark -f aleph

@github-actions
Copy link
Copy Markdown
Contributor

👋 /benchmark request received. A collaborator will review and approve the run.

@ruroru ruroru force-pushed the main branch 2 times, most recently from 832f4b9 to 24592dd Compare April 29, 2026 16:31
@github-actions
Copy link
Copy Markdown
Contributor

Benchmark Results

Framework: aleph | Test: all tests

Test Conn RPS CPU Mem Δ RPS Δ Mem
baseline 512 1,241,410 6690.0% 14.5GiB +2.4% +271.8%
baseline 4096 1,328,417 6647.3% 6.9GiB +9.9% +50.0%
limited-conn 512 506,562 3690.1% 5.3GiB +0.3% +96.3%
limited-conn 4096 494,679 3362.4% 5.3GiB +0.8% +71.0%
json 4096 541,369 5152.7% 5.3GiB +2.1% +17.8%
json-comp 512 222,350 5829.0% 7.0GiB +4.9% +94.4%
json-comp 4096 231,062 6124.0% 6.6GiB +7.7% +61.0%
json-comp 16384 232,779 5917.3% 7.1GiB +2.8% +39.2%
upload 32 663 2896.2% 23.0GiB -3.4% +36.9%
upload 256 581 5617.9% 31.5GiB -2.7% ~0%
api-4 256 34,996 398.7% 904MiB +2.7% +16.8%
api-16 1024 77,003 1635.1% 1.8GiB +0.9% +5.9%
static 1024 22,978 6501.8% 7.7GiB +1.5% +75.0%
static 4096 22,303 6468.5% 8.5GiB +1.3% +60.4%
static 6800 21,947 6427.1% 9.2GiB +0.6% +43.7%
async-db 1024 105,034 4622.0% 7.3GiB -2.7% +62.2%
Full log
Requests/sec:  19013.19
Transfer/sec:    342.83MB
[info] CPU 6192.5% | Mem 7.8GiB

[run 2/3]
Running 5s test @ http://localhost:8080
  64 threads and 4096 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   168.02ms   96.95ms 973.29ms   73.28%
    Req/Sec   367.16    193.34     3.90k    88.10%
  112163 requests in 5.13s, 1.98GB read
Requests/sec:  21848.99
Transfer/sec:    394.08MB
[info] CPU 6216.1% | Mem 8.4GiB

[run 3/3]
Running 5s test @ http://localhost:8080
  64 threads and 4096 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   172.42ms   88.50ms 888.23ms   72.87%
    Req/Sec   352.15    118.27     2.75k    85.39%
  114200 requests in 5.12s, 2.01GB read
Requests/sec:  22303.14
Transfer/sec:    401.59MB
[info] CPU 6468.5% | Mem 8.5GiB

=== Best: 22303 req/s (CPU: 6468.5%, Mem: 8.5GiB) ===
[info] saved results/static/4096/aleph.json
httparena-bench-aleph
httparena-bench-aleph

==============================================
=== aleph / static / 6800c (tool=wrk) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
Running 5s test @ http://localhost:8080
  64 threads and 6800 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   315.93ms  227.52ms   1.93s    80.17%
    Req/Sec   335.05    174.75     1.28k    83.07%
  93696 requests in 5.10s, 1.66GB read
  Socket errors: connect 0, read 0, write 0, timeout 10
Requests/sec:  18365.39
Transfer/sec:    334.02MB
[info] CPU 6074.6% | Mem 8.7GiB

[run 2/3]
Running 5s test @ http://localhost:8080
  64 threads and 6800 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   248.80ms  153.00ms   1.57s    73.10%
    Req/Sec   383.67    214.83     3.54k    81.16%
  108763 requests in 5.13s, 1.93GB read
Requests/sec:  21209.49
Transfer/sec:    385.16MB
[info] CPU 6089.2% | Mem 9.0GiB

[run 3/3]
Running 5s test @ http://localhost:8080
  64 threads and 6800 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   279.36ms  130.92ms   1.28s    73.27%
    Req/Sec   352.22    154.59     3.12k    86.74%
  112074 requests in 5.11s, 1.98GB read
Requests/sec:  21947.75
Transfer/sec:    397.22MB
[info] CPU 6427.1% | Mem 9.2GiB

=== Best: 21947 req/s (CPU: 6427.1%, Mem: 9.2GiB) ===
[info] saved results/static/6800/aleph.json
httparena-bench-aleph
httparena-bench-aleph

==============================================
=== aleph / async-db / 1024c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   10.83ms   9.14ms   12.20ms   36.60ms   300.10ms

  921185 requests in 10.00s, 921186 responses
  Throughput: 92.10K req/s
  Bandwidth:  354.97MB/s
  Status codes: 2xx=921186, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 921186 / 921186 responses (100.0%)
  Reconnects: 36412
  Per-template: 183387,184191,185109,184586,183913
  Per-template-ok: 183387,184191,185109,184586,183913
[info] CPU 4921.4% | Mem 8.4GiB

[run 2/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   9.60ms   9.31ms   11.90ms   15.40ms   20.80ms

  1018242 requests in 10.00s, 1018242 responses
  Throughput: 101.80K req/s
  Bandwidth:  392.41MB/s
  Status codes: 2xx=1018242, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 1018241 / 1018242 responses (100.0%)
  Reconnects: 40334
  Per-template: 203233,203342,204130,204002,203534
  Per-template-ok: 203233,203342,204130,204002,203534
[info] CPU 4416.5% | Mem 8.2GiB

[run 3/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   9.29ms   8.99ms   11.60ms   14.90ms   19.80ms

  1050344 requests in 10.00s, 1050345 responses
  Throughput: 105.01K req/s
  Bandwidth:  404.76MB/s
  Status codes: 2xx=1050345, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 1050344 / 1050345 responses (100.0%)
  Reconnects: 41837
  Per-template: 209883,209803,210266,210296,210096
  Per-template-ok: 209883,209803,210266,210296,210096
[info] CPU 4622.0% | Mem 7.3GiB

=== Best: 105034 req/s (CPU: 4622.0%, Mem: 7.3GiB) ===
[info] input BW: 7.01MB/s (avg template: 70 bytes)
[info] saved results/async-db/1024/aleph.json
httparena-bench-aleph
httparena-bench-aleph
[info] skip: aleph does not subscribe to crud
[info] skip: aleph does not subscribe to baseline-h2
[info] skip: aleph does not subscribe to static-h2
[info] skip: aleph does not subscribe to baseline-h2c
[info] skip: aleph does not subscribe to json-h2c
[info] skip: aleph does not subscribe to baseline-h3
[info] skip: aleph does not subscribe to static-h3
[info] skip: aleph does not subscribe to gateway-64
[info] skip: aleph does not subscribe to gateway-h3
[info] skip: aleph does not subscribe to production-stack
[info] skip: aleph does not subscribe to unary-grpc
[info] skip: aleph does not subscribe to unary-grpc-tls
[info] skip: aleph does not subscribe to stream-grpc
[info] skip: aleph does not subscribe to stream-grpc-tls
[info] skip: aleph does not subscribe to echo-ws
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/api-16-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/api-4-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/async-db-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-16384.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-6800.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-32.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
httparena-postgres
[info] restoring loopback MTU to 65536
[info] restoring CPU governor → powersave

@ruroru
Copy link
Copy Markdown
Contributor Author

ruroru commented Apr 29, 2026

/benchmark -f aleph

@github-actions
Copy link
Copy Markdown
Contributor

👋 /benchmark request received. A collaborator will review and approve the run.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmark Results

Framework: aleph | Test: all tests

Test Conn RPS CPU Mem Δ RPS Δ Mem
baseline 512 1,239,963 6690.8% 14.5GiB +2.3% +271.8%
baseline 4096 1,191,555 6416.9% 5.4GiB -1.4% +17.4%
limited-conn 512 508,633 3627.4% 5.2GiB +0.7% +92.6%
limited-conn 4096 497,637 3435.4% 5.4GiB +1.4% +74.2%
json 4096 555,203 5100.1% 7.3GiB +4.7% +62.2%
json-comp 512 221,791 5707.4% 6.9GiB +4.6% +91.7%
json-comp 4096 235,190 6057.3% 6.0GiB +9.7% +46.3%
json-comp 16384 231,016 5820.9% 7.2GiB +2.0% +41.2%
json-tls 4096 611,443 6412.7% 9.5GiB NEW NEW
upload 32 650 2902.1% 19.4GiB -5.2% +15.5%
upload 256 591 5610.6% 31.6GiB -1.0% +0.3%
api-4 256 34,826 399.0% 895MiB +2.2% +15.6%
api-16 1024 77,883 1664.6% 1.8GiB +2.0% +5.9%
static 1024 22,910 6491.9% 7.1GiB +1.2% +61.4%
static 4096 22,495 6479.3% 9.0GiB +2.2% +69.8%
static 6800 22,265 6470.7% 9.5GiB +2.1% +48.4%
async-db 1024 106,006 4595.5% 13.6GiB -1.8% +202.2%
crud 4096 189,798 4851.7% 13.4GiB NEW NEW
Full log
    Latency   11.03ms   8.77ms   12.40ms   36.50ms   313.90ms

  904524 requests in 10.00s, 904525 responses
  Throughput: 90.43K req/s
  Bandwidth:  348.19MB/s
  Status codes: 2xx=904525, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 904525 / 904525 responses (100.0%)
  Reconnects: 35606
  Per-template: 180496,181256,181465,181125,180183
  Per-template-ok: 180496,181256,181465,181125,180183
[info] CPU 5299.6% | Mem 13.9GiB

[run 2/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   9.15ms   8.89ms   11.30ms   14.50ms   21.00ms

  1060058 requests in 10.00s, 1060062 responses
  Throughput: 105.98K req/s
  Bandwidth:  408.37MB/s
  Status codes: 2xx=1060062, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 1060060 / 1060062 responses (100.0%)
  Reconnects: 42096
  Per-template: 211822,211848,212238,212526,211626
  Per-template-ok: 211822,211848,212238,212526,211626
[info] CPU 4595.5% | Mem 13.6GiB

[run 3/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   9.46ms   9.17ms   11.70ms   15.00ms   22.90ms

  1031192 requests in 10.00s, 1031193 responses
  Throughput: 103.10K req/s
  Bandwidth:  397.48MB/s
  Status codes: 2xx=1031193, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 1031187 / 1031193 responses (100.0%)
  Reconnects: 40909
  Per-template: 205785,205851,206626,206765,206160
  Per-template-ok: 205785,205851,206626,206765,206160
[info] CPU 4460.4% | Mem 12.9GiB

=== Best: 106006 req/s (CPU: 4595.5%, Mem: 13.6GiB) ===
[info] input BW: 7.08MB/s (avg template: 70 bytes)
[info] saved results/async-db/1024/aleph.json
httparena-bench-aleph
httparena-bench-aleph

==============================================
=== aleph / crud / 4096c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  200
  Templates: 20
  Expected:  200
  Duration:  15s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   22.15ms   27.80ms   30.90ms   73.20ms   204.10ms

  2649118 requests in 15.00s, 2646211 responses
  Throughput: 176.38K req/s
  Bandwidth:  64.02MB/s
  Status codes: 2xx=2349285, 3xx=0, 4xx=296926, 5xx=0
  Latency samples: 2646211 / 2646211 responses (100.0%)
  Reconnects: 11084
  Per-template: 94443,101466,121998,126121,147229,147335,147869,147563,147289,147318,147391,147000,147082,146966,147560,147467,137190,108815,93772,94337
  Per-template-ok: 94443,101466,121998,126121,147229,147335,147869,147563,147289,147318,147390,146999,147082,146966,147560,147467,137190,0,0,0

  WARNING: 296926/2646211 responses (11.2%) had unexpected status (expected 2xx)
[info] CPU 4874.3% | Mem 14.4GiB

[run 2/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  200
  Templates: 20
  Expected:  200
  Duration:  15s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   18.76ms   26.80ms   29.00ms   37.20ms   55.40ms

  3132233 requests in 15.00s, 3129589 responses
  Throughput: 208.59K req/s
  Bandwidth:  75.51MB/s
  Status codes: 2xx=2768172, 3xx=0, 4xx=361417, 5xx=0
  Latency samples: 3129588 / 3129589 responses (100.0%)
  Reconnects: 13386
  Per-template: 109254,117672,131653,148433,166487,176693,176185,176164,176648,176010,176355,174812,175632,175340,174970,174076,161789,138839,113750,108826
  Per-template-ok: 109254,117672,131653,148433,166487,176693,176185,176164,176648,176010,176355,174812,175632,175340,174970,174075,161789,0,0,0

  WARNING: 361417/3129589 responses (11.5%) had unexpected status (expected 2xx)
[info] CPU 4674.2% | Mem 14.4GiB

[run 3/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  200
  Templates: 20
  Expected:  200
  Duration:  15s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   18.31ms   26.40ms   28.80ms   36.30ms   42.60ms

  3223864 requests in 15.00s, 3221403 responses
  Throughput: 214.71K req/s
  Bandwidth:  77.77MB/s
  Status codes: 2xx=2846981, 3xx=0, 4xx=374422, 5xx=0
  Latency samples: 3221403 / 3221403 responses (100.0%)
  Reconnects: 14312
  Per-template: 111747,120213,133146,150515,168665,181351,181144,180782,182492,182043,181039,180981,181465,182094,181500,180523,167281,145593,117651,111178
  Per-template-ok: 111747,120213,133146,150515,168665,181351,181144,180782,182492,182043,181039,180981,181465,182094,181500,180523,167281,0,0,0

  WARNING: 374422/3221403 responses (11.6%) had unexpected status (expected 2xx)
[info] CPU 4851.7% | Mem 13.4GiB

=== Best: 189798 req/s (CPU: 4851.7%, Mem: 13.4GiB) ===
[info] input BW: 16.29MB/s (avg template: 90 bytes)
[info] saved results/crud/4096/aleph.json
httparena-bench-aleph
httparena-bench-aleph
[info] skip: aleph does not subscribe to baseline-h2
[info] skip: aleph does not subscribe to static-h2
[info] skip: aleph does not subscribe to baseline-h2c
[info] skip: aleph does not subscribe to json-h2c
[info] skip: aleph does not subscribe to baseline-h3
[info] skip: aleph does not subscribe to static-h3
[info] skip: aleph does not subscribe to gateway-64
[info] skip: aleph does not subscribe to gateway-h3
[info] skip: aleph does not subscribe to production-stack
[info] skip: aleph does not subscribe to unary-grpc
[info] skip: aleph does not subscribe to unary-grpc-tls
[info] skip: aleph does not subscribe to stream-grpc
[info] skip: aleph does not subscribe to stream-grpc-tls
[info] skip: aleph does not subscribe to echo-ws
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/api-16-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/api-4-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/async-db-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/crud-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-16384.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-tls-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-6800.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-32.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
httparena-postgres
httparena-redis
[info] restoring loopback MTU to 65536
[info] restoring CPU governor → powersave

Also remove /db handler from ring-http-exchange
@ruroru
Copy link
Copy Markdown
Contributor Author

ruroru commented Apr 30, 2026

/benchmark -f aleph

@github-actions
Copy link
Copy Markdown
Contributor

👋 /benchmark request received. A collaborator will review and approve the run.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmark Results

Framework: aleph | Test: all tests

Test Conn RPS CPU Mem Δ RPS Δ Mem
baseline 512 1,245,357 6683.7% 14.4GiB +2.7% +269.2%
baseline 4096 1,210,360 6473.1% 5.3GiB +0.2% +15.2%
limited-conn 512 514,525 3665.7% 5.3GiB +1.9% +96.3%
limited-conn 4096 492,255 3395.4% 5.3GiB +0.3% +71.0%
json 4096 555,604 5130.5% 7.2GiB +4.8% +60.0%
json-comp 512 222,963 5860.9% 5.6GiB +5.2% +55.6%
json-comp 4096 234,549 5983.9% 6.3GiB +9.4% +53.7%
json-comp 16384 233,164 5893.8% 7.5GiB +2.9% +47.1%
json-tls 4096 616,320 6452.1% 16.2GiB NEW NEW
upload 32 666 3043.0% 22.6GiB -2.9% +34.5%
upload 256 599 5922.3% 31.3GiB +0.3% -0.6%
api-4 256 35,421 399.4% 908MiB +3.9% +17.3%
api-16 1024 77,481 1657.0% 1.8GiB +1.5% +5.9%
static 1024 22,912 6495.5% 7.5GiB +1.2% +70.5%
static 4096 22,522 6465.2% 9.0GiB +2.3% +69.8%
static 6800 22,192 6433.1% 9.3GiB +1.7% +45.3%
async-db 1024 103,663 4598.9% 7.0GiB -4.0% +55.6%
crud 4096 189,475 4658.5% 10.0GiB NEW NEW
Full log
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   10.33ms   8.86ms   11.50ms   57.60ms   282.10ms

  958570 requests in 10.00s, 958573 responses
  Throughput: 95.84K req/s
  Bandwidth:  369.64MB/s
  Status codes: 2xx=958573, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 958573 / 958573 responses (100.0%)
  Reconnects: 37860
  Per-template: 191244,191351,191873,192131,191974
  Per-template-ok: 191244,191351,191873,192131,191974
[info] CPU 4847.0% | Mem 8.0GiB

[run 2/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   9.42ms   9.13ms   11.70ms   15.10ms   21.00ms

  1035105 requests in 10.00s, 1034998 responses
  Throughput: 103.48K req/s
  Bandwidth:  399.05MB/s
  Status codes: 2xx=1034998, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 1034993 / 1034998 responses (100.0%)
  Reconnects: 41115
  Per-template: 206518,206528,207270,207633,207044
  Per-template-ok: 206518,206528,207270,207633,207044
[info] CPU 4569.1% | Mem 7.6GiB

[run 3/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   9.43ms   9.12ms   11.70ms   15.40ms   25.00ms

  1036635 requests in 10.00s, 1036635 responses
  Throughput: 103.64K req/s
  Bandwidth:  399.85MB/s
  Status codes: 2xx=1036635, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 1036630 / 1036635 responses (100.0%)
  Reconnects: 41165
  Per-template: 206716,206484,207745,208268,207417
  Per-template-ok: 206716,206484,207745,208268,207417
[info] CPU 4598.9% | Mem 7.0GiB

=== Best: 103663 req/s (CPU: 4598.9%, Mem: 7.0GiB) ===
[info] input BW: 6.92MB/s (avg template: 70 bytes)
[info] saved results/async-db/1024/aleph.json
httparena-bench-aleph
httparena-bench-aleph

==============================================
=== aleph / crud / 4096c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  200
  Templates: 20
  Expected:  200
  Duration:  15s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   24.87ms   28.80ms   36.00ms   86.80ms   247.20ms

  2359669 requests in 15.00s, 2356772 responses
  Throughput: 157.08K req/s
  Bandwidth:  57.31MB/s
  Status codes: 2xx=2356772, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 2356772 / 2356772 responses (100.0%)
  Reconnects: 10668
  Per-template: 87222,89820,111265,122721,129476,129928,129363,129923,129506,129541,129429,129737,129874,129423,129571,129598,117608,98746,86735,87286
  Per-template-ok: 87222,89820,111265,122721,129476,129928,129363,129923,129506,129541,129429,129737,129874,129423,129571,129598,117608,98746,86735,87286
[info] CPU 4995.4% | Mem 10.8GiB

[run 2/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  200
  Templates: 20
  Expected:  200
  Duration:  15s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   20.69ms   28.30ms   31.00ms   40.90ms   47.60ms

  2824975 requests in 15.00s, 2822125 responses
  Throughput: 188.11K req/s
  Bandwidth:  69.32MB/s
  Status codes: 2xx=2822125, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 2822124 / 2822125 responses (100.0%)
  Reconnects: 12068
  Per-template: 102077,108794,126068,135303,152585,156516,155791,156739,156698,156769,156165,156619,157109,155815,155794,155970,148730,121795,104493,102294
  Per-template-ok: 102077,108794,126068,135303,152585,156516,155791,156739,156698,156769,156165,156619,157109,155815,155794,155970,148730,121795,104493,102294
[info] CPU 4555.4% | Mem 10.6GiB

[run 3/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  200
  Templates: 20
  Expected:  200
  Duration:  15s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   20.59ms   28.40ms   31.10ms   40.60ms   45.90ms

  2844981 requests in 15.00s, 2842133 responses
  Throughput: 189.44K req/s
  Bandwidth:  69.74MB/s
  Status codes: 2xx=2842133, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 2842133 / 2842133 responses (100.0%)
  Reconnects: 12106
  Per-template: 102998,109733,127221,136491,152999,158130,157386,157288,157511,157684,157121,157322,157952,157283,157755,157652,149019,122318,105263,103007
  Per-template-ok: 102998,109733,127221,136491,152999,158130,157386,157288,157511,157684,157121,157322,157952,157283,157755,157652,149019,122318,105263,103007
[info] CPU 4658.5% | Mem 10.0GiB

=== Best: 189475 req/s (CPU: 4658.5%, Mem: 10.0GiB) ===
[info] input BW: 16.26MB/s (avg template: 90 bytes)
[info] saved results/crud/4096/aleph.json
httparena-bench-aleph
httparena-bench-aleph
[info] skip: aleph does not subscribe to baseline-h2
[info] skip: aleph does not subscribe to static-h2
[info] skip: aleph does not subscribe to baseline-h2c
[info] skip: aleph does not subscribe to json-h2c
[info] skip: aleph does not subscribe to baseline-h3
[info] skip: aleph does not subscribe to static-h3
[info] skip: aleph does not subscribe to gateway-64
[info] skip: aleph does not subscribe to gateway-h3
[info] skip: aleph does not subscribe to production-stack
[info] skip: aleph does not subscribe to unary-grpc
[info] skip: aleph does not subscribe to unary-grpc-tls
[info] skip: aleph does not subscribe to stream-grpc
[info] skip: aleph does not subscribe to stream-grpc-tls
[info] skip: aleph does not subscribe to echo-ws
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/api-16-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/api-4-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/async-db-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/crud-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-16384.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-tls-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-6800.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-32.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
httparena-postgres
httparena-redis
[info] restoring loopback MTU to 65536
[info] restoring CPU governor → powersave

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant