Skip to content

[ruby] Upgrade to 4.1.0-preview - #1571

Draft
p8 wants to merge 2 commits into
MDA2AV:mainfrom
p8:ruby-4.1-preview
Draft

p8 wants to merge 2 commits into
MDA2AV:mainfrom
p8:ruby-4.1-preview

Conversation

@p8

@p8 p8 commented Oct 16, 2026

Copy link
Copy Markdown
Contributor

No description provided.

@p8
p8 force-pushed the ruby-4.1-preview branch 8 times, most recently from aca8767 to 69c6a62 Compare October 16, 2026 07:48
@p8
p8 force-pushed the ruby-4.1-preview branch from 69c6a62 to c7ba0c8 Compare October 16, 2026 07:50
@p8

p8 commented Oct 16, 2026

Copy link
Copy Markdown
Contributor Author

/benchmark-multiple

@github-actions

Copy link
Copy Markdown
Contributor

👋 Benchmark request received. A collaborator will review and approve the run.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmark Results

Frameworks: 5 | Test: all tests

✅ hanami

Test Conn RPS Rate CPU/req p99 p99.9 CPU Mem Δ RPS Δ Mem
baseline 4096 44,331 — — — — 4309.7% 3.7GiB -0.1% +23.3%
pipelined 4096 613,117 — — — — 6113.2% 3.8GiB -3.1% +72.7%
limited-conn 4096 34,230 — — — — 3285.7% 3.7GiB -5.2% +27.6%
json-comp 4096 57,207 — — — — 5304.8% 2.8GiB -32.4% -20.0%
json-comp 16384 59,113 — — — — 5219.3% 3.0GiB -29.3% -21.1%
json-tls 4096 117,292 — — — — 6388.1% 6.3GiB +1.7% +28.6%
8gbit 512 49,331 0.9866 640.54us 15060.0us 24312.0us 3175.9% 5.1GiB ~0% +4.1%
latency-1m 1024 126,036 0.1260 ⚠️ 405.92us 17326080.0us 17653760.0us 4931.5% 6.5GiB -13.3% +124.1%
latency-10k 1024 9,982 0.9982 433.24us 1209.0us 9100.0us 417.4% 4.3GiB ~0% +65.4%
latency-500k-8cpu 1024 23,090 0.0462 ⚠️ 344.67us 18849792.0us 19030016.0us 759.7% 1.1GiB +9.8% +109.8%
async 32000 23,885 — — — — 673.3% 4.2GiB +0.6% -28.8%

✅ rack-iodine

Test Conn RPS Rate CPU/req p99 p99.9 CPU Mem Δ RPS Δ Mem
baseline 4096 133,004 — — — — 4808.3% 4.8GiB +111.7% -2.0%
pipelined 4096 2,422,401 — — — — 6502.0% 5.5GiB +4.0% +19.6%
limited-conn 4096 58,342 — — — — 4855.5% 5.0GiB -1.4% +6.4%
latency-1m 1024 995,041 0.9950 56.20us 858.0us 47824.0us 6071.6% 5.7GiB ~0% +29.5%
latency-10k 1024 9,950 0.9950 74.03us 168.0us 23976.0us 96.9% 4.6GiB ~0% +7.0%

✅ rails

Test Conn RPS Rate CPU/req p99 p99.9 CPU Mem Δ RPS Δ Mem
baseline 4096 28,255 — — — — 6056.4% 4.2GiB -16.3% -44.7%
pipelined 4096 317,686 — — — — 6251.2% 3.9GiB +4.1% +56.0%
limited-conn 4096 25,669 — — — — 6085.1% 4.0GiB -6.9% -38.5%
json-comp 4096 49,528 — — — — 4402.3% 3.0GiB -40.2% -25.0%
json-comp 16384 53,501 — — — — 5171.8% 3.2GiB -35.8% -27.3%
json-tls 4096 29,566 — — — — 2224.0% 4.7GiB -74.3% -11.3%
8gbit 512 49,243 0.9849 628.96us 29384.0us 40016.0us 3211.1% 5.1GiB -0.1% -7.3%
async-db 1024 33,704 — — — — 3555.8% 4.0GiB -53.8% +11.1%
latency-1m 1024 41,051 0.0411 ⚠️ 455.95us 18898944.0us 19259392.0us 1848.4% 4.4GiB -74.4% -13.7%
latency-10k 1024 9,982 0.9982 440.40us 1685.0us 19032.0us 423.9% 5.1GiB ~0% +27.5%
latency-500k-8cpu 1024 7,191 0.0144 ⚠️ 357.08us 19406848.0us 19652608.0us 254.9% 676MiB -68.7% -22.7%
async 32000 14,771 — — — — 1031.5% 4.0GiB -11.2% -7.0%

✅ roda

Test Conn RPS Rate CPU/req p99 p99.9 CPU Mem Δ RPS Δ Mem
baseline 4096 66,562 — — — — 4096.8% 3.4GiB -22.0% -33.3%
pipelined 4096 666,082 — — — — 5827.9% 3.4GiB -5.1% +54.5%
limited-conn 4096 39,283 — — — — 2758.5% 4.0GiB -0.4% +25.0%
json-comp 4096 81,338 — — — — 5181.9% 2.3GiB -43.7% -55.8%
json-comp 16384 81,617 — — — — 5307.0% 2.5GiB -42.9% -55.4%
json-tls 4096 209,095 — — — — 6448.5% 6.5GiB -9.0% -17.7%
8gbit 512 49,284 0.9857 326.41us 7334.0us 20456.0us 1660.6% 5.0GiB -0.2% -28.6%
static-tls 1024 32,258 — — — — 2605.9% 3.5GiB -71.1% -45.3%
async-db 1024 64,038 — — — — 4257.8% 3.2GiB +1.5% +14.3%
latency-1m 1024 224,509 0.2245 ⚠️ 176.97us 15388672.0us 15863808.0us 3983.1% 5.3GiB -40.3% -3.6%
latency-10k 1024 9,986 0.9986 199.65us 677.0us 5486.0us 192.8% 4.7GiB ~0% +20.5%
latency-500k-8cpu 1024 56,890 0.1138 ⚠️ 132.47us 17522688.0us 17702912.0us 727.1% 1.2GiB -8.3% -14.3%
async 32000 24,190 — — — — 557.4% 3.8GiB +0.9% -32.1%

✅ sinatra

Test Conn RPS Rate CPU/req p99 p99.9 CPU Mem Δ RPS Δ Mem
baseline 4096 52,345 — — — — 4219.6% 3.4GiB -8.0% -27.7%
pipelined 4096 446,006 — — — — 5938.3% 2.8GiB -6.8% +33.3%
limited-conn 4096 40,337 — — — — 3132.8% 4.0GiB -1.0% -7.0%
json-comp 4096 41,054 — — — — 3462.4% 2.3GiB -67.7% -50.0%
json-comp 16384 39,222 — — — — 2896.2% 2.7GiB -68.7% -43.7%
json-tls 4096 167,209 — — — — 6287.6% 5.8GiB -12.1% -15.9%
8gbit 512 49,234 0.9847 338.27us 9676.0us 19448.0us 1650.0% 5.0GiB -0.3% -26.5%
static-tls 1024 20,428 — — — — 6476.3% 3.7GiB -6.2% -46.4%
async-db 1024 53,278 — — — — 3777.3% 3.5GiB -51.2% +9.4%
latency-1m 1024 179,044 0.1790 ⚠️ 227.95us 16281600.0us 16756736.0us 4022.5% 5.3GiB -37.2% -26.4%
latency-10k 1024 9,983 0.9983 248.38us 824.0us 10004.0us 236.5% 4.7GiB ~0% +9.3%
latency-500k-8cpu 1024 44,255 0.0885 ⚠️ 177.26us 17997824.0us 18194432.0us 754.9% 1.3GiB -6.3% +18.2%
async 32000 17,303 — — — — 689.5% 3.5GiB -2.8% -23.9%

@p8

p8 commented Oct 16, 2026

Copy link
Copy Markdown
Contributor Author

/benchmark-multiple --save

@github-actions

Copy link
Copy Markdown
Contributor

👋 Benchmark request received. A collaborator will review and approve the run.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmark Results

Frameworks: 5 | Test: all tests

✅ hanami

Test Conn RPS Rate CPU/req p99 p99.9 CPU Mem Δ RPS Δ Mem
baseline 4096 43,750 — — — — 4465.7% 3.9GiB -1.4% +30.0%
pipelined 4096 599,538 — — — — 6067.3% 3.5GiB -5.2% +59.1%
limited-conn 4096 34,991 — — — — 3515.4% 3.5GiB -3.1% +20.7%
json-comp 4096 58,202 — — — — 5186.0% 2.8GiB -31.2% -20.0%
json-comp 16384 59,611 — — — — 5327.3% 2.9GiB -28.7% -23.7%
json-tls 4096 116,252 — — — — 6291.6% 6.3GiB +0.8% +28.6%
8gbit 512 49,229 0.9846 618.82us 14548.0us 23928.0us 3172.4% 5.2GiB -0.1% +6.1%
latency-1m 1024 125,462 0.1255 ⚠️ 410.38us 17342464.0us 17735680.0us 5068.1% 6.7GiB -13.7% +131.0%
latency-10k 1024 9,982 0.9982 426.28us 1137.0us 11572.0us 413.1% 4.5GiB ~0% +73.1%
latency-500k-8cpu 1024 23,150 0.0463 ⚠️ 344.40us 18849792.0us 19030016.0us 764.9% 1.1GiB +10.1% +109.8%
async 32000 23,781 — — — — 692.8% 4.2GiB +0.2% -28.8%

✅ rack-iodine

Test Conn RPS Rate CPU/req p99 p99.9 CPU Mem Δ RPS Δ Mem
baseline 4096 63,258 — — — — 4796.3% 4.8GiB +0.7% -2.0%
pipelined 4096 2,317,519 — — — — 6516.0% 5.5GiB -0.5% +19.6%
limited-conn 4096 59,161 — — — — 4742.2% 5.0GiB ~0% +6.4%
latency-1m 1024 995,312 0.9953 56.06us 824.0us 46928.0us 6044.5% 5.8GiB ~0% +31.8%
latency-10k 1024 9,946 0.9946 78.11us 238.0us 30920.0us 100.8% 4.6GiB ~0% +7.0%

✅ rails

Test Conn RPS Rate CPU/req p99 p99.9 CPU Mem Δ RPS Δ Mem
baseline 4096 28,694 — — — — 6054.8% 4.4GiB -15.0% -42.1%
pipelined 4096 315,374 — — — — 6227.4% 3.9GiB +3.3% +56.0%
limited-conn 4096 25,572 — — — — 5952.0% 4.0GiB -7.2% -38.5%
json-comp 4096 49,405 — — — — 5286.1% 2.9GiB -40.4% -27.5%
json-comp 16384 51,108 — — — — 4989.4% 3.2GiB -38.7% -27.3%
json-tls 4096 29,665 — — — — 2189.3% 4.8GiB -74.2% -9.4%
8gbit 512 49,397 0.9879 617.01us 30088.0us 39088.0us 2912.2% 5.1GiB +0.2% -7.3%
async-db 1024 37,876 — — — — 3798.5% 4.1GiB -48.1% +13.9%
latency-1m 1024 40,249 0.0402 ⚠️ 459.25us 18931712.0us 19275776.0us 1901.7% 4.3GiB -74.9% -15.7%
latency-10k 1024 9,982 0.9982 443.68us 1877.0us 18312.0us 426.6% 5.0GiB ~0% +25.0%
latency-500k-8cpu 1024 6,480 0.0130 ⚠️ 364.63us 19439616.0us 19701760.0us 235.9% 658MiB -71.8% -24.8%
async 32000 14,891 — — — — 1039.6% 4.0GiB -10.4% -7.0%

✅ roda

Test Conn RPS Rate CPU/req p99 p99.9 CPU Mem Δ RPS Δ Mem
baseline 4096 64,420 — — — — 4107.6% 3.4GiB -24.5% -33.3%
pipelined 4096 665,297 — — — — 6021.0% 3.2GiB -5.2% +45.5%
limited-conn 4096 39,015 — — — — 2713.2% 3.9GiB -1.1% +21.9%
json-comp 4096 82,211 — — — — 5055.3% 2.3GiB -43.1% -55.8%
json-comp 16384 81,196 — — — — 4835.4% 2.6GiB -43.1% -53.6%
json-tls 4096 208,100 — — — — 6355.9% 6.8GiB -9.4% -13.9%
8gbit 512 49,324 0.9865 340.34us 7014.0us 18536.0us 1608.4% 4.9GiB ~0% -30.0%
static-tls 1024 32,348 — — — — 2530.0% 3.3GiB -71.1% -48.4%
async-db 1024 37,598 — — — — 3037.5% 2.9GiB -40.4% +3.6%
latency-1m 1024 225,995 0.2260 ⚠️ 176.74us 15421440.0us 15970304.0us 3923.7% 5.4GiB -39.9% -1.8%
latency-10k 1024 9,982 0.9982 197.29us 674.0us 9964.0us 191.7% 4.5GiB ~0% +15.4%
latency-500k-8cpu 1024 56,396 0.1128 ⚠️ 132.86us 17539072.0us 17752064.0us 725.2% 1.1GiB -9.1% -21.4%
async 32000 24,199 — — — — 570.6% 3.8GiB +0.9% -32.1%

✅ sinatra

Test Conn RPS Rate CPU/req p99 p99.9 CPU Mem Δ RPS Δ Mem
baseline 4096 51,628 — — — — 4208.3% 3.3GiB -9.3% -29.8%
pipelined 4096 457,282 — — — — 6144.7% 3.1GiB -4.4% +47.6%
limited-conn 4096 38,744 — — — — 2871.3% 3.8GiB -4.9% -11.6%
json-comp 4096 41,139 — — — — 3105.6% 2.3GiB -67.7% -50.0%
json-comp 16384 38,585 — — — — 2808.3% 2.7GiB -69.2% -43.7%
json-tls 4096 167,501 — — — — 6165.5% 5.9GiB -11.9% -14.5%
8gbit 512 49,326 0.9865 368.75us 10420.0us 19464.0us 1831.2% 5.1GiB -0.1% -25.0%
static-tls 1024 20,234 — — — — 6474.1% 3.5GiB -7.1% -49.3%
async-db 1024 50,312 — — — — 3692.4% 3.5GiB -53.9% +9.4%
latency-1m 1024 177,785 0.1778 ⚠️ 228.79us 16314368.0us 16867328.0us 3967.8% 5.6GiB -37.7% -22.2%
latency-10k 1024 9,982 0.9982 247.10us 780.0us 7970.0us 237.0% 4.7GiB ~0% +9.3%
latency-500k-8cpu 1024 44,006 0.0880 ⚠️ 178.23us 18014208.0us 18210816.0us 752.5% 1.1GiB -6.8% ~0%
async 32000 17,323 — — — — 700.8% 3.6GiB -2.7% -21.7%

@p8

p8 commented Oct 16, 2026

Copy link
Copy Markdown
Contributor Author

Strange, I'm seeing too many connection errors. Trying this in a seperate PR for a single framework.

@p8
p8 marked this pull request as draft October 16, 2026 15:58

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant