Skip to content

quest: audit memory retention and kernel settings - #6332

Merged
kixelated merged 7 commits into
mainfrom
codex/memory-kernel-audit-quests
Oct 22, 2026
Merged

kixelated merged 7 commits into
mainfrom
codex/memory-kernel-audit-quests

Conversation

@kixelated

Copy link
Copy Markdown
Collaborator

Problem

The performance survey needs coverage for memory after bursts, growth with historical usage, idle browser work and effective kernel/runtime settings. Source inspection identified concrete retention paths, but their production cost has not been measured.

Approach

Add eight benchmark-first quests: recycled QUIC receive state, UDP pool recovery, cache metadata capacity, shared backing amplification, idle browser stats, transport preference history, resume identity history and UDP socket queue/drop attribution. Extend the existing worker-default quest with NUMA, SMT and NIC placement experiments.

Require burst/quiet/reuse/teardown measurements that distinguish live allocations, allocator resident/retained memory and kernel queues. Preserve equivalent useful work, paired measurements, browser and physical-NIC validation where applicable, and nightly benchmark coverage. A measured no-win is valid. Document client versus relay-peer limits, already-enabled io_uring features, existing kernel experiment ownership and previously rejected ideas.

This follows moq-dev/moq#6318, which entered the merge queue before this follow-up could be pushed. Its commits are included as prerequisites until it lands; merge this follow-up after it. The combined survey has 23 child quests.

Impact

  • Public API and wire format: none; quest plans only.
  • No production defaults, package versions or performance thresholds change.
  • Findings are source-supported hypotheses, not measured memory leaks or claimed speedups.

Alternatives

Reuse existing receive-memory, QUIC I/O ownership, shard-default, keepalive and zero-copy-send quests. Do not duplicate the release audit or reopen busy polling without new profile evidence. Keep implementation and tuning decisions conditional on measurements.

Validation

  • just ci passes in the Nix environment.
  • quest check --base origin/main: 467 documents pass.
  • Whitespace checks pass; all repository links in the 25 surveyed documents resolve.
  • A second source review corrected client versus peer defaults and found no further factual issues in the new Rust memory plans.
  • No browser, memory-recovery or physical-NIC performance benchmarks were run in this planning change.

Follow-ups

The eight new quests and expanded worker-placement experiment are the requested follow-ups. No implementation contract or API choice is settled here.

(Written by GPT-6)

@coderabbitai

coderabbitai Bot commented Oct 22, 2026 •

Copy link
Copy Markdown
Contributor

Warning

Review limit reached

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Next included review available in 47 minutes.

Check out review usage here.

View limit details

Limit details: You’ve used all 4 included reviews currently available.

Learn how review limits work.

Review configuration:

⚙️ Run configuration
  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: Organization UI
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 31e5330a-1906-4852-a394-27d01ff1ac6c
📥 Commits

Reviewing files that changed from the base of the PR and between 540e683 and f7405e7.

📒 Files selected for processing: 9
  • quest/m2/perf/shard-default.md
  • quest/m2/performance-survey/README.md
  • quest/m2/performance-survey/browser-idle-stats.md
  • quest/m2/performance-survey/cache-backing.md
  • quest/m2/performance-survey/cache-metadata.md
  • quest/m2/performance-survey/quic-receive-reuse.md
  • quest/m2/performance-survey/resume-history.md
  • quest/m2/performance-survey/socket-queues.md
  • quest/m2/performance-survey/transport-history.md
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 22, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-22T22:36:58.765779Z f7405e7 New commits
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@kixelated
kixelated added this pull request to the merge queue Oct 22, 2026
@github-merge-queue
github-merge-queue Bot removed this pull request from the merge queue due to a conflict with the base branch Oct 22, 2026
kixelated and others added 2 commits October 22, 2026 13:39
# Conflicts:
#	quest/m2/README.md
#	quest/m2/performance-survey/README.md
#	quest/m2/performance-survey/quic-schedule-churn.md
The maintainer picked #6350's quest/m2/perf/uring-pool-memory.md over
uring-pools; socket-queues names that PR until it merges.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@kixelated
kixelated added this pull request to the merge queue Oct 22, 2026
@kixelated
kixelated removed this pull request from the merge queue due to a manual request Oct 22, 2026
kixelated and others added 2 commits October 22, 2026 15:33
#5878 finished and deleted quest/m1/quic/receive-memory.md.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@kixelated
kixelated added this pull request to the merge queue Oct 22, 2026
@kixelated
kixelated removed this pull request from the merge queue due to a manual request Oct 22, 2026
@kixelated
kixelated added this pull request to the merge queue Oct 22, 2026

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: f7405e7157

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".


For settings sweeps, record effective values, not only requested ones.
[Resolved client defaults](/rs/moq-tokio/src/quic.rs) currently allow 10,000
streams per direction, 64 MiB connection receive credit, 4 MiB per-stream

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Update the client receive-window default to 128 MiB

At the reviewed commit, rs/moq-tokio/src/quic.rs:119 defines DEFAULT_RECEIVE_WINDOW as 128 << 20, not 64 MiB. Because this paragraph establishes the effective baseline for subsequent settings sweeps, the incorrect value could cause experiments to compare against or explicitly configure the wrong baseline; update it to 128 MiB.

AGENTS.md reference: AGENTS.md:L32-L32

Useful? React with 👍 / 👎.

Merged via the queue into main with commit 7928b02 Oct 22, 2026
9 checks passed
@kixelated
kixelated deleted the codex/memory-kernel-audit-quests branch October 22, 2026 22:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant