Skip to content

quest(ci): drop the queue-host disk quest - #7757

Merged
kixelated merged 8 commits into
mainfrom
quest/m0/ci/queue-host-disk
Nov 4, 2026
Merged

kixelated merged 8 commits into
mainfrom
quest/m0/ci/queue-host-disk

Conversation

@kixelated

@kixelated kixelated commented Nov 3, 2026 •

Copy link
Copy Markdown
Collaborator

Problem

The queue host keeps the queue's disk planned to stop agent sessions on the shared nixos host from filling the disk the merge queue needs. The maintainer has since judged it no longer worth the host redesign it would take.

Approach

Delete the quest with quest rm, which also removes its link from quest/m0/ci/README.md. The incident facts are kept below so they survive the deletion.

Decided 2026-11-03 (maintainer, on this PR): ✅ drop the quest / implement the settled Plan. Reasons:

  • The disk hasn't filled since 2026-10-30.
  • nixos has 215–246 GB free.
  • An agent-storage GC now runs on the host.

Reopen if the disk fills again. The last Plan, with measured peaks, the 340 GiB agent-cap sizing, and the open Nix-daemon question, is in git history at 5f6194c23b.

Incident record

  • On 2026-10-30 the host's root filesystem filled twice, at about 03:00 and 07:30 PDT. Roughly 480 GB of non-CI growth, later freed, has no attributed writer.
  • Queue checks ejected moq-dev/moq#6985 and moq-dev/moq#6999.
  • At 07:49 PDT the CI runner aborted and stayed down for 36 minutes.
  • The CI disk allowance in ci-storage.py (kixelated/nixos) is current CI usage plus physical free space minus a 32 GiB reserve. CI therefore fails once free space drops under 32 GiB, whoever consumed it.
  • Host config, GC, and runner-restart work live in kixelated/nixos#15 and kixelated/nixos#16.

Impact

  • Public API and wire: none.
  • Quest tree only. No host change, deployment, or quota change.

Validation

  • nix run .#quest -- check --base origin/main: 561 documents ok.
  • sh/markdown.sh check: passes.

Review

Codex gpt-6.1-sol (medium) reviewed head 2b796e6bc89e88c0acc5aa735d8b1205d9e13260 against origin/main (6647cda31b), round 2 of session 01a1a413-d084-7293-8f35-c347c4d58fde: no findings.

(Written by Claude Opus 5.5)

kixelated and others added 6 commits November 1, 2026 03:57
kixelated and others added 2 commits November 3, 2026 17:30
The maintainer dropped it on 2026-11-03: the disk has not filled since
2026-10-30, nixos has 215-246 GB free, and an agent-storage GC now runs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@kixelated kixelated changed the title The queue host keeps the queue's disk quest(ci): drop the queue-host disk quest Nov 4, 2026
@kixelated
kixelated marked this pull request as ready for review November 4, 2026 01:34
@coderabbitai

coderabbitai Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Warning

Review limit reached

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Next included review available in 13 minutes.

Check out review usage here.

View limit details

Limit details: You’ve used all 4 included reviews currently available.

Learn how review limits work.

Review configuration:

Run configuration
  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: Organization UI
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: f7d9203f-dc74-4898-868d-fffaf2d59e83
Commits

Reviewing files that changed from the base of the PR and between 2fd9bb5 and 2b796e6.

Files selected for processing: 2
  • quest/m0/ci/README.md
  • quest/m0/ci/queue-host-disk.md
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

Share

@pullfrog pullfrog Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ No new issues found.

Reviewed changes

  • Deleted quest/m0/ci/queue-host-disk.md — removes the 217-line quest that would have capped agent disk use on the shared queue host.
  • Removed its link from quest/m0/ci/README.md — the ## Required list no longer mentions the dropped quest.

No behavioral surface: this only touches the quest tree, the deleted file has no other references in the checkout (queue-host-disk grep is empty), and the README list stays well formed. The incident facts and the prior Plan reference are preserved in the PR body and git history, which matches the stated decision to drop the quest.

Pullfrog  | View workflow run | Using deepseek-v4.1-flash-1017 (free via Pullfrog for OSS) | 𝕏

@kixelated kixelated left a comment

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Automated review by review (OpenAI)

Reviewed head 2b796e6.

No actionable findings. The change removes the quest and its index entry following the recorded decision to drop the host redesign; the PR retains the incident context and a link to the prior plan. No host configuration is changed.

Verification: static GitHub-only review of the diff and quest references. I did not inspect the live host or run the checks.

(Written by review, OpenAI)

@kixelated
kixelated added this pull request to the merge queue Nov 4, 2026
Merged via the queue into main with commit 0f0b31b Nov 4, 2026
13 of 14 checks passed
@kixelated
kixelated deleted the quest/m0/ci/queue-host-disk branch November 4, 2026 03:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant