Repository navigation
feat(models): route XS writers to Claude Sonnet 5.5 high - #646
Conversation
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ap as a setting Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Warning Review limit reachedYou've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository. Next included review available in 57 minutes. View limit details
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. |
|
quest land watch: the merge queue removed this pull request at e80bee7 because it conflicts with The land fixer works on it in the background, and the watcher re-enqueues it at the back of the queue once it is fixed or judged flaky, or hands it back here with what it needs. (written by quest land watch) |
|
codex, gpt-6.1-sol, medium effort land fixer note:
(written by codex, gpt-6.1-sol, medium effort) |
|
codex, gpt-6.1-sol, medium effort land fixer: CONFLICT (content): Merge conflict in quest/m0/routing-evidence/writer-ab.md Auto-merging quest/m1/model-check.md Auto-merging src/cli/models.ts Automatic merge failed; fix conflicts and then commit the result. (written by codex, gpt-6.1-sol, medium effort) |
Summary
XS quests' first writer moves from
claude-haiku-5-5at xhigh toclaude-sonnet-5-5at high;gpt-6.1-sollow stays the fallback. Decided by the maintainer on 2026-11-11 in a /quest-run session.Why: two Haiku XS agents in a row on moq-dev/quest#643 died with Claude Code's "context refilled too quickly after compaction". The maintainer's settings cap Haiku's auto-compact window at 100k because Haiku 5.5 bills 5x past 100k input, and a quest agent's fixed load (system prompt,
quest context, skill, guide) is roughly 40-60k tokens. Sonnet 5.5 is flat priced ($2/$10 per MTok) over a 1M window. Rejected: raising Haiku's window to 200k, removing the cap, leaving it.Effort high (maintainer's pick over medium): Anthropic's cost guide shows Sonnet 5.5 medium about 7 points below high on its SWE-bench Pro subset and 15 below on its internal agentic-coding set, while Sonnet high matches Opus 5.5 low (87.6% vs 87.4%) at about the same cost per solved task. Artificial Analysis puts Sonnet high ahead of Opus low on Terminal-Bench 4.0.
Changes:
WRITERS.XSand its comment (the unusedhaikuhelper is replaced bysonnet), README routing table andquest modelsexample, the CLI test, and quest/m1/model-check.md's record (new 2026-11-11 entry; XS Sonnet high to be tallied fresh, since mypriors has no Sonnet high row). quest/m0/routing-evidence/writer-ab.md is left to the coordinator's own PR.Public API
quest models XSandquest unblocked --jsonnow listclaude-sonnet-5-5 highfirst for XS. No flag, schema, or wire change.Validation
quest gate just checkandquest gate just test: both exit 0 on the final head.just build):claude --helplists--effortwithhigh, but a liveclaude -p --model claude-sonnet-5-5run could not happen here (the sandbox's Claude CLI is not logged in), so the id is unverified against the live CLI.Review
Local
quest review --size Son c82ba13: Codex gpt-6.1-sol medium, score 10, 0 findings; opencode deepseek-v4.1-flash high, score 9, 2 low findings.Head e80bee7: fixed both. (1) The new model-check entry re-parented the Nov 9 Fable and S sub-bullets; moved it below them. (2) No Sonnet high benchmark row and the comment called the 100k cap a model property; the entry now marks the cell tally-only with the cost guide's numbers, and the comment names the cap as a user setting.
Head dc177ef: merged origin/main (#641, #644, #647) to clear the merge queue's
merge_conflict. The only conflict, quest/m0/routing-evidence/writer-ab.md, took main's version, which already routes XS to Sonnet 5.5 high in its A/B.git diff origin/main...HEADmatches the reviewed head's diff apart from blob indices, so the e80bee7 review covers it.quest gate just checkandquest gate just testpass.Models
Size: S
Implementer: Claude Code, claude-opus-5-5, low effort
Implementer: Claude Code, claude-opus-5-5, low effort (iterate, S)
🤖 Generated with Claude Code
(Written by Claude Opus 5.5 with low)