Skip to content

Clarify the published performance results - #236

Merged
wallstop merged 1 commit into
test-parallel-remaining-casesfrom
docs-qualify-performance-baseline
Oct 14, 2026
Merged

wallstop merged 1 commit into
test-parallel-remaining-casesfrom
docs-qualify-performance-baseline

Conversation

@wallstop

@wallstop wallstop commented Oct 14, 2026 •

Copy link
Copy Markdown
Owner

DISCLOSURE: LLM-GENERATED TEXT

Why: The performance guide overstates search latency and describes a merged defect as current.

What:

  • Distinguish search medians from samples above 100 milliseconds.
  • Explain that the refresh timer excludes fixture creation.
  • Separate published sizes from the current driver's run set.
  • Link the merged import fix and its pending validation.

Refs #114, #226.


Note

Low Risk
Documentation-only edits to performance claims and gap notes; no runtime or test code changes.

Overview
Updates docs/performance.md so the published baseline matches what the harness actually measures and what the table proves.

The how numbers are produced section now states that PerfBaseline runs 100 / 1,000 / 10,000 assets while this page only publishes 100 and 1,000, and that fixture import times only the post-creation AssetDatabase.Refresh (not the CreateAsset loop).

Search first results no longer implies a blanket sub-100 ms acceptance win: it calls out medians under 100 ms but maxima above it (e.g. 235.1 ms at 100 assets), and notes that five samples are not a worst-case or p95 guarantee.

Current gaps for 10k is rewritten to reference the merged #228 fix for #226, while making clear that a post-fix 10k run and full Unity test validation are still pending and the existing table is pre-fix.

Reviewed by Cursor Bugbot for commit a64469c. Bugbot is set up for automated code reviews on this repo. Configure here.

The performance guide overstates the search result and describes a
merged production defect as current. Readers cannot distinguish the
recorded baseline from the missing post-fix validation.

State that medians are below 100 ms while both recorded maxima exceed
it. Distinguish the driver's three sizes from the two published sizes.
Explain that the fixture-refresh timer excludes CreateAsset calls,
verified against both the original baseline driver and current source.
Link the merged type-only relevance fix and its open validation issue.

All measurement and environment table lines match origin/main exactly.
check:fast and all nine applicable check:gate steps pass. The strict
MkDocs build passes; generated performance HTML contains the corrected
claims. Unity validation does not apply to these prose-only changes.
The host bridge remains unreachable, so no new measurement is claimed.

Refs #114, #226, #228.
@wallstop
wallstop changed the base branch from main to test-parallel-remaining-cases October 14, 2026 18:56
@wallstop
wallstop force-pushed the docs-qualify-performance-baseline branch from af25f69 to a64469c Compare October 14, 2026 18:56
@wallstop
wallstop added this pull request to stack #238 October 14, 2026 18:56
@wallstop
wallstop merged commit 51b37b8 into main Oct 14, 2026
5 of 9 checks passed
@wallstop
wallstop deleted the docs-qualify-performance-baseline branch October 14, 2026 19:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant