Skip to content

fix(report): include flows that fail before stage logs - #4677

Merged
vvbandeira merged 2 commits into
The-OpenROAD-Project:masterfrom
vvbandeira:orfs-report-incomplete-note
Oct 14, 2026
Merged

vvbandeira merged 2 commits into
The-OpenROAD-Project:masterfrom
vvbandeira:orfs-report-incomplete-note

Conversation

@vvbandeira

@vvbandeira vvbandeira commented Oct 14, 2026 •

Copy link
Copy Markdown
Member

When Make fails before the first stage, it can leave no variant log directory, so the final report omits the failed design.
Keep the Make log for that case and report that the flow did not reach the last stage, with the failure details.
Detect completion from the expected final-stage log instead of the last filename, and report empty log directories without a crash.

The missing-input regression now counts all three designs and lists both failing runs.
Tests also cover configured variants and design nicknames, successful reruns, auxiliary logs, and empty log directories.
Local validation: eight report tests, all utility test scripts (one existing skip), Bash syntax, and Black 26.5.1.
The missing-input failure was also reproduced with the real ORFS Makefile.

Signed-off-by: Vitor Bandeira <vvbandeira@precisioninno.com>

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the report generation logic in flow/util/genReport.py to explicitly indicate when a flow did not reach its last stage, and adds a corresponding unit test in flow/test/test_genReport.py. The review feedback suggests conditionally appending the last log file information only if data['last_log'] is not empty, preventing uninformative output when a flow fails extremely early before any logs are created.

Comment thread flow/util/genReport.py Outdated
Make can fail before it creates the variant log directory.
The summary then omits the failed design.

Save the Make log when no stage log exists.
Detect completion from the expected log, and handle empty log folders.

Add CLI regression coverage for the missing-input failure and reruns.

Signed-off-by: Vitor Bandeira <vvbandeira@precisioninno.com>
@vvbandeira vvbandeira changed the title fix(report): flag flows that miss the final stage fix(report): include flows that fail before stage logs Oct 14, 2026
@openroad-ci

openroad-ci commented Oct 14, 2026 •

Copy link
Copy Markdown
Member

🔍 QoR check

Metrics reflect the PR merge build — i.e. what will land on the target branch.

Commit 6436b88 · Jenkins build #2 · Baseline: build · View build on dashboard

62 design(s) checked — 0 with regression(s), 0 without a comparable baseline.

@vvbandeira
vvbandeira merged commit d4b9638 into The-OpenROAD-Project:master Oct 14, 2026
13 checks passed
@vvbandeira
vvbandeira deleted the orfs-report-incomplete-note branch October 14, 2026 18:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants