Skip to content

Enable 56 validation scenes that now pass - #1933

Merged
bkaradzic-microsoft merged 1 commit into
BabylonJS:masterfrom
bkaradzic-microsoft:enable-passing-validation-tests
Oct 13, 2026
Merged

bkaradzic-microsoft merged 1 commit into
BabylonJS:masterfrom
bkaradzic-microsoft:enable-passing-validation-tests

Conversation

@bkaradzic-microsoft

@bkaradzic-microsoft bkaradzic-microsoft commented Oct 13, 2026 •

Copy link
Copy Markdown
Member

Enables 56 validation scenes that pass after #1926. Only Apps/Playground/Scripts/config.json changes.

How they were picked

  • Ran all 720 scenes one at a time with --include-excluded (Windows, D3D11, Release, Babylon.js 9.29 from npm), then re-ran the excluded scenes that passed twice more to confirm they pass every time.
  • Ran the full sequential suite, as CI does, on Windows D3D11 and on Linux OpenGL (WSL, clang, JavaScriptCore, xvfb + llvmpipe).

Scenes enabled everywhere except OpenGL (excludedGraphicsApis: ["OpenGL"])

  • Prepass + mirror 291/292 and Prepass SSAO 298, 301, 303, 310: llvmpipe aborts with LLVM ERROR: Cannot emit physreg copy instruction. Prepass SSAO scenes that are already enabled are OpenGL-excluded for the same reason.
  • SubSurface Scattering 479: bgfx FrameBufferGL::resolve asserts in glDrawBuffers (the same bug as Screen Space Reflections 2).
  • FrameGraph nrge SSR neon 439 and multiple post processes 446: llvmpipe rejects the 4x MSAA render target format.
  • Pixel diff over tolerance on llvmpipe: LineEdgesRenderer 179, GLTF Serializer KHR materials clearcoat 218, Instanced Bones 256, MeshSimplification 264, Baked Vertex Animation 331, show-bounding-box 389, glTF Loader Cameras 420/421.

Still excluded, with updated reasons

  • Draco 202-204, 206 and 207, GLTF Serializer KHR draco 217, GLTF Buggy with Draco 232, and Node Geometry Building generator 147: createScene never resolves on JavaScriptCore (Linux CI) and JSI (Win32 CI), even when run alone; they pass on Chakra, V8 and QuickJS. The harness can't exclude per JS engine, so they stay excluded. 147 and 202-206 also get the leak-cleanup workaround, which fixes their order dependency in a full run.
  • screen-space-curvature 411: Hermes (Win32 CI) fails to import dragon.babylon.
  • GLTF Serializer camera rotation 227-230: they pass alone but fail after GLTF Serializer Rotation conversion, left-handed in a full run, and none of the existing workarounds fix it.

Testing

  • Windows D3D11 full run: 427 ran, 427 passed (was 371).
  • Linux OpenGL (WSL, JavaScriptCore) full run: 385 ran, 385 passed.

Copilot AI balanced review requested due to automatic review settings October 13, 2026 18:42

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

The configuration changes are sound; only a non-blocking stale explanation remains.

1 open finding
What changed in this PR

Enables 60 validation scenes that now pass following #1926 while retaining nine order-dependent exclusions.

Changes:

  • Re-enables 60 validation scenes.
  • Updates exclusion reasons for nine sequential-run failures.
File Description
Apps/​Playground/​Scripts/​config.json Updates validation-scene exclusions and reasons.

🧠 Review effort: Balanced


💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread Apps/Playground/Scripts/config.json Outdated
@bkaradzic-microsoft
bkaradzic-microsoft force-pushed the enable-passing-validation-tests branch 2 times, most recently from 8de5493 to 4c6a776 Compare October 13, 2026 21:47
@bkaradzic-microsoft bkaradzic-microsoft changed the title Enable 60 validation scenes that now pass Enable 57 validation scenes that now pass Oct 13, 2026
Enable the excluded validation scenes that pass in a full sequential run
after BabylonJS#1926. Only Apps/Playground/Scripts/config.json changes.

17 of them fail on Linux OpenGL CI (llvmpipe), so they get
excludedGraphicsApis ["OpenGL"]. Draco and WebAssembly scenes that hang
on JavaScriptCore and JSI stay excluded.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 60c2ec68-6de1-445d-9fc9-b699db737eae
@bkaradzic-microsoft
bkaradzic-microsoft force-pushed the enable-passing-validation-tests branch from 4c6a776 to 4d6bb1d Compare October 13, 2026 22:28
@bkaradzic-microsoft bkaradzic-microsoft changed the title Enable 57 validation scenes that now pass Enable 56 validation scenes that now pass Oct 13, 2026
@bkaradzic-microsoft
bkaradzic-microsoft enabled auto-merge (squash) October 13, 2026 23:02
@bkaradzic-microsoft
bkaradzic-microsoft merged commit 29d0c01 into BabylonJS:master Oct 13, 2026
35 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants