[Gasoonjia]

Stacked on #24050.

Every CUDA method load that binds FQN weights next to an off-graph KV cache printed one AOTI warning line per KV buffer:

[WARNING] Found constant or module state buffer or empty module state parameter __et_offgraph_kv_layer_0_k in model, but not provided by user!

The unittest-cuda-muse-glimmer-batching log contains 1672 of these lines, out of 11650 lines total.

Why it happens. CudaWeightCache::load binds the weights with validate_full_update=true and intentionally leaves the off-graph KV buffers unbound, because the KV pool binds them later. AOTI's full-update check (assert_all_constants) allows absent buffers, but it writes a warning to stderr for each absent buffer on every load.

Fix.

• When the AOTI library exports AOTInductorModelContainerGetConstantType and AOTInductorModelContainerGetConstantFromFolded, ExecuTorch runs the same completeness rule itself. Folded constants, buffers, tensor constants, and empty parameters may be absent. Every other constant must be bound, otherwise load fails with InvalidProgram.
• Binding then runs with validate_full_update=false. In AOTI that flag only gates assert_all_constants, so nothing else about binding changes.
• If the library does not export those two APIs, load keeps validate_full_update=true as before.

Test plan:

• g++ -fsyntax-only on cuda_weight_cache.cpp and cuda_backend.cpp against the CUDA 12.6 headers.
• CI: the CUDA unittest jobs and the muse-glimmer batching job should pass, and their logs should no longer contain the __et_offgraph_kv_ warnings.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/24052

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 8 Pending

As of commit 64ca607 with merge base 8d9eec3 ():

NEW FAILURE - The following job has failed:

• Test WebGPU Backend / test-webgpu / test-backend-linux (webgpu, operators) / linux-job (gh)
  curl: (22) The requested URL returned error:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[linux-foundation-easycla]

The committers listed above are authorized under a signed CLA.

• ✅ login: Gasoonjia / name: gasoonjia (64ca607)