assetopsbench

SmartGridBench: a smart-grid transformer-maintenance benchmark for tool-using LLM agents, built on IBM AssetOpsBench with MCP/direct-call tool surfaces.

[L3 ASSET] A2B — AssetOpsBench Bridge. IJCAI-25. Constitutional governance benchmarks for industrial AI.

Performance-profiling framework for IBM's AssetOpsBench multi-agent system: times every tool call and LLM token across two orchestrators and 20 industrial scenarios to find where agents spend their time. Groundwork for an inference-optimization study (Columbia HPML).

SmartGridBench: a smart-grid transformer-maintenance benchmark for tool-using LLM agents, built on IBM AssetOpsBench with MCP/direct-call tool surfaces.

Trajectory-level hallucination detection for multi-agent LLM workflows in industrial maintenance. Introduces Trajel, 225 expert-annotated agent trajectories with a five-type hallucination taxonomy, plus LLM-as-a-judge and BERT/NLI/Longformer detectors. Built on IBM Research's AssetOpsBench.