AgentIndex icon
AgentIndex
ToolsMCP ServersHOTCategoriesTrendingNewBest ListsCompareGuides
Submit Tool
ToolsMCP ServersHOTCategoriesTrendingNewBest ListsCompare
Home/
Multi-Agent/
AssetOpsBench
AssetOpsBench logo

AssetOpsBench

Active·★ 2.4k·Apache-2.0·Updated 2026-10-20
★ Essential★ Trending

AssetOpsBench, published under IBM's GitHub organization, is a framework for developing, orchestrating and evaluating domain-specific AI agents for industrial asset operations and maintenance. It provides reproducible scenarios, agent tooling and evaluation pipelines for multi-step workflows in simulated industrial environments. The README's summary lists 9 asset classes, 141+ scenarios and 5 domain agents, and says the work was accepted to KDD 2026 (Datasets & Benchmarks track). Example tasks include listing the sensors of a chiller at a site (IoT) and identifying failure modes.

Domain-specific MCP servers expose the tools: IoT (sites, assets, sensors, history), failure-mode and sensor mapping (FMSR), time-series foundation models (forecasting and anomaly detection), work orders and vibration analysis (FFT and envelope spectra). Agent frameworks include Plan-Execute, Deep Agent, and ReAct orchestrators for Claude and OpenAI models. Setup is `git clone` and `pip install -e .`, with a Colab notebook and a Hugging Face playground for trying it without installing, and INSTRUCTIONS.md for MCP servers and the plan-execute runner. The README notes that active development is on `main`, while publication code stays on separate branches. It is Apache-2.0 licensed, with a paper and dataset linked.

© 2026 AgentIndex.app|Built by a 10-year iOS Developer.
Best by use caseAboutContactAdvertisePrivacy PolicyTerms of UseQYSGitHubBuy me a coffee ☕

Browse by Category

MCP ServersCode AssistantWorkflow AutomationRAG / Knowledge BaseMulti-AgentBrowser AutomationLLM InfraDev ToolingObservability

Not affiliated with Anthropic, OpenAI or Microsoft.

Guides

This write-up is based on the project's README and public repository data. We have not hand-tested the tool. Data as of 2026-10-18.

License
Apache-2.0
Latest release
No GitHub releases
Last commit
2026-10-18
Contributors
51
Forks
343
Open issues and PRs
48
First published
2025-05-01

Source: GitHub, npm and PyPI public APIs.

#AI Agents#Industrial AI#Benchmarking#Multi-Agent Systems#Industry 4.0#LLM Orchestration#Predictive Maintenance
$ Install
$ git clone https://github.com/IBM/AssetOpsBench.git && cd AssetOpsBench && pip install -e .
↗ Visit site★ GitHub
01

Features

01Unified framework for building, orchestrating, and evaluating domain-specific AI agents.
02Provides reproducible scenarios, agent tooling, and evaluation pipelines for multi-step workflows.
03Supports various domain-specific Model Context Protocol (MCP) servers (IoT, FMSR, TSFM, WO, Vibration).
04Includes multiple agent frameworks like Plan-Execute, Deep Agent, Claude Agent, and OpenAI Agent.
05Powered by LLMs and Time Series Foundation Models for industrial data analysis.
02

Why choose it

+Backed by a paper and dataset, with reproducible scenarios and evaluation pipelines
+Domain-specific MCP servers (IoT, work orders, vibration, time-series models) show how to wire agents to real industrial data
+Several agent frameworks to compare on the same scenarios
+Colab notebook and Hugging Face playground for trying it without installing
03

Trade-offs

!It is a research benchmark in simulated environments, not a ready-to-deploy maintenance product
!The README's quick-start scenario command is marked "to be enabled", so use the Colab notebook or INSTRUCTIONS.md to get running
!Code is split across branches (`main`, `main-0.x`, publication branches), so check which one matches a paper
!Narrow domain: useful mainly for industrial maintenance and benchmarking research
04

Maintenance check

ActiveChecked: 2026-10-22
Last commit
2026-10-13
Commits, last 90 days
100+
Releases, last 90 days
0
Latest release
—
Open issues
51
Recent issues with at least one comment
1/3
Commits per week, last 12 weeks
Commits per week, last 12 weeks: 0, 0, 7, 7, 1, 6, 14, 5, 4, 2, 2, 0

Oldest week on the left; the latest four weeks are orange. Source: GitHub commit activity.

Status rule: archived on GitHub = Archived; last commit within 90 days = Active; 91 to 365 days = Slowing; older = Stale. All figures come from the GitHub API on the date shown.

05

Compatibility

Python
Language
Verified via docs
LLM
Runtime
Verified via docs
Model Context Protocol (MCP)
Protocol
Verified via docs
Time Series Foundation Models
Runtime
Verified via docs
06

Quick start

1
$ git clone https://github.com/IBM/AssetOpsBench.git
2
$ cd AssetOpsBench
3
$ pip install -e .
07

Use cases

↳Assisting maintenance engineers and reliability specialists with operational queries.
↳Identifying failure modes and forecasting asset performance based on sensor data.
↳Automating work order generation and managing industrial asset operations.
↳Benchmarking and evaluating AI agent performance in complex industrial scenarios.
08

Alternatives

⚡Top VS:
VSag2★5.0k→VSadk-python★22.0k→VSagent-framework★14.3k→VS

Comments

Log in to leave a comment

No comments yet. Be the first!

On this page
01Features02Why choose it03Trade-offs04Maintenance check05Compatibility06Quick start

Most discussed open issues

  • #580 🔒 [IBM OSPO Security Notification] — IBM/AssetOpsBench11 comments · 2026-09-29
  • #632 ci: discuss a lightweight Python smoke check for pull requests4 comments · 2026-10-13
  • #645 iot__find_assets_by_sensors: unreachable error guard returns an opaque schema failure0 comments · 2026-10-16
  • #644 Refresh the main branch with aafeedback branch0 comments · 2026-10-16

Issue titles are quoted from GitHub. Open the link to check whether a problem still applies to the version you use.

spring-ai-alibaba
★11.1k
→
ag2 logo
ag2★ 5.0k
AG2 (formerly AutoGen): The Open-Source AgentOS. Join us at: https://discord.gg/sNGSwQME3x
VSCompare→
adk-python logo
adk-python★ 22.0k
An open-source, code-first Python toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
VSCompare→
agent-framework logo
agent-framework★ 14.3k
A framework for building, orchestrating and deploying AI agents and multi-agent workflows with support for Python and .NET.
VSCompare→
spring-ai-alibaba logo
spring-ai-alibaba★ 11.1k
Agentic AI Framework for Java Developers
VSCompare→
PraisonAI logo
PraisonAI★ 9.3k
PraisonAI is a production-ready Multi AI Agents framework, designed to create AI Agents to automate and solve problems ranging from simple tasks to complex challenges. It provides a low-code solution to streamline the building and management of multi-agent LLM systems, emphasising simplicity, customisation, and effective human-agent collaboration.
VSCompare→
solace-agent-mesh logo
solace-agent-mesh★ 4.9k
An event-driven framework designed to build and orchestrate multi-agent AI systems. It enables seamless integration of AI agents with real-world data sources and systems, facilitating complex, multi-step workflows.
VSCompare→
AWorld logo
AWorld★ 1.2k
Build, evaluate and train General Multi-Agent Assistance with ease
VSCompare→
codomyrmex logo
codomyrmex★ 11
Modular Python 3.11+ coding and agent platform — 130 modules spanning LLM agents (13+ providers), graph RAG, static analysis, git ops, cloud and container deployment, all exposed as 612 Model Context Protocol tools. uv-managed, 36k tests with a zero-mock policy.
VSCompare→
See all alternatives →
07
Use cases
08Alternatives
IBM /
AssetOpsBench
↗

Benchmark and framework for AI agents in industrial asset operations

2.4k343Apache-2.0
Last commit3d ago
StatusActive
CategoryMulti-Agent
Contributors51
Links
Documentation↗Discussion↗Issues↗Releases↗
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit