AgentIndex icon
AgentIndex
ToolsMCP ServersHOTCategoriesTrendingNewBest ListsCompareGuides
Submit Tool
ToolsMCP ServersHOTCategoriesTrendingNewBest ListsCompareGuides
Home/
Workflow Automation/
dagster
dagster logo

dagster

Active·★ 16.3k·Apache-2.0·Updated 2026-10-27
★ Most Popular★ Essential★ Trending

Dagster is a data pipeline orchestrator for the whole development lifecycle. Instead of wiring up tasks, you declare the data assets you want (tables, datasets, ML models, reports) as Python functions with the `@dg.asset` decorator, and Dagster works out dependencies from function arguments and runs them at the right time to keep the assets up to date. The README's example builds three assets, a DataFrame, a scikit-learn model and a stats table, that load as a graph in the web UI.

It is meant to be used from local development and unit tests through staging to production. The README describes three roles: a productivity platform (reusable components, early data-quality checks), an orchestration engine (multi-tenant, multi-tool) and a control plane (metadata, cataloging, lineage and diagnostics in one place), plus a library of integrations with common data tools. Python 3.9 to 3.14 is supported, and it installs from PyPI (for example `uv add dagster dagster-webserver dagster-dg-cli`).

It is a data-engineering tool rather than an AI-agent tool, but it is widely used to orchestrate ML and data workflows. This review is based on the README and repository data; we have not run it ourselves.

This write-up is based on the project's README and public repository data. We have not hand-tested the tool. Data as of 2026-10-27.

License
Apache-2.0
Latest release
1.13.27 · 2026-10-26
Last commit
2026-10-27
Contributors
707
Forks
2,381
Open issues and PRs
2,620
First published
2018-04-30
PyPI package
dagster 1.13.27 · 2,345,341 downloads last week

Source: GitHub, npm and PyPI public APIs.

#Data Orchestration#MLOps#Data Pipelines#ETL#Python#Coding#Data Analysis
$ Install
$ pip install dagster dagster-webserver
↗ Visit site★ GitHub
01

Features

01Software-defined Assets
02Declarative Programming Model
03Powerful Local Development
04Robust Operational UI (Dagit)
05Extensive Integrations
02

Why choose it

+Asset-based model: declare data assets as Python functions and dependencies come from function arguments
+Meant for every stage, from local dev and unit tests to staging and production
+Built-in lineage, cataloging and observability, with metadata kept in one control plane
+Library of integrations for common data tools, installable from PyPI under Apache-2.0
03

Trade-offs

!A data-engineering orchestrator, not an AI agent framework; you need to learn its asset, resource and deployment concepts
!Running it in production means operating the webserver and daemon yourself (or using the vendor's hosted offering, which the README does not price)
!The README is mostly high-level feature copy plus one example, so you will need the docs site for real setup details
05

Maintenance check

ActiveChecked: 2026-10-23
Last commit
2026-10-22
Commits, last 90 days
100+
Releases, last 90 days
11
Latest release
1.13.26 (2026-10-09)
Open issues
2610
Recent issues with at least one comment
3/13
Commits per week, last 12 weeks
Commits per week, last 12 weeks: 29, 14, 18, 37, 48, 28, 34, 52, 44, 70, 14, 19

Oldest week on the left; the latest four weeks are orange. Source: GitHub commit activity.

Status rule: archived on GitHub = Archived; last commit within 90 days = Active; 91 to 365 days = Slowing; older = Stale. All figures come from the GitHub API on the date shown.

Most discussed open issues

  • #2219 Support Auth & RBAC in Dagit87 comments · 2020-02-27
  • #17005 Partitioned asset checks69 comments · 2023-10-04
  • #21655 Sqlmesh integration51 comments · 2024-05-06
  • #20325 Dagster uses an implausible number of postgresql connections42 comments · 2024-03-07
  • #22553 Global asset page not showing partitioned assets as unsynced even though partitions are out of sync32 comments · 2024-06-14

Issue titles are quoted from GitHub. Open the link to check whether a problem still applies to the version you use.

04

Who it fits

Pick it if
  • You need an asset-centric data and AI orchestration platform that tracks data dependencies, partition lineages, and observability in Python.
  • You want local development ergonomics, declarative asset definitions, and unified orchestration across dbt, ML models, and data pipelines.
Look elsewhere if
  • You need simple, lightweight agent conversation loops; Dagster is an enterprise data engineering orchestrator, not a chat bot loop.
  • You need durable function workflows with arbitrary sleeps and human-in-the-loop approvals without asset abstractions; Temporal is simpler for that.
06

How it differs

temporal logovs temporal★ 24.0k

Dagster is built around asset-oriented pipelines, data lineage, and MLOps batch/streaming data awareness. Temporal is built around general-purpose durable execution of arbitrary code workflows with event-driven state recovery.

Full comparison →
07

Compatibility

Snowflake
Supported
Verified via docs
Spark
Supported
Verified via docs
Kubernetes
Supported
Verified via docs
dbt
Supported
Verified via docs
Airbyte
Supported
Verified via docs
Scikit-learn
Supported
Verified via docs
08

Quick start

1
$ pip install dagster dagster-webserver
09

Use cases

↳Building reliable data platforms
↳Developing MLOps workflows
↳Automating data analytics and reporting
10

Alternatives

⚡Top VS:
VStemporal★24.0k→VSFlashLearn★608→VSbudibase★28.4k→VSn8n★208.8k→
temporal logo
temporal★ 24.0k
Temporal is a durable execution platform: it runs workflows reliably, automatically handling intermittent failures and retrying failed operations, so long-running applications and AI agents survive crashes and restarts.
VSCompare→
FlashLearn logo
FlashLearn★ 608
Integrate LLM in any pipeline - fit/predict pattern, JSON driven flows, and built in concurency support.
VSCompare→
budibase logo
budibase★ 28.4k
Create business apps and automate workflows in minutes. Supports PostgreSQL, MySQL, MariaDB, MSSQL, MongoDB, Rest API, Docker, K8s, and more 🚀 No code / Low code platform..
VSCompare→
n8n logo
n8n★ 208.8k
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.
VSCompare→
flow-like logo
flow-like★ 967
Flow-Like: Strongly Typed Enterprise Scale Workflows. Built for scalability, speed, seamless AI integration and rich customization.
VSCompare→
Flowise logo
Flowise★ 55.5k
Visual builder for AI agents and LLM workflows. Discontinued: the repository was archived in August 2026 and the project reached end of life on August 31, 2026.
VSCompare→
MindsHub (formerly MindsDB) logo
MindsHub (formerly MindsDB)★ 39.8k
MindsHub (formerly MindsDB) is an agent workspace for knowledge work and software development, with connected data sources, a model router across frontier and open models, open-source agent harnesses, and publishable artifacts.
VSCompare→
ToolJet logo
ToolJet★ 41.1k
ToolJet is the open-source foundation of ToolJet AI - the AI-native platform for building internal tools, dashboard, business applications, workflows and AI agents 🚀
VSCompare→
See all alternatives →

Comments

Log in to leave a comment

No comments yet. Be the first!

On this page
01Features02Why choose it03Trade-offs05Maintenance check04Who it fits06How it differs07Compatibility08Quick start09Use cases10Alternatives
dagster-io /
dagster
↗

Apache-2.0 Python orchestrator that models pipelines as declared data assets, with lineage and observability built in

16.3k2.4kApache-2.0
Last commit1d ago
StatusActive
CategoryWorkflow Automation
Contributors707
Latest release1.13.27
Links
Documentation↗Discussion↗Issues↗Releases↗
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
© 2026 AgentIndex.app|Built by a 10-year iOS Developer.
Best by use caseAboutContactAdvertisePrivacy PolicyTerms of UseQYSGitHubBuy me a coffee ☕

Browse by Category

MCP ServersCode AssistantWorkflow AutomationRAG / Knowledge BaseMulti-AgentBrowser AutomationLLM InfraDev ToolingObservability

Not affiliated with Anthropic, OpenAI or Microsoft.