dagster: Dagster is a data orchestrator purpose-built for data platforms in the MLOps era, helping users define, develop, and operate data assets. It offers a powerful programming model, local development experience, and a robust UI for observing and debugging pipelines in production.; dagu: Dagu is a local-first, self-hosted control plane designed for existing operations automation and AI agent workflows. It allows defining complex pipelines in simple declarative YAML, executing them anywhere with a single binary, and distributing tasks across workers. It comes with a built-in Web UI for debugging and monitoring, eliminating the need for external databases or message brokers.
Building reliable data platforms
ETL and data operations: Turn data extraction scripts, SQL queries, dbt commands, and data-processing runbooks into observable pipelines.