dagster: Dagster is a data orchestrator purpose-built for data platforms in the MLOps era, helping users define, develop, and operate data assets. It offers a powerful programming model, local development experience, and a robust UI for observing and debugging pipelines in production.; asya: Asya is a queue-based actor framework designed for orchestrating AI/ML workloads on Kubernetes, enabling independent scaling and dynamic pipelines. It allows data scientists to write pure Python functions while handling queues, routing, scaling, and monitoring with zero infrastructure code.
Building reliable data platforms
Multi-step AI/ML pipelines (e.g., document processing, image pipelines, LLM workflows).