couler: Couler is a system for unified machine learning workflow optimization in the cloud, offering a consistent interface across various workflow engines like Argo Workflows, Tekton Pipelines, and Apache Airflow. It enhances efficiency through features such as autonomous construction, artifact caching, and auto-parallelism optimization, though it primarily supports Argo Workflows currently.; dagster: Dagster is a data orchestrator purpose-built for data platforms in the MLOps era, helping users define, develop, and operate data assets. It offers a powerful programming model, local development experience, and a robust UI for observing and debugging pipelines in production.
Simplifying and unifying machine learning workflow development across diverse cloud engines.
Building reliable data platforms