Turns Data and AI algorithms into production-ready web applications in no time.

🧙 Build, run, and manage data pipelines for integrating and transforming data.

ZenML 🙏: MLOps for Reliable AI: from Classical AI to Agents. https://zenml.io.

The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

Elyra extends JupyterLab with an AI centric approach.

Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.

Azure DevOps Extension for Azure CLI

pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.

Lightweight fast function pipeline (DAG) creation in pure Python for scientific workflows 🕸️🧪

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

Train and run Pytorch models on Apache Spark.

The easiest way to use Machine Learning. Mix and match underlying ML libraries and data set sources. Generate new datasets or modify existing ones with ease.

Machine Learning eXchange (MLX). Data and AI Assets Catalog and Execution Engine

Toloka-Kit is a Python library for working with Toloka API.

Preprocessing of diffusion MRI

Small scale distributed training of sequential deep learning models, built on Numpy and MPI.

A library for composing end-to-end tunable machine learning pipelines.

使用open-webui中的pipelines技术在open-webui中调用ragflow的agent实现基于知识库的智能对话，并拥有美观的界面。

Data pipelines from re-usable components