Skip to content

A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)

License

Notifications You must be signed in to change notification settings

terrytangyuan/awesome-kubeflow

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

51 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Awesome Twitter Follow LinkedIn

Awesome Kubeflow

🔔 NEWS:

A curated list of awesome projects and resources related to Kubeflow, a Cloud Native Computing Foundation (CNCF) incubating project (announcement).

kubeflow

What is Kubeflow?

The Kubeflow project is dedicated to making deployments of machine learning (ML) workflows on Kubernetes simple, portable and scalable.

Table of Contents

Main projects in Kubeflow:

  • Kubeflow Main Repository which provides the front-end to access major components of Kubeflow.
  • Katib is a Kubernetes-native project for automated machine learning (AutoML).
  • Pipelines is dedicated to making deployments of machine learning workflows on Kubernetes simple, portable, and scalable with Kubeflow.
  • Training Operator provides Kubernetes custom resources that makes it easy to run distributed or non-distributed TensorFlow/PyTorch/Apache MXNet/XGBoost/MPI jobs on Kubernetes.
  • Arena is a CLI for Kubeflow.

Other open source projects that use or integrate with Kubeflow:

  • Argo Workflows is a container-native workflow engine for orchestrating parallel jobs on Kubernetes.
  • Couler provides a unified interface for constructing and managing workflows on different workflow engines.
  • deployKF effortlessly integrates Kubeflow and leading MLOps tools on Kubernetes into open ML platforms.
  • Kale is aims at simplifying the data science experience of deploying Kubeflow Pipelines workflows.
  • Kedro is an open-source Python framework for creating reproducible, maintainable and modular data science code.
  • KServe is a standardized serverless ML inference platform on Kubernetes.
  • MLRun is an open MLOps platform for quickly building and managing continuous ML applications across their lifecycle.
  • ModelDB is an open-source system to version machine learning models including their ingredients code, data, config, and environment and to track ML metadata across the model lifecycle.
  • Polyaxon is a platform for building, training, and monitoring large scale deep learning applications.
  • Seldon is an MLOps framework to package, deploy, monitor and manage thousands of production machine learning models.
  • SQLFlow extends SQL to support AI and compiles the SQL program to a workflow that runs on Kubernetes.
  • ZenML is a framework to build portable, production-ready MLOps pipelines.
  • Elyra is a set of AI-centric extensions to JupyterLab Notebooks, that contains a visual pipeline editor.
  • Pipeline Editor web app that allows the users to build and run Machine Learning pipelines using drag and drop. A VSCode extension can be found here.
  • WizStudio is a web based tool that allows the users to build Kubeflow pipelines using drag and drop interface.
  • Continuous Machine Learning with Kubeflow introduces you to the modern machine learning infrastructure, which includes Kubernetes and the Kubeflow architecture. This book will explain the fundamentals of deploying various AI/ML use cases with TensorFlow training and serving with Kubernetes and how Kubernetes can help with specific projects from start to finish.
  • 🔥[New!] Distributed Machine Learning Patterns teaches you how to take machine learning models from your personal laptop to large distributed clusters. You’ll explore key concepts and patterns behind successful distributed machine learning systems, and learn technologies like TensorFlow, Kubernetes, Kubeflow, and Argo Workflows with real-world scenarios and hands-on projects.
  • Kubeflow for Machine Learning: From Lab to Production helps data scientists build production-grade machine learning implementations with Kubeflow and shows data engineers how to make models scalable and reliable.
  • Kubeflow in Action: End-to-End Machine Learning is an authoritative hands-on guide to deploying machine learning to production using the Kubeflow MLOps platform.
  • Kubeflow Operations Guide: Managing Cloud and On-Premise Deployment shows data scientists, data engineers, and platform architects how to plan and execute a Kubeflow project to make their Kubernetes workflows portable and scalable.

Please check out the official Kubeflow Project blog. Additional blog posts:

Please check out the official Kubeflow YouTube channel.

Kubeflow Summit talks playlist

Additional videos

Social media accounts:

⬆ back to top