Kubeflow components

Kubeflow Pipelines

Platform to create machine learning workflows /schedules with containers ML Workflows and Schedules

https://www.kubeflow.org/docs/components/pipelines/ https://github.com/kubeflow/pipelines

Model registry

Model metadata

https://www.kubeflow.org/docs/components/model-registry/

Training Operator

Model Training and Fine-Tuning

https://www.kubeflow.org/docs/components/training/ https://github.com/kubeflow/training-operator

Katib

Model tuning. Model Optimization and AutoML automated machine learning (AutoML)

https://www.kubeflow.org/docs/components/katib/

KServe

Model Serving

https://www.kubeflow.org/docs/external-add-ons/kserve/ https://github.com/kserve/kserve https://kserve.github.io/website

Kubeflow MPI Operator

All-Reduce Model Training

https://www.kubeflow.org/docs/components/training/user-guides/mpi/ https://github.com/kubeflow/mpi-operator

Spark Operator

Data Preparation (run spark applications)

https://www.kubeflow.org/docs/scomponents/spark-operator/ https://github.com/kubeflow/spark-operator https://kubeflow.github.io/spark-operator/

Other

Kubeflow Notebooks (web-based development environments)

For interactive data exploration and model development, provides a way to run web-based development environments inside your Kubernetes cluster by running them inside Pods.

• https://www.kubeflow.org/docs/components/notebooks/

Central Dashboard (to the kubeflow ecosystem)

For easy navigation and management with Kubeflow Profiles for access control.

• https://www.kubeflow.org/docs/components/central-dash/
• https://github.com/kubeflow/kubeflow/tree/master/components/centraldashboard

MPI Operator (allreduce distributed training strategy)

• https://github.com/kubeflow/mpi-operator
• https://medium.com/kubeflow/introduction-to-kubeflow-mpi-operator-and-industry-adoption-296d5f2e6edc

Istio (service mesh)

• https://www.kubeflow.org/docs/concepts/multi-tenancy/istio/

with cilium https://docs.cilium.io/en/latest/network/servicemesh/istio/ https://github.com/kubeflow/manifests/issues/2729

Feast

https://www.kubeflow.org/docs/external-add-ons/feast/ https://github.com/feast-dev/feast https://feast.dev/

Elyra

https://www.kubeflow.org/docs/external-add-ons/elyra/ https://elyra.readthedocs.io/

Bento ML

https://github.com/kubeflow/manifests/tree/master/contrib/bentoml

Seldon

https://github.com/kubeflow/manifests/tree/master/contrib/seldon

Ray

https://github.com/kubeflow/manifests/tree/master/contrib/ray

Additional Tooling

Additional tooling for data management (PVC Viewer), visualization (TensorBoards), and more.

Links

https://www.kubeflow.org/docs/started/introduction/ https://www.kubeflow.org/docs/started/architecture/ https://www.kubeflow.org/docs/releases/kubeflow-1.9/ https://blog.kubeflow.org/ https://github.com/kubeflow/manifests/