Skip to content

Non-Cloud Infrastructure Providers

Cluster API provides several infrastructure providers designed for environments outside of major cloud platforms. This document explores bare metal, virtualization, and nested cluster providers that enable Kubernetes deployment without dependency on AWS, Azure, GCP, or similar cloud services.

Overview

Non-cloud infrastructure providers enable Kubernetes cluster provisioning across diverse environments:

  • Bare Metal: Physical servers without virtualization layers
  • Virtualization: Virtual machines on platforms like KubeVirt, vSphere
  • Nested/Virtual Clusters: Kubernetes clusters running within existing Kubernetes clusters

These providers handle infrastructure lifecycle management, OS provisioning (when applicable), and Kubernetes node bootstrapping.

Virtualization and Nested Cluster Providers

KubeVirt

Run VMs as Kubernetes resources alongside containerized workloads.

Key Features:

  • Native Kubernetes API for VM management
  • VMs run as pods with KVM virtualization
  • Live migration support
  • Integration with Kubernetes networking and storage
  • PCI passthrough support
  • CNCF Status: Incubating (since April 2022)

Links:

vcluster

Virtual Kubernetes clusters running inside existing Kubernetes clusters.

Key Features:

  • Lightweight virtual clusters
  • Full Kubernetes API compatibility
  • Certified Kubernetes distribution (100% conformance tests)
  • Resource isolation and multi-tenancy
  • Syncs only necessary resources to host cluster
  • No performance overhead
  • CNCF Status: Not a CNCF project (as of 2025)

Links:

Harvester

Open source hyperconverged infrastructure (HCI) built on Kubernetes.

Key Features:

  • Built on Kubernetes, KubeVirt, and Longhorn
  • Hyperconverged infrastructure (compute, storage, networking)
  • VM lifecycle management
  • Web UI and API
  • Rancher integration
  • Live migration and backup
  • CNCF Status: Not a CNCF project (built on CNCF projects)

Links:

Dedicated Bare Metal Providers

Metal3

The most mature and widely adopted bare metal provider for Cluster API.

Key Features:

  • Uses OpenStack Ironic for bare metal provisioning
  • Supports hardware introspection and discovery
  • Handles firmware and BIOS configuration
  • Provides power management capabilities (IPMI, Redfish)
  • Network boot support (PXE, iPXE)
  • CNCF Status: Incubating (since August 2025)

Links:

Tinkerbell

A bare metal provisioning framework designed for scalability and flexibility.

Key Features:

  • Workflow-based provisioning system
  • Microservices architecture
  • Hardware data management
  • DHCP and TFTP services included
  • Custom workflow definitions
  • CNCF Status: Sandbox (since November 2020)

Links:

Sidero (Community Maintained)

Note: Sidero Labs is no longer actively developing Sidero Metal. The project is now community-maintained. For new deployments, Sidero Labs recommends using Omni as the alternative.

A bare metal provider built specifically for Talos Linux.

Key Features:

  • Talos Linux native integration
  • API-driven bare metal management
  • Automatic hardware discovery
  • Secure boot support
  • Immutable infrastructure approach
  • CNCF Status: Not a CNCF project

Status:

  • No longer actively developed by Sidero Labs
  • Community-maintained (Slack support available)
  • Supports Kubernetes v1.34 and Talos v1.11
  • Recommended to use Omni for new deployments

Links:

Omni (Sidero Labs Alternative)

The successor to Sidero from Sidero Labs, providing a SaaS platform for Talos Linux cluster management.

Key Features:

  • Managed Talos Linux platform
  • Multi-cluster management
  • Works with bare metal, cloud, and edge
  • Web-based UI and API
  • Secure by default (WireGuard-based)
  • GitOps integration
  • CNCF Status: Not a CNCF project

Note: Omni is not a traditional Cluster API provider but rather a complete cluster management platform that can work alongside or instead of Cluster API.

Links:

Hivelocity

A commercial bare metal cloud provider with Cluster API integration.

Key Features:

  • Managed bare metal infrastructure
  • Global data center presence
  • API-driven provisioning
  • Network configuration management
  • Storage options
  • CNCF Status: Not a CNCF project

Links:

Flexible/Hybrid Providers

BYOH (Bring Your Own Host)

Note: The original VMware Tanzu BYOH provider is no longer actively maintained. An actively maintained fork is available from Platform9.

The most flexible option for existing bare metal infrastructure.

Key Features:

  • SSH-based host registration
  • No special hardware requirements
  • Works with Ubuntu 20.04 and 22.04
  • Agent-based approach
  • Supports existing infrastructure
  • CNCF Status: Not a CNCF project

Status:

  • Alpha stage (not production-ready)
  • Platform9 fork actively maintained
  • Supports Kubernetes v1.31.*
  • No backwards-compatibility guarantee

Links:

MAAS (Metal as a Service)

Canonical's bare metal provisioning solution.

Key Features:

  • Comprehensive hardware management
  • Network configuration automation
  • Storage configuration
  • Integration with Juju
  • Web UI and API
  • CNCF Status: Not a CNCF project

Links:

k0smotron RemoteMachine

SSH-based remote machine provisioning.

Key Features:

  • SSH connectivity
  • k0s distribution focus
  • Simple deployment model
  • No agent required on target
  • CNCF Status: Not a CNCF project

Links:

Provider Comparison

Virtualization and Nested Providers

Provider Maturity Complexity CNCF Status Infrastructure Type Special Requirements
KubeVirt High Medium Incubating VM in K8s Existing K8s cluster
vcluster Medium Low Not CNCF Virtual K8s in K8s Existing K8s cluster
Harvester Medium Medium Not CNCF (uses CNCF projects) HCI on bare metal Bare metal servers

Bare Metal and Hybrid Providers

Provider Maturity Complexity Hardware Discovery Boot Method Self-Hosted CNCF Status Special Requirements
Metal3 High Medium-High Yes PXE/iPXE Yes (BM) Incubating IPMI/Redfish
Tinkerbell Medium Medium Yes PXE Yes (BM) Sandbox DHCP/TFTP infrastructure
Sidero Medium (Community) Medium Yes PXE Yes (BM) Not CNCF Talos Linux (not actively developed)
Omni Medium Low No Agent-based Optional Not CNCF Talos Linux, Omni account
Hivelocity Medium Low N/A Managed No Not CNCF Hivelocity account
BYOH Low (Alpha) Low No N/A Yes (Both) Not CNCF SSH access (Platform9 fork)
MAAS High Medium-High Yes PXE Yes (BM) Not CNCF MAAS server
k0smotron Low-Medium Low No N/A Yes (Both) Not CNCF SSH access

Legend:

  • Self-Hosted: Yes (BM) = Bare metal only, Yes (Both) = Bare metal and cloud, Optional = SaaS or self-hosted, No = Managed service only
  • CNCF Status: Incubating/Sandbox = Official CNCF project level, Not CNCF = Independent project, Part of CAPI = Kubernetes subproject