HPE EZMERAL CONTAINER PLATFORM 5.2 AND HPE EZMERAL DATA FABRIC ON HPE DL SERVERS

# Solution Storage

The HPE Ezmeral Data Fabric for Kubernetes provides the ability to run HPE Data Fabric services on top of Kubernetes as a set of pods. It allows you to create Data Platform Clusters for storing data and Tenants for running application such as spark jobs inside pods. Installing both the Tenant components and the Data Platform Cluster components, the HPE Data Fabric Platform runs as a fully native Kubernetes application.Deploying the Data Platform Cluster as part of the HPE Data Fabric for Kubernetes provides the following benefits:

  • Independent and elastic scaling of storage and compute

  • Ability to run different versions of Spark applications using the same data platform

  • Deployment of multiple environments with resource isolation and sharing as required

The HPE CSI Driver is a multi-vendor and multi-backend driver where each implementation has a Container Storage Provider (CSP). The HPE CSI Driver allows any vendor or project to develop its own Container Storage Provider by using the CSP specification. This makes it very easy for third parties to integrate their storage solution into Kubernetes as all the intricacies are taken care of by the HPE CSI Driver.

The CSI specification include constructs to manage snapshots as native Kubernetes objects and create new Persistent Volume Claims (PVCs) by referencing those objects. Other capabilities include PVC expansion, inline ephemeral volume, and the ability to present raw block storage to pods.

Solution components HPE Ezmeral Data Fabric for Kubernetes are described at a high-level in Figure 8.

Figure 8. High-level HPE Ezmeral Data Fabric for Kubernetes Overview

Figure 9. High-level HPE Ezmeral Data Fabric for Kubernetes architecture

By default, HPE Data Platform Clusters on Kubernetes require a minimum of 5 nodes with at least 16 Cores, 500GB Memory, and 500GB of ephemeral storage available to the OS. Additional 3X 500 GB disks for configuring storage for HPE Data Fabric for Kubernetes.

# Configuring solution storage

Based on the required performance either solid-state disks or hard disk drives can be used, where it is consumed by HPE Ezmeral Container Platform ephemeral disk for Docker and optionally by compute nodes as boot devices. Kubernetes Storage Cluster running on HPE ProLiant DL380 Gen10 server's local disk provides Persistent Volume (PV) for containers using the HPE CSI Driver.

Figure 10. Logical storage layout within the solution

← Solution Deployment Flow →