This put up was co-authored by Maneesh Sah, Company Vice President, Azure Storage Engineering.
Container is the brand new digital machine (VM). Whether or not you’re a CTO, enterprise architect, main DevOps groups, or constructing functions, you will have already launched into the journey to containerize your functions or are raring to go—to maximise the advantages of scale, flexibility, and value. With Kubernetes on the helm, containers have quickly develop into a hotbed of innovation and a essential space of transformation for enterprises and startups alike. After the preliminary deal with stateless containers, working excessive scale stateful workloads on containers has now develop into the norm. To run business-critical, enterprise-grade functions on Kubernetes within the cloud, prospects want extremely scalable, cost-efficient, and performant storage—built-for and with intrinsic help for containers. At this time, we’re excited to announce the preview of Azure Container Storage, the trade’s first platform-managed container native storage service within the public cloud, offering finish to finish storage administration and orchestration for stateful functions to run effectively at scale on Azure.
Why Azure Container Storage?
With fast adoption of Kubernetes, we see a surge of manufacturing workloads, each cloud-first in addition to app modernization, that want container-native persistent storage for databases (equivalent to MySQL), large information (equivalent to ElasticSearch), messaging functions (equivalent to Kafka), and steady integration and steady supply (CI/CD) techniques (equivalent to Jenkins). To run these stateful functions, prospects want operational simplicity to deploy and scale storage tightly coupled with the containerized functions. Prospects at this time, nevertheless, want to decide on between utilizing VM centric cloud storage choices, retrofitted to containers, or deploying and self-managing open-source container storage options within the cloud—main to large operational overhead, scaling bottlenecks, and excessive value.
To supply prospects with a seamless end-to-end expertise, container native storage must allow:
- Seamless quantity mobility throughout the cluster to maximise pod availability with out bottlenecks on quantity attaches and deletes.
- Fast scaling of huge variety of volumes as software pods scale up or scale out as wanted.
- Optimum price-performance for any quantity sizes, particularly small volumes that require larger enter/output operations per second (IOPS).
- Easy and constant quantity administration expertise throughout backing storage varieties to match workload necessities, equivalent to extraordinarily low latency ephemeral disks versus persistent or scalable distant storage.
Azure Container Storage addresses these necessities by enabling prospects to focus their consideration on working workloads and functions somewhat than managing storage. Azure Container Storage is our first step in direction of offering a transformative storage expertise. As a essential addition to Azure’s suite of container providers, it’ll assist organizations of all sizes to streamline their containerization efforts and enhance their total storage administration capabilities.
Leveraging Azure Container Storage
Azure Container Storage is a purpose-built, software-defined storage answer that delivers a constant management aircraft throughout a number of backing storage choices to satisfy the wants of stateful container functions. This totally managed service supplies a quantity administration layer for stateful container functions enabling storage orchestration, information administration, Kubernetes-aware information safety, and rule-based efficiency scaling.
Aligning with open-source container native storage approaches, Azure Container Storage runs microservices-based storage controllers in Kubernetes, to summary the storage administration layer from pods and backing storage, enabling portability throughout Kubernetes nodes and skill to mount totally different storage choices as proven within the determine.
Azure Container Storage elements embody:
- A Storage Pool, which is a set of storage assets grouped and introduced as a unified storage entity to your AKS cluster.
- A knowledge providers layer, chargeable for replication, encryption, and different add-on performance absent within the underlying storage supplier.
- A protocol layer, which exposes provisioned volumes through NVMe-oF protocol to software pods.
With this method Azure Container Storage affords a number of differentiated experiences to prospects on Azure, together with:
Reducing the overall value of possession (TCO) by offering means to scale IOPS on smaller quantity sizes, to help containerized functions which have dynamic and fluctuating enter/output (IO) necessities. That is enabled utilizing shared provisioning of capability and efficiency on a storage pool, which may be leveraged by a number of volumes. With shared provisioning, prospects can now maximize efficiency throughout software containers whereas conserving TCO down. As a substitute of allocating capability and IOPS per persistent quantity (PV), which generally results in overprovisioning, prospects can now create PVs and dynamically share assets from a Storage Pool.
Fast scale-out of stateful pods, achieved utilizing distant community protocols like NVME-oF and iSCSI to mount PV, enabling easy scaling on AKS throughout Compute and Storage. That is particularly useful for container deployments that begin small and iteratively add assets. Responsiveness is vital to make sure that functions are usually not starved or disrupted, both throughout initialization or scaling in manufacturing. Moreover, software resiliency is vital with pod respawns throughout the cluster requiring fast PV motion. Leveraging distant community protocols permits us to tightly couple with the pod lifecycle to help extremely resilient excessive scale stateful functions on AKS.
Simplified constant quantity administration interface backed by native and distant storage choices enabling prospects to allocate and use storage through the Kubernetes management aircraft. Which means prospects can leverage ephemeral disks, Azure Disks in addition to Azure Elastic SAN through a unified administration interface to satisfy workload wants. For example, ephemeral storage could also be preferable for Cassandra to attain the bottom latency, whereas Azure Disks is appropriate for PostgreSQL or different database options. This unified expertise supplied by Azure Container Storage simplifies the administration of persistent volumes, whereas delivering a complete answer to deal with the broad vary of efficiency necessities of varied containerized workloads.
Totally built-in day-2 experiences, together with information safety, cross-cluster restoration, and observability offering operational simplicity for purchasers who must create buyer scripts or sew collectively disparate instruments at this time. Prospects can orchestrate Kubernetes-aware backup of the persistent volumes built-in with AKS usually obtainable to streamline the end-to-end experiences for working stateful container workloads on Azure.
Confer with the technical neighborhood weblog put up for extra particulars about Azure Container Storage.
Getting began
Enroll to take part within the preview and deploy your first stateful container software at this time.
Confer with the Azure Container Storage documentation to study extra in regards to the service.
We’re assured that this new provide will considerably speed up app modernization and cloud migration. We sit up for listening to your suggestions. Please e mail us at azcontainerstorage@microsoft.com with any questions.
