Asia Pacific

Solution NIO adopted a hybrid GPU sharing strategy, selecting different GPU allocation mechanisms based on workload characteristics rather than enforcing a single approach. The following diagram illustrates the GPU management architecture after integrating HAMi into Kubernetes....

The Challenge: Resource fragmentation As Xiaohongshu’s business grew rapidly, its infrastructure demands quickly outpaced the capacity of individual Kubernetes clusters. Both self-built data centers and managed Kubernetes services (TKE/ACK) from cloud vendors have cluster size limits...

Challenge As Ke Holdings’ machine learning initiatives scaled, the infrastructure team faced significant challenges in GPU resource management: Initially, the overall GPU utilization was only 13% due to the complexity of the multi-cloud environment and diverse...

The solution: A unified GitOps framework The turning point came when we decided to stop managing clusters and start engineering a platform. We chose Argo CD as the centerpiece of our strategy, moving toward a declarative,...

Solution DaoCloud adopted HAMi, a CNCF Sandbox project, for heterogeneous AI computing virtualization, as the unified GPU layer across both D.run and DCE. HAMi provides device virtualization, vGPU partitioning, and scheduling for heterogeneous accelerators in Kubernetes...

Solution: How Keycloak Secured 2M+ user logins To address these challenges, the company implemented Keycloak as a centralized identity and access management solution. Keycloak enabled seamless Single Sign-On (SSO) across web, desktop, and native applications, allowing...

Cybozu Boosts Performance with Cilium on Bare Metal Cybozu is a Japanese software company known for its customizable low code/no code workflow platform Kintone, which lets teams manage data, tasks, and communication in one central place....

EffectiveGPU leverages several key capabilities provided by HAMi: EffectiveGPU further extends the capabilities of HAMi and provides the following advanced features: By leveraging these technologies, the team can deploy more services with fewer GPUs, dynamically adjust...

“HAMi is a great option for vGPU scheduling, helping us optimize GPU usage for our AI microservices. Its monitoring and alerting features are also very helpful for long-term tracking. The documentation is clear, and the ability...