Gang scheduling and topology-aware placement for AI training in Kubernetes
Distributed AI training workloads impose complex scheduling requirements that Kubernetes’s built-in scheduler can’t meet. Kubernetes schedules pods individually and independently, but distributed training introduces two requirements that break this model: Pods must land on hardware with…
The PARK stack (PyTorch, AI models, Ray, and Kubernetes) is emerging as the de facto open source standard for production AI. Within that stack, KubeRay has become the bridge connecting scalable AI applications built on Ray…
Faster LLM inference startup: What you need to know
Adding an inference replica creates capacity only after the new instance can serve requests. Between starting a process and generating a response, an LLM server may need to load weights, initialize GPU resources, compile kernels, capture…
About Seres Seres Group Co., Ltd. was founded in 1986 and is headquartered in Chongqing. It is a technology-driven automotive company whose core business is new energy vehicles. The company is listed on both the A-share…
Unlocking a New Developer Experience The sandbox fundamentally changes how developers interact with telecom APIs by removing long approval processes and paywalls, providing immediate access to all CAMARA APIs in one place. This allows for safe…
Who owns NIS2 and DORA on a Kubernetes platform team
There is a meeting that repeats across a lot of European engineering organizations right now. Someone from legal or risk brings a NIS2 control, a DORA article, or a “can we evidence this” request into the…
Kubernetes disaster recovery: Guidance from three reproducible failure scenarios
Scope This document describes three failure scenarios that separate having backups from being able to recover, and the guidance that follows from each. Every scenario is reproducible on a laptop from the lab repository above, and…
German ciphers, telegrams, and cloud native data sovereignty
A lesson from 1917 In January 1917, Germany sent a secret telegram. It went to Mexico. The offer: join the war against the United States, and you can have Texas, Arizona and New Mexico back. The…
Good apps aren’t born, they’re guided: Building observable policy as code
As parents in tech, we’ve learned that neither children nor applications thrive without clear boundaries. There are no “good” or “bad” kids, just as there are no inherently “good” or “bad” applications, only behaviors shaped by…
Shadow AI in CI/CD: Threat-modeling the path from developer laptop to Kubernetes
Artificial intelligence is becoming part of daily software delivery, often before it becomes part of the security architecture. That gap has a name: Shadow AI. It is any AI tool, model, agent, extension, or integration used…