Why goodput matters more than throughput for LLM serving
When we benchmark an LLM serving setup, the number almost everyone reaches for first is throughput: how many requests per second the system can push through. It is easy to measure, easy to compare, and it…
Challenge: Scaling Infrastructure Without Linear Team Growth Operating Kubernetes at large scale required more than deploying clusters. Manual provisioning and ad-hoc operations would not scale, and planned maintenance could not be disruptive. As internal adoption increased,…
OTel and mesh-derived metrics: A 2026 reference
If you already run an OpenTelemetry pipeline, you have good visibility into what your applications are doing. This blog post is about what you don’t see yet: the east-west traffic between your services, measured at the…
Dynamic configuration for cloud native Swift services
Modern Swift services increasingly run alongside the same cloud native infrastructure stacks that power much of today’s Kubernetes ecosystem — including ConfigMaps, containerized workloads, declarative deployments, and service lifecycle management. Projects such as Prometheus and OpenTelemetry…
Designing end-to-end ingress request tracing for multi-tenant SaaS platforms
Modern SaaS platforms built on cloud‑native architectures frequently consist of dozens of independently deployed microservices. A single customer request entering the platform at the ingress layer may traverse authentication services, orchestration engines, data services, and downstream…
The AI-driven shift in vulnerability discovery: What maintainers and bug finders need to know
AI models have recently drastically changed the sophistication, speed and scale of software vulnerability discovery. It is now trivial for non-experts to find real vulnerabilities in software with minimal effort and expertise. It is also now…
The Challenge: Fragmented tooling and compliance risk at scale The client’s platform engineering team managed a sprawling cloud-native estate with over 1,000 GitLab projects, hundreds of Kubernetes workloads, Kafka streams, Databricks and Spark jobs, and Aurora…
Welcome llm-d to the CNCF: Evolving Kubernetes into SOTA AI infrastructure
We are thrilled to announce that llm-d has officially been accepted as a Cloud Native Computing Foundation (CNCF) Sandbox project! As generative AI transitions from research labs to production environments, platform engineering teams are facing a…
Announcing a Kotlin Multiplatform API and SDK for OpenTelemetry
OpenTelemetry has become the de facto standard for collecting and exporting telemetry data across cloud native systems. Its success has been driven by strong community collaboration, a clear specification, and a growing ecosystem of language-specific SDKs…
CNCF Unveils KubeCon + CloudNativeCon India 2026 Schedule
Third annual India event to spotlight AI, observability, platform engineering and more MUMBAI, India, 11 March, 2026 – The Cloud Native Computing Foundation® (CNCF®), which builds sustainable ecosystems for cloud native software, today announced the conference…