KServe is an open source, Kubernetes-based platform for deploying, serving, and scaling both predictive and large language models.