KServe

KServe is a standardized distributed generative and predictive AI inference platform for scalable, multi-framework deployment on Kubernetes.

KServe is being used across many organizations and is a Cloud Native Computing Foundation (CNCF) incubating project.

For more details, visit the KServe website: https://kserve.github.io/website/