Evolving Deep Learning Platform with Knative
Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io
Don’t miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects
Evolving Deep Learning Platform with Knative - Ti Zhou, Baidu
The emergence of Knative has enhanced the capabilities of Baidu internal deep learning platform. The workflow between training and inference services can be implemented based on Knative eventing. The training and inference services can also implement smart routing and auto-scaling by leveraging Knative serving. And the training job image can also be built by Knative build framework. After using Knative, Baidu internal deep learning platform has reduced resource consumption by 20%. In this speech, we will show how to use the capabilities of Knative to reconstruct deep learning platform, including: Expanding eventing to achieve training to inference pipeline automation Use serving to implement smart routing and auto-scaling of inference services Use build to automate the process of generating the training images