Go FaaSter: Cold Start Optimization in a Serverless Platform
Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io
Don’t miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects
Go FaaSter: Cold Start Optimization in a Serverless Platform - Scott Zhou & Yanbo Li, Tencent
There is an open secret in the Serverless industry, most functions start off cold, taking many seconds the very first time – impacting the latency of many business critical applications. Come to this talk, where we’ll talk about how we are dramatically improving the cold start performance of the Tencent Serverless Cloud Functions(SCF) platform. We’ll talk about our SCF architecture – including networking, infrastructure, and function deployments – and the factors that causes cold start latency. We’ll then cover the architectural changes we’re making that is improving cold starts. Including improvements to elastic network interfaces, migration from containers to micro VMs, function code deployment, and resource reuse. Finally, we’ll cover how combining ML with autoscaling can avoid cold starts alltogether.