DeepSpeed: Efficient Training Scalability for Deep Learning

DeepSpeed: Efficient Training Scalability for Deep Learning - Tunji Ruwase, Snowflake DeepSpeed is a OSS framework that provides a suite of systems optimizations to enable efficient large-scale deep learning. This talk will chart a brief history of the project and present latest progress in compiler, offloading, and storage optimizations.