A Stable Limited LibTorch ABI? How?! (and Why?)

Lightning Talk: A Stable Limited LibTorch ABI? How?! (and Why?) - Jane Xu, Meta Do you use or maintain third-party C++/CUDA extensions with torch? (Think flash attention :)) Would you like to build that extension with one torch version and run with another torch version WITHOUT rebuilding the extension? Do you ever wish you didn’t have to rebuild all your wheels when a new PyTorch nightly or release came out? If so, then this talk is for you! Come explore our plans for a new limited stable libtorch ABI that you can build against to simplify your binary packaging situation. Trek with us through the cobwebs of detangling and rearranging C++ libtorch into header-only APIs and ABI-stable APIs powered through a C shim. Dream with us as we envision the possible futures we can build on top of a sturdier, stable, ABI compatible interface for fundamental concepts like Tensor. Before we get too ahead of ourselves though, sit tight and inquire of us about the new APIs we’re landing (like STABLE_TORCH_LIBRARY) so you can start building ABI stable PyTorch extensions ASAP!