LLM

The Shift to LLM Fine-Tuning with Thinking Machines

Devendra Chaplot

LLM future is multi-model

Erik Davtyan

Arctic Inference: Breaking the Speed-Cost Tradeoff in LLM Serving

Aurick Qiao

Designing and Building Custom Reinforcement Learning Environments for Fine-tuning LLMs

N. Bantilan

Enabling VLLM V1 on AMD GPUs With Triton

Thomas Parnell, IBM Research & Aleksandr Malyshev, AMD

No GPU Left Behind: Scaling Online LLM Training With...

Mert Toslali & Yu Chin Fabian Lim

PyTorch in Production: Boosting LLM Training and...

F. Hua

Scaling KV Caches for LLMs: How LMCache + NIXL Handle Network and Storage...- J. Jiang & M. Khazraee

Serving PyTorch LLMs at Scale: Disaggregated Inference With Kubernetes and Llm-d

M. Ayoub & C. Liu

Unlocking Performance: Harnessing LLMs To Streamline GPU Kernel Development in...

Jiannan Wang

Verl: A Flexible and Efficient RL Framework for LLMs

Hongpeng Guo & Ziheng Jiang, ByteDance Seed

vLLM & Deepspeed Updates

Simon Mo & Tunji Ruwase

vLLM: Easy, Fast, and Cheap LLM Serving for Everyone

Simon Mo, vLLM

A Practical Field Guide to Optimizing Cost, Speed & Accuracy of LLMs

Niels Bantilan, Union.ai

AI Red Teaming — Why & How to Jailbreak LLM Agents

Alex Combessie, Giskard

LLM Inference: A Comparative Guide to Modern Open-Source Runtimes

Aleksandr Shirokov, Wildberries

Vibe Coding Your First LLM End-to-End Application

Greg Loughnane & Chris Alexiuk, AI Makerspace

Vibe Coding Your First LLM End-to-End Application

Greg Loughnane & Chris Alexiuk, AI Makerspace

Hacking LLMs: An Introduction to Mechanistic Interpretability

Jenny Vega

From AI agents to LLMs as judges: Reshaping observability in the era of generative AI

Diana Todea

Replacing platform abstractions with LLM-powered interfaces

George Fahmy

From LLM-as-a-Judge To Human-in-the-Loop: Rethinking Evaluat...

Eric Pugh & Fernando Rejon Barrera

From Traces To Action: Auto-Instrumenting LLMs for Observability...

Aditya Soni & Anshika Tiwari

Optimizing LLM Performance With Caching Strategies in OpenSearch

‪Uri Rosenberg‬‏ & Sherin Chandy