This video explains how Distributed Data Parallel (DDP) and Fully Sharded Data Parallel (FSDP) works. The slides are available at #pytorch #fsdp #ddp #Distributed #Sharded #Data #Parallel #machinelearning #deeplearning