Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel (huggingface.co)

huggingface.co · 4 years ago · write a board post referencing this