Browse Source

Set sampler in DDP example

Sebastian Raschka 1 day ago
parent
commit
75133605c5
1 changed files with 2 additions and 0 deletions
  1. 2 0
      appendix-A/01_main-chapter-code/DDP-script.py

+ 2 - 0
appendix-A/01_main-chapter-code/DDP-script.py

@@ -133,6 +133,8 @@ def main(rank, world_size, num_epochs):
     # the core model is now accessible as model.module
 
     for epoch in range(num_epochs):
+        # NEW: Set sampler to ensure each epoch has a different shuffle order
+        train_loader.sampler.set_epoch(epoch)
 
         model.train()
         for features, labels in train_loader: