update readme to guide large cluster operators to the distributed tra…

…ining guide
bghira · Oct 10, 2024 · 376293e · 376293e
1 parent fa4815c
commit 376293e
Showing 1 changed file with 2 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -37,6 +37,8 @@ For a quick start without reading the full documentation, you can use the [Quick
 
 For memory-constrained systems, see the [DeepSpeed document](/documentation/DEEPSPEED.md) which explains how to use 🤗Accelerate to configure Microsoft's DeepSpeed for optimiser state offload.
 
+For multi-node distributed training, [this guide](/documentation/DISTRIBUTED.md) will help tweak the configurations from the INSTALL and Quickstart guides to be suitable for multi-node training, and optimising for image datasets numbering in the billions of samples.
+
 ---
 
 ## Features