huggingface/accelerate
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
https://skillcdn.ai/gh/huggingface/accelerateConnect this address to your AI to use these skills. How to connect
- Unverified
- Default branch
main - Commit
01c73fb - License
Apache-2.0
Explore this repository
Searches the original text of skills and documents; display translations are not searched.
Documents
- Execution processWhen working with distributed training systems, it is important to manage how and when processes are executed across GPUs. Some processes are completed faster than others, and some processes shouldn'…docs/source/basic_tutorials/execution.md
- InstallationBefore you start, you will need to setup your environment, install the appropriate packages, and configure Accelerate. Accelerate is tested on Python 3.8+.docs/source/basic_tutorials/install.md
- Launching Accelerate scriptsIn the previous tutorial, you were introduced to how to modify your current training script to use Accelerate. The final version of that code is shown below:docs/source/basic_tutorials/launch.md
- Add Accelerate to your codeEach distributed training framework has its own way of doing things which can require writing a lot of custom code to adapt it to your PyTorch training code and training environment. Accelerate offer…docs/source/basic_tutorials/migration.md
- Launching distributed training from Jupyter NotebooksThis tutorial teaches you how to fine-tune a computer vision model with 🤗 Accelerate from a Jupyter Notebook on a distributed system. You will also learn how to set up a few requirements needed for…docs/source/basic_tutorials/notebook.md
- OverviewWelcome to the Accelerate tutorials! These introductory guides will help catch you up to speed on working with Accelerate. You'll learn how to modify your code to have it work with the API seamlessly…docs/source/basic_tutorials/overview.md
- TPU trainingA TPU (Tensor Processing Unit) is a type of hardware specifically designed for training models efficiently. Accelerate supports TPU training, but there are a few things you should be aware of, namely…docs/source/basic_tutorials/tpu.md
- TroubleshootThis guide provides solutions to some issues you might encounter when using Accelerate. Not all errors are covered because Accelerate is an active library that is continuously evolving and there are…docs/source/basic_tutorials/troubleshooting.md