huggingface/optimum-furiosa
Accelerated inference of 🤗 models using FuriosaAI NPU chips.
https://skillcdn.ai/gh/huggingface/optimum-furiosaConnect this address to your AI to use these skills. How to connect
- Unverified
- Default branch
main - Commit
148a427 - License
Apache-2.0
Explore this repository
Searches the original text of skills and documents; display translations are not searched.
Documents
- Optimum Inference with Furiosa NPUOptimum Furiosa is a utility package for building and running inference with Furiosa NPUs. Optimum can be used to load optimized models from the Hugging Face Hub and create pipelines to run accelerat…docs/source/usage_guides/models.mdx
- OverviewWelcome to the 🤗 Optimum Furiosa how-to guides! These guides tackle more advanced topics and will show you how to easily get the best from NPUs:docs/source/usage_guides/overview.mdx
- Quantization🤗 Optimum provides an optimum.furiosa package that enables you to apply quantization on many models hosted on the Hugging Face Hub using the Furiosa quantization tool.docs/source/usage_guides/quantization.mdx