huggingface/optimum-furiosa
Accelerated inference of 🤗 models using FuriosaAI NPU chips.
https://skillcdn.ai/gh/huggingface/optimum-furiosaConnect this address to your AI to use these skills. How to connect
- Unverified
- Default branch
main - Commit
148a427 - License
Apache-2.0
Explore this repository
Searches the original text of skills and documents; display translations are not searched.
Documents
- ConfigurationThe configuration classes are the way to specify how a task should be done. Here is how a quantization can be configered:docs/source/package_reference/configuration.mdx
- ModelsThe following Furiosa classes are available for instantiating a base model class without a specific head.docs/source/package_reference/modeling.mdx
- Quantization[[autodoc]] FuriosaAIQuantizerdocs/source/package_reference/quantization.mdx