huggingface/lighteval
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
https://skillcdn.ai/gh/huggingface/lightevalConnect this address to your AI to use these skills. How to connect
- Unverified
- Default branch
main - Commit
c2af9e5 - License
MIT
Explore this repository
Searches the original text of skills and documents; display translations are not searched.
Documents
- Doc[[autodoc]] tasks.requests.Docdocs/source/package_reference/doc.mdx
- EvaluationTracker[[autodoc]] logging.evaluation_tracker.EvaluationTrackerdocs/source/package_reference/evaluation_tracker.mdx
- Logging[[autodoc]] logging.evaluation_tracker.EvaluationTrackerdocs/source/package_reference/logging.mdx
- Metrics[[autodoc]] metrics.utils.metric_utils.Metricdocs/source/package_reference/metrics.mdx
- Model ConfigsThe model configs are used to define the model and its parameters. All the parameters can be set in the model-args or in the model yaml file (see example here).docs/source/package_reference/models.mdx
- Model's OutputAll models will generate an ouput per Doc supplied to the generation or loglikelihood fuctions.docs/source/package_reference/models_outputs.mdx
- Pipeline[[autodoc]] pipeline.Pipelinedocs/source/package_reference/pipeline.mdx
- Tasks[[autodoc]] tasks.lighteval_task.LightevalTaskConfigdocs/source/package_reference/tasks.mdx