huggingface/lighteval
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
https://skillcdn.ai/gh/huggingface/lighteval내 AI에 이 주소를 연결하면 이 스킬들을 쓸 수 있어요. 연결 방법 보기
- 미확인
- 기본 브랜치
main - 커밋
c2af9e5 - 라이선스
MIT
저장소 둘러보기
스킬과 문서의 원문에서 찾습니다. 화면용 번역은 검색되지 않아요.
문서
- Doc[[autodoc]] tasks.requests.Docdocs/source/package_reference/doc.mdx
- EvaluationTracker[[autodoc]] logging.evaluation_tracker.EvaluationTrackerdocs/source/package_reference/evaluation_tracker.mdx
- Logging[[autodoc]] logging.evaluation_tracker.EvaluationTrackerdocs/source/package_reference/logging.mdx
- Metrics[[autodoc]] metrics.utils.metric_utils.Metricdocs/source/package_reference/metrics.mdx
- Model ConfigsThe model configs are used to define the model and its parameters. All the parameters can be set in the model-args or in the model yaml file (see example here).docs/source/package_reference/models.mdx
- Model's OutputAll models will generate an ouput per Doc supplied to the generation or loglikelihood fuctions.docs/source/package_reference/models_outputs.mdx
- Pipeline[[autodoc]] pipeline.Pipelinedocs/source/package_reference/pipeline.mdx
- Tasks[[autodoc]] tasks.lighteval_task.LightevalTaskConfigdocs/source/package_reference/tasks.mdx