Hugging Face · Agent Skill

huggingface-community-evals

Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.

Published by Hugging FaceApache-2.0207 lines in SKILL.md

Source: huggingface/skills/skills/huggingface-community-evals
Repository owner: huggingface

Install

Read the SKILL.md and any scripts before installing: a skill runs with your agent's permissions. This copies just this skill into Claude Code's user skills folder; other agents read skills from their own folder.

Claude Code (user-level)

git clone --depth 1 --filter=blob:none --sparse https://github.com/huggingface/skills.git /tmp/skills
cd /tmp/skills && git sparse-checkout set "skills/huggingface-community-evals"
mkdir -p ~/.claude/skills && cp -r "skills/huggingface-community-evals" ~/.claude/skills/huggingface-community-evals

Skills folder docs:

Claude Code Codex Gemini CLI OpenCode Cursor GitHub Copilot goose OpenHands Amp Factory Droid Junie Kiro Roo Code Mistral Vibe pi Hermes Agent OpenClaw Letta

Works with

Agent Skills is an open format, so this skill loads in any harness that supports it, including Claude Code, Codex, Gemini CLI, OpenCode, Cursor, GitHub Copilot, goose, OpenHands. Some skills are written for one product and say so in their description.

More skills from Hugging Face

hf-cli hf-cloud-aws-context-discovery hf-cloud-python-env-setup hf-cloud-sagemaker-deployment-planner hf-cloud-sagemaker-iam-preflight hf-cloud-sagemaker-production-defaults hf-cloud-serving-image-selection hf-mem huggingface-best huggingface-datasets huggingface-gradio huggingface-llm-trainer

Reviewed Oct 5, 2026. Name and description are the skill's own frontmatter.