.claude/skills/ai-eval-toolkitRuntime, accounts, dependencies, permissions, network behavior and task quality remain untested.
LLM 评测工具链(可运行实现)——把评测方法论变成能直接跑的本地引擎:评测集管理(JSONL 建集/质量检查/规模统计)、幻觉检测引擎(数字一致性/引用校验/否定矛盾/关键论断互证四类规则检测)、RAG 指标计算(RAGAS 四指标的本地简化实现:忠实度/答案相关性/上下文精度/上下文召回)、回归对比(基线 vs 新结果差异判定)、报告生成与上线门禁(分场景得分/门禁判定/报告输出)。零依赖纯标准库,本地闭环不联网。与「LLM 质量评测」(方法论)互补——那个讲怎么做,这个给能跑的实现。面向 AI 工程师、测试与质量负责人。
These states come from the source or distribution context. None of the entries below are SkillVetAI compatibility test results.
These checks parse the fixed package against dated platform rules. They do not execute the Skill or verify task behavior.
.claude/skills/ai-eval-toolkitRuntime, accounts, dependencies, permissions, network behavior and task quality remain untested.
.agents/skills/ai-eval-toolkitRuntime, accounts, dependencies, permissions, network behavior and task quality remain untested.
skills/ai-eval-toolkitRuntime, accounts, dependencies, permissions, network behavior and task quality remain untested.
This command is recorded from the source ecosystem and resolves the registry's latest release. The fixed release shown on this page should be inspected before adoption.
clawhub install @zhaoxinghua09-cell/ai-eval-toolkitclawhub inspect @zhaoxinghua09-cell/ai-eval-toolkit --version 1.0.0This automated, non-executing scan is bound to this release hash. It is not a safety certification and may contain false positives or false negatives.
This is registry-supplied evidence for the recorded release, not an independent SkillVetAI scan. Check the canonical source for the full report, scanner versions, scope, and current moderation state.
The catalog stores hashes and an inventory summary for change detection. It does not republish the package contents.
sha256:dea7c7d9fb7c4c823a3903e036cc16ac8217de359a905dfbdc6749f50cfd8ce3ATTESTATION.mdLICENSE.mdmanifest.jsonreferences/01-工具链全景.mdreferences/02-评测集管理.mdreferences/03-幻觉检测引擎.mdreferences/04-RAG指标计算.mdreferences/05-回归对比.mdreferences/06-报告与门禁.mdreferences/07-与平台工具衔接.mdreferences/08-FAQ.mdSECURITY_AUDIT.mdskill-card.mdSKILL.mdtools/eval_toolkit.pyverify/eval_toolkit_quality_test.pyverify/gen_security_radar.pyverify/security_results.jsonverify/security-radar.svgv1.0.0: runnable LLM evaluation toolkit (zero-dependency, pure stdlib, local offline) - dataset management engine (JSONL init/quality check/statistics), hallucination detection engine (four rule-based detectors, numeric consistency, citation validation, negation contradiction, key-claim cross-checking), RAG metric engine (local simplified RAGAS, faithfulness/answer relevance/context precision/context recall), regression comparison engine (baseline vs new diff), report and launch-gate engine (per-scenario scores, gate decision); complements the LLM quality evaluation methodology playbook