Verified claim · AI-ML · 100% confidence
HELM introduced in paper: Holistic Evaluation of Language Models (Liang et al., Stanford CRFM 2022-11-16).
Last verified 2026-05-16 · Methodology veritas-v0.1 · 494f2bf84f0e5dd2
Structured fields
- Subject
- HELM
- Predicate
introduced_in_paper- Object
- Holistic Evaluation of Language Models (Liang et al., Stanford CRFM 2022-11-16)
- Confidence
- 100%
- Tags
- helm · stanford-crfm · benchmark · holistic-evaluation · foundational · 2022
Sources (2)
[1] preprint · arXiv · 2022-11-16
Holistic Evaluation of Language Models“HELM evaluates 30 prominent language models on 42 scenarios, measuring 7 metrics (accuracy, calibration, robustness, fairness, bias, toxicity, efficiency) across each scenario.”
[2] benchmark · Stanford CRFM · 2022-11-16
HELM — Stanford CRFM Leaderboard
Cite this claim
Ready-to-paste citation (Markdown / plain text):
HELM introduced in paper: Holistic Evaluation of Language Models (Liang et al., Stanford CRFM 2022-11-16). — SourceScore Claim 494f2bf84f0e5dd2 (verified 2026-05-16). https://sourcescore.org/api/v1/claims/494f2bf84f0e5dd2.jsonEmbed this claim
Drop this iframe into any blog post, docs page, or knowledge base. The widget renders the signed claim + primary source + click-through to this canonical page. CC-BY 4.0; attribution included.
<iframe src="https://sourcescore.org/embed/claim/494f2bf84f0e5dd2/" width="100%" height="360" frameborder="0" loading="lazy" title="HELM introduced in paper: Holistic Evaluation of Language Models (Liang et al., Stanford CRFM 2022-11-16)."></iframe>Preview: open in new tab
Related claims
Other verified claims sharing tags with this one — useful for LLM retrieval graphs and citation discovery.
Chinchilla scaling laws introduced in paper: Training Compute-Optimal Large Language Models (Hoffmann et al., 2022).
8befcae6bce01a95 · 100% confidence · shares 2 tags (foundational, 2022)
Chain-of-Thought prompting introduced in paper: Chain-of-Thought Prompting Elicits Reasoning in Large Language Models (Wei et al., 2022).
3af924da138ff84c · 100% confidence · shares 2 tags (foundational, 2022)
ReAct (Reasoning + Acting) introduced in paper: ReAct: Synergizing Reasoning and Acting in Language Models (Yao et al., 2022).
fceea64fa7d04d3a · 100% confidence · shares 2 tags (foundational, 2022)
SuperGLUE benchmark introduced in paper: SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems (Wang et al., 2019).
1a1e87145608c91a · 100% confidence · shares 2 tags (benchmark, foundational)
GLUE benchmark introduced in paper: GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding (Wang et al., 2018).
aa113b5e61d5c214 · 100% confidence · shares 2 tags (benchmark, foundational)
Frequently asked questions
Is the claim "HELM introduced in paper: Holistic Evaluation of Language Models (Liang et al., Stanford CRFM 2022-11-16)." verified?
Yes — SourceScore verified this claim with 100% confidence as of 2026-05-16. The verification uses 2 primary sources cross-referenced against the SourceScore methodology (version veritas-v0.1). Full source list + signed JSON envelope linked below.
What is the evidence for "HELM introduced in paper: Holistic Evaluation of Language Models (Liang et al., Stanford CRFM 2022-11-16)."?
Evidence comes from 2 primary sources: arXiv, Stanford CRFM. Each source is listed below with verbatim excerpts and URLs. The signed JSON envelope at https://sourcescore.org/api/v1/claims/494f2bf84f0e5dd2.json includes an HMAC-SHA256 signature for audit verification.
When was this claim last verified by SourceScore?
Last verified 2026-05-16 under methodology version veritas-v0.1. The signed JSON envelope is dated and cryptographically signed for audit trail. Re-verification cadence depends on the claim type and source freshness.
How can I cite this SourceScore claim in my code or article?
Fetch the signed JSON envelope from https://sourcescore.org/api/v1/claims/494f2bf84f0e5dd2.json which includes the verbatim claim, primary sources, confidence, methodology version, last-verified date, and HMAC-SHA256 signature for audit. The CC-BY-4.0 license permits commercial use with attribution to SourceScore.
Use this claim in your code
Fetch this signed envelope from your application. The response includes the verbatim excerpt, primary source URLs, and an HMAC-SHA256 signature you can verify locally for audit trails.
cURL
curl https://sourcescore.org/api/v1/claims/494f2bf84f0e5dd2.jsonJavaScript / TypeScript
const r = await fetch("https://sourcescore.org/api/v1/claims/494f2bf84f0e5dd2.json");
const envelope = await r.json();
console.log(envelope.claim.statement);
// "HELM introduced in paper: Holistic Evaluation of Language Models (Liang et al., Stanford CRFM 2022-11-16)."Python
import httpx
r = httpx.get("https://sourcescore.org/api/v1/claims/494f2bf84f0e5dd2.json")
envelope = r.json()
print(envelope["claim"]["statement"])
# "HELM introduced in paper: Holistic Evaluation of Language Models (Liang et al., Stanford CRFM 2022-11-16)."LangChain (retrieve-then-cite)
from langchain_core.tools import tool
import httpx
@tool
def get_helm_fact() -> dict:
"""Fetch the verified SourceScore claim for HELM."""
r = httpx.get("https://sourcescore.org/api/v1/claims/494f2bf84f0e5dd2.json")
return r.json()