Verified claim · AI-ML · 92% confidence
BIG-bench introduced in paper: Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models (Srivastava et al., 2022).
Last verified 2026-05-31 · Methodology veritas-v0.1 · bde28f6f7e14e0e9
SourceScore rates how reliable a source is to cite — for AI answers and research. This is one verified claim from the catalog.
Related verified claims
More verified claims related to this one — keep exploring.
MTEB benchmark introduced in: Muennighoff et al. 2022 — Massive Text Embedding Benchmark.
100% confidence · shares 3 tags (benchmark, evaluation, 2022)
Chain-of-Thought prompting introduced in paper: Chain-of-Thought Prompting Elicits Reasoning in Large Language Models (Wei et al., 2022).
100% confidence · shares 2 tags (2022, google)
MMLU benchmark introduced in paper: Measuring Massive Multitask Language Understanding (Hendrycks et al., 2020).
100% confidence · shares 2 tags (benchmark, evaluation)
SuperGLUE benchmark introduced in paper: SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems (Wang et al., 2019).
100% confidence · shares 2 tags (benchmark, evaluation)
GLUE benchmark introduced in paper: GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding (Wang et al., 2018).
100% confidence · shares 2 tags (benchmark, evaluation)
PaLM introduced in paper: PaLM: Scaling Language Modeling with Pathways (Chowdhery et al., 2022).
100% confidence · shares 2 tags (google, 2022)
Imagen introduced in paper: Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding (Saharia et al., 2022).
100% confidence · shares 2 tags (google, 2022)
Speculative decoding introduced in: Leviathan, Kalman, Matias 2023 — Google Research.
100% confidence · shares 2 tags (google, 2022)
Structured fields
- Subject
- BIG-bench
- Predicate
introduced_in_paper- Object
- Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models (Srivastava et al., 2022)
- Confidence
- 92%
- Tags
- big-bench · bigbench · benchmark · evaluation · srivastava · 2022 · google
Sources (3)
[1] preprint · arXiv (Srivastava et al. — 450 authors across 132 institutions) · 2022-06-09
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models“we introduce the Beyond the Imitation Game benchmark (BIG-bench). BIG-bench currently consists of 204 tasks, contributed by 450 authors across 132 institutions.”
[2] github release · Google · 2022-06-09
BIG-bench collaborative benchmark repository[3] docs · Hugging Face
BIG-bench (Hugging Face Papers)Hugging Face is rated by SourceScore — see its reliability →
Cite this claim
Ready-to-paste citation (Markdown / plain text):
BIG-bench introduced in paper: Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models (Srivastava et al., 2022). — SourceScore Claim bde28f6f7e14e0e9 (verified 2026-05-31). https://sourcescore.org/api/v1/claims/bde28f6f7e14e0e9.jsonEmbed this claim
Drop this iframe into any blog post, docs page, or knowledge base. The widget renders the claim record + top cited source + click-through to this canonical page. CC-BY 4.0; attribution included.
<iframe src="https://sourcescore.org/embed/claim/bde28f6f7e14e0e9/" width="100%" height="360" frameborder="0" loading="lazy" title="BIG-bench introduced in paper: Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models (Srivastava et al., 2022)."></iframe>Preview: open in new tab
Frequently asked questions
How has SourceScore reviewed the claim "BIG-bench introduced in paper: Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models (Srivastava et al., 2022)."?
SourceScore records this assertion with 92% legacy editorial confidence as of 2026-05-31, under methodology veritas-v0.1. That metadata is not a truth guarantee. Inspect the 3 cited source record(s), excerpts, and live evidence below.
What is the evidence for "BIG-bench introduced in paper: Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models (Srivastava et al., 2022)."?
The record lists 3 cited source(s): arXiv (Srivastava et al. — 450 authors across 132 institutions), Google, Hugging Face. Each is shown below with a short excerpt and URL. The JSON record at https://sourcescore.org/api/v1/claims/bde28f6f7e14e0e9.json includes SourceScore-issued HMAC integrity metadata, not a public verification proof.
When was this claim record last reviewed by SourceScore?
Last reviewed 2026-05-31 under methodology version veritas-v0.1. The dated JSON record includes SourceScore-issued HMAC metadata, which is not publicly recomputable. Refetch the record and inspect current evidence before relying on it.
How can I cite this SourceScore claim in my code or article?
Fetch the JSON record from https://sourcescore.org/api/v1/claims/bde28f6f7e14e0e9.json, including the verbatim claim, cited evidence, confidence, methodology version, and last-verified date. Refetch the canonical HTTPS record and inspect cited evidence; the HMAC tag is not publicly independently verifiable. The CC-BY-4.0 license permits commercial use with attribution to SourceScore.
Use this claim in your code
Fetch this record from your application. The response includes verbatim excerpts, primary-source URLs, and SourceScore-issued HMAC integrity metadata. Refetch the canonical HTTPS record and inspect cited evidence; public users cannot independently verify the HMAC tag.
cURL
curl https://sourcescore.org/api/v1/claims/bde28f6f7e14e0e9.jsonJavaScript / TypeScript
const r = await fetch("https://sourcescore.org/api/v1/claims/bde28f6f7e14e0e9.json");
const envelope = await r.json();
console.log(envelope.claim.statement);
// "BIG-bench introduced in paper: Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models (Srivastava et al., 2022)."Python
import httpx
r = httpx.get("https://sourcescore.org/api/v1/claims/bde28f6f7e14e0e9.json")
envelope = r.json()
print(envelope["claim"]["statement"])
# "BIG-bench introduced in paper: Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models (Srivastava et al., 2022)."LangChain (retrieve-then-cite)
from langchain_core.tools import tool
import httpx
@tool
def get_big_bench_fact() -> dict:
"""Fetch the verified SourceScore claim for BIG-bench."""
r = httpx.get("https://sourcescore.org/api/v1/claims/bde28f6f7e14e0e9.json")
return r.json()