Verified claim · AI-ML · 100% confidence
ELECTRA introduced in paper: ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators (Clark et al., 2020).
Last verified 2026-05-16 · Methodology veritas-v0.1 · 2f9c79357e9d4da9
Structured fields
- Subject
- ELECTRA
- Predicate
introduced_in_paper- Object
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators (Clark et al., 2020)
- Confidence
- 100%
- Tags
- electra · pretraining · discriminator · foundational · 2020 · google
Sources (2)
[1] preprint · arXiv (Clark, Luong, Le, Manning) · 2020-03-23
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators“We propose a more sample-efficient pre-training task called replaced token detection. Instead of masking the input, our approach corrupts it by replacing some tokens with plausible alternatives sampled from a small generator network.”
[2] github release · Google Research · 2020-03-23
google-research/electra — official implementation
Cite this claim
Ready-to-paste citation (Markdown / plain text):
ELECTRA introduced in paper: ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators (Clark et al., 2020). — SourceScore Claim 2f9c79357e9d4da9 (verified 2026-05-16). https://sourcescore.org/api/v1/claims/2f9c79357e9d4da9.jsonEmbed this claim
Drop this iframe into any blog post, docs page, or knowledge base. The widget renders the signed claim + primary source + click-through to this canonical page. CC-BY 4.0; attribution included.
<iframe src="https://sourcescore.org/embed/claim/2f9c79357e9d4da9/" width="100%" height="360" frameborder="0" loading="lazy" title="ELECTRA introduced in paper: ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators (Clark et al., 2020)."></iframe>Preview: open in new tab
Related claims
Other verified claims sharing tags with this one — useful for LLM retrieval graphs and citation discovery.
Vision Transformer (ViT) introduced in paper: An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (Dosovitskiy et al., 2020).
d3681b0981e0b700 · 100% confidence · shares 3 tags (foundational, 2020, google)
Reformer introduced in paper: Reformer: The Efficient Transformer (Kitaev, Kaiser, Levskaya, 2020).
76f7f00e79bc18c8 · 100% confidence · shares 3 tags (foundational, 2020, google)
Retrieval-Augmented Generation (RAG) introduced in paper: Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks (Lewis et al., 2020).
d15057ced937a103 · 100% confidence · shares 2 tags (foundational, 2020)
BERT (Bidirectional Encoder Representations from Transformers) introduced in paper: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (Devlin et al., 2018).
4c1ee70007dc89c1 · 100% confidence · shares 2 tags (foundational, google)
T5 (Text-to-Text Transfer Transformer) introduced in paper: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer (Raffel et al., 2019).
ef28341c3b308737 · 100% confidence · shares 2 tags (foundational, google)
Programmatic access
Fetch this claim with a signed envelope for verification:
curl https://sourcescore.org/api/v1/claims/2f9c79357e9d4da9.json