Tag
2020
20 verified claims carrying this tag. Each cites primary evidence; the source count is shown on every record.
Retrieval-Augmented Generation (RAG) introduced in paper: Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks (Lewis et al., 2020).
d15057ced937a103 · 2 sources · 100% confidence
GPT-3 parameter count: 175000000000.
1ca2cc2864dfb376 · 2 sources · 100% confidence
Vision Transformer (ViT) introduced in paper: An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (Dosovitskiy et al., 2020).
d3681b0981e0b700 · 2 sources · 100% confidence
Denoising Diffusion Probabilistic Models (DDPM) introduced in paper: Denoising Diffusion Probabilistic Models (Ho, Jain, Abbeel, 2020).
e700f81fff6f38c7 · 2 sources · 100% confidence
MMLU benchmark introduced in paper: Measuring Massive Multitask Language Understanding (Hendrycks et al., 2020).
428d754e7c651be6 · 2 sources · 100% confidence
The Pile dataset released on: 2020-12-31.
4aef1422b96df26c · 2 sources · 100% confidence
EleutherAI founded in: 2020.
f018fec775a8e941 · 2 sources · 95% confidence
ELECTRA introduced in paper: ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators (Clark et al., 2020).
2f9c79357e9d4da9 · 2 sources · 100% confidence
GPT-3 introduced in paper: Language Models are Few-Shot Learners (Brown et al., 2020).
7d3e6a39b1656571 · 2 sources · 100% confidence
Longformer introduced in paper: Longformer: The Long-Document Transformer (Beltagy, Peters, Cohan, 2020).
c3d2ec81d9faf837 · 2 sources · 100% confidence
Reformer introduced in paper: Reformer: The Efficient Transformer (Kitaev, Kaiser, Levskaya, 2020).
76f7f00e79bc18c8 · 2 sources · 100% confidence
DeepSpeed publicly released on: 2020-02-13 by Microsoft Research.
53cc193ef08fc5c0 · 2 sources · 100% confidence
AlphaFold 1 introduced in: Senior et al. 2020 — DeepMind protein structure prediction.
a77a8dd48941a53d · 2 sources · 100% confidence
Haystack publicly released on: 2020-04 by deepset GmbH.
6218cda83723327f · 2 sources · 100% confidence
Hugging Face Hub publicly released on: 2020-09 — model + dataset sharing platform.
9ef57203f2dd34ec · 1 source · 100% confidence
ColBERT introduced in: Khattab & Zaharia 2020 — late-interaction retrieval.
2335984b07f28cac · 2 sources · 100% confidence
Kaplan scaling laws introduced in paper: Kaplan et al. 2020 — Scaling Laws for Neural Language Models.
22e12bfbe7770657 · 2 sources · 100% confidence
Jina AI founded in: 2020 by Han Xiao — open-source multimodal AI infrastructure (Jina Framework, Jina Embeddings, Reader API).
3cabd56c2d4ac308 · 2 sources · 100% confidence
BigBird introduced in paper: Big Bird: Transformers for Longer Sequences (Zaheer et al., 2020).
1783cda1b5f622e7 · 2 sources · 82% confidence
DeBERTa introduced in paper: DeBERTa: Decoding-enhanced BERT with Disentangled Attention (He et al., 2020).
7cbe7b535b211862 · 2 sources · 82% confidence