Tag
2019
22 verified claims carrying this tag. Each cites primary evidence; the source count is shown on every record.
GPT-2 introduced in paper: Language Models are Unsupervised Multitask Learners (Radford et al., 2019).
859551dc078c46f8 · 2 sources · 100% confidence
T5 (Text-to-Text Transfer Transformer) introduced in paper: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer (Raffel et al., 2019).
ef28341c3b308737 · 2 sources · 100% confidence
Stability AI founded in: 2019.
d23bd1687a3ea44a · 2 sources · 95% confidence
Cohere founded in: 2019.
cf4cbf71dc7dd19a · 2 sources · 95% confidence
C4 (Colossal Clean Crawled Corpus) introduced in paper: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer (Raffel et al., 2019).
0d24c97977ebd744 · 2 sources · 100% confidence
Pinecone founded in: 2019.
1cfc3870019a8819 · 2 sources · 90% confidence
Weaviate founded in: 2019.
9f25f9f965e7cde4 · 2 sources · 85% confidence
Replicate founded in: 2019.
d9e848aed91184f4 · 2 sources · 85% confidence
SuperGLUE benchmark introduced in paper: SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems (Wang et al., 2019).
1a1e87145608c91a · 2 sources · 100% confidence
RoBERTa introduced in: Liu et al. 2019 — A Robustly Optimized BERT Pretraining Approach.
d4fecb26a4c9cdca · 2 sources · 100% confidence
DistilBERT introduced in: Sanh et al. 2019 — a smaller, faster, cheaper BERT via knowledge distillation.
245af747a3d21061 · 2 sources · 100% confidence
BART introduced in: Lewis et al. 2019 — denoising sequence-to-sequence pretraining.
f5b422e3255fd7c0 · 2 sources · 100% confidence
Milvus vector database publicly released on: 2019-10-15 by Zilliz.
aa5b818bcc5124d7 · 2 sources · 100% confidence
ARC-AGI benchmark introduced in: Chollet 2019 — abstraction and reasoning corpus.
cc5df3c14d35fa49 · 2 sources · 100% confidence
PyTorch Lightning publicly released on: 2019-03-31 by William Falcon.
902b86707095e3f6 · 2 sources · 100% confidence
PEFT (parameter-efficient fine-tuning) popularized in: Houlsby et al. 2019 — Adapter Modules + downstream PEFT library.
fb9a06ffca4277c1 · 2 sources · 100% confidence
Glean founded in: 2019 by Arvind Jain + T.R. Vishwanath + Tony Gentilcore + Piyush Prahladka — enterprise AI work assistant (search + agents).
dccd22fd257e6d6d · 2 sources · 100% confidence
HellaSwag benchmark introduced in paper: HellaSwag: Can a Machine Really Finish Your Sentence? (Zellers et al., 2019).
b3f34e83dd0c53b9 · 3 sources · 92% confidence
RMSNorm (Root Mean Square Layer Normalization) introduced in paper: Root Mean Square Layer Normalization (Zhang & Sennrich, 2019).
c64636dc60b1216f · 3 sources · 92% confidence
ALBERT introduced in paper: ALBERT: A Lite BERT for Self-supervised Learning of Language Representations (Lan et al., 2019).
7c050ea8dac8797e · 2 sources · 82% confidence
XLNet introduced in paper: XLNet: Generalized Autoregressive Pretraining for Language Understanding (Yang et al., 2019).
d8983079997f21c6 · 2 sources · 82% confidence
Megatron-LM introduced in paper: Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism (Shoeybi et al., 2019).
5739ea06ced93de9 · 2 sources · 82% confidence