AI/ML claims from 2019

ARC-AGI benchmark introduced in: Chollet 2019 — abstraction and reasoning corpus.

cc5df3c14d35fa49 · 2 sources · 100% confidence

BART introduced in: Lewis et al. 2019 — denoising sequence-to-sequence pretraining.

f5b422e3255fd7c0 · 2 sources · 100% confidence

C4 (Colossal Clean Crawled Corpus) introduced in paper: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer (Raffel et al., 2019).

0d24c97977ebd744 · 2 sources · 100% confidence

DistilBERT introduced in: Sanh et al. 2019 — a smaller, faster, cheaper BERT via knowledge distillation.

245af747a3d21061 · 2 sources · 100% confidence

Glean founded in: 2019 by Arvind Jain + T.R. Vishwanath + Tony Gentilcore + Piyush Prahladka — enterprise AI work assistant (search + agents).

dccd22fd257e6d6d · 2 sources · 100% confidence

GPT-2 introduced in paper: Language Models are Unsupervised Multitask Learners (Radford et al., 2019).

859551dc078c46f8 · 2 sources · 100% confidence

Kaplan scaling laws introduced in paper: Kaplan et al. 2020 — Scaling Laws for Neural Language Models.

22e12bfbe7770657 · 2 sources · 100% confidence

Milvus vector database publicly released on: 2019-10-15 by Zilliz.

aa5b818bcc5124d7 · 2 sources · 100% confidence

PEFT (parameter-efficient fine-tuning) popularized in: Houlsby et al. 2019 — Adapter Modules + downstream PEFT library.

fb9a06ffca4277c1 · 2 sources · 100% confidence

PyTorch Lightning publicly released on: 2019-03-31 by William Falcon.

902b86707095e3f6 · 2 sources · 100% confidence

RoBERTa introduced in: Liu et al. 2019 — A Robustly Optimized BERT Pretraining Approach.

d4fecb26a4c9cdca · 2 sources · 100% confidence

SuperGLUE benchmark introduced in paper: SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems (Wang et al., 2019).

1a1e87145608c91a · 2 sources · 100% confidence

T5 (Text-to-Text Transfer Transformer) introduced in paper: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer (Raffel et al., 2019).

ef28341c3b308737 · 2 sources · 100% confidence

HellaSwag benchmark introduced in paper: HellaSwag: Can a Machine Really Finish Your Sentence? (Zellers et al., 2019).

b3f34e83dd0c53b9 · 3 sources · 92% confidence

RMSNorm (Root Mean Square Layer Normalization) introduced in paper: Root Mean Square Layer Normalization (Zhang & Sennrich, 2019).

c64636dc60b1216f · 3 sources · 92% confidence

ALBERT introduced in paper: ALBERT: A Lite BERT for Self-supervised Learning of Language Representations (Lan et al., 2019).

7c050ea8dac8797e · 2 sources · 82% confidence

Megatron-LM introduced in paper: Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism (Shoeybi et al., 2019).

5739ea06ced93de9 · 2 sources · 82% confidence

XLNet introduced in paper: XLNet: Generalized Autoregressive Pretraining for Language Understanding (Yang et al., 2019).

d8983079997f21c6 · 2 sources · 82% confidence