google

Gemini Pro released on: 2023-12-06.

e2a6019bd2ce5c97 · 1 source · 100% confidence

BERT (Bidirectional Encoder Representations from Transformers) introduced in paper: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (Devlin et al., 2018).

4c1ee70007dc89c1 · 2 sources · 100% confidence

T5 (Text-to-Text Transfer Transformer) introduced in paper: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer (Raffel et al., 2019).

ef28341c3b308737 · 2 sources · 100% confidence

Sparsely-Gated Mixture-of-Experts (MoE) introduced in paper: Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer (Shazeer et al., 2017).

2d6d7f61f1db6493 · 1 source · 100% confidence

Switch Transformer introduced in paper: Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity (Fedus et al., 2021).

3d9c14b9379038c9 · 2 sources · 100% confidence

Chain-of-Thought prompting introduced in paper: Chain-of-Thought Prompting Elicits Reasoning in Large Language Models (Wei et al., 2022).

3af924da138ff84c · 2 sources · 100% confidence

Gemini 1.5 Pro announced on: 2024-02-15.

b55da789dba1c76b · 1 source · 100% confidence

DeepMind acquired by google on: 2014-01-26.

25a8f486a0947790 · 2 sources · 95% confidence

Vision Transformer (ViT) introduced in paper: An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (Dosovitskiy et al., 2020).

d3681b0981e0b700 · 2 sources · 100% confidence

Word2Vec introduced in paper: Efficient Estimation of Word Representations in Vector Space (Mikolov et al., 2013).

4978f76d228a3db1 · 2 sources · 100% confidence

Gemini 2.0 announced on: 2024-12-11.

bc1d6baa80070e80 · 1 source · 100% confidence

SentencePiece tokenizer introduced in paper: SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing (Kudo & Richardson, 2018).

0d47bb8eb637a2e4 · 2 sources · 100% confidence

C4 (Colossal Clean Crawled Corpus) introduced in paper: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer (Raffel et al., 2019).

0d24c97977ebd744 · 2 sources · 100% confidence

ELECTRA introduced in paper: ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators (Clark et al., 2020).

2f9c79357e9d4da9 · 2 sources · 100% confidence

Batch Normalization introduced in paper: Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift (Ioffe & Szegedy, 2015).

56c451642ab41e68 · 2 sources · 100% confidence

Sequence-to-Sequence Learning (seq2seq) introduced in paper: Sequence to Sequence Learning with Neural Networks (Sutskever, Vinyals, Le, 2014).

ff80a25ed7e83b45 · 2 sources · 100% confidence

Reformer introduced in paper: Reformer: The Efficient Transformer (Kitaev, Kaiser, Levskaya, 2020).

76f7f00e79bc18c8 · 2 sources · 100% confidence

Gemma released on: 2024-02-21.

87b09546387243ef · 2 sources · 100% confidence

PaLM introduced in paper: PaLM: Scaling Language Modeling with Pathways (Chowdhery et al., 2022).

d58d505fd9d705fe · 2 sources · 100% confidence

Imagen introduced in paper: Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding (Saharia et al., 2022).

30fdfa95f8684ca5 · 2 sources · 100% confidence

Gemini Ultra publicly released on: 2024-02-08 via Gemini Advanced subscription.

d2ac7cd6fc8b1156 · 2 sources · 100% confidence

TensorFlow publicly released on: 2015-11-09 by Google.

fc71d09cd60b84ab · 2 sources · 100% confidence

JAX publicly released on: 2018-12-10 by Google Research.

3652d087edc1e228 · 2 sources · 100% confidence

Gemini 2.5 Pro publicly released on: 2025-03-25 by Google DeepMind.

1529ff37ac65916a · 2 sources · 100% confidence

Knowledge Distillation popularized in: Hinton, Vinyals, Dean 2015 — distilling the knowledge in a neural network.

f14acb906ba6c12f · 2 sources · 100% confidence

Mixture of Experts (MoE) revival popularized in: Shazeer et al. 2017 — outrageously large neural networks via sparse gating.

f068236101568ad7 · 2 sources · 100% confidence

Speculative decoding introduced in: Leviathan, Kalman, Matias 2023 — Google Research.

6cdc7730bf41bb3d · 2 sources · 100% confidence

CRAG (Corrective RAG) introduced in: Yan et al. 2024 — corrective retrieval-augmented generation.

326d6dd16bd353d1 · 2 sources · 100% confidence

Google Gemma 2 publicly released on: 2024-06-27 by Google DeepMind — Gemma 2 family (9B + 27B), Gemma terms.

34ccd18a9fbc50d2 · 2 sources · 100% confidence

Google Gemma 3 publicly released on: 2025-03-12 by Google DeepMind — Gemma 3 family (1B/4B/12B/27B), 128k context, multimodal vision.

a832aaba30ee658e · 2 sources · 100% confidence

NotebookLM publicly released on: 2023-07-12 by Google Labs — AI research assistant grounding responses in user-uploaded source material.

f8fb76bf3685dcae · 2 sources · 100% confidence

Google AI Studio publicly released on: 2023-12-13 by Google — developer playground for Gemini API + prompt engineering UI.

fdf293ee05e8168d · 2 sources · 100% confidence

BIG-bench introduced in paper: Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models (Srivastava et al., 2022).

bde28f6f7e14e0e9 · 3 sources · 92% confidence

ALBERT introduced in paper: ALBERT: A Lite BERT for Self-supervised Learning of Language Representations (Lan et al., 2019).

7c050ea8dac8797e · 2 sources · 82% confidence