GELU (Gaussian Error Linear Unit) introduced in paper: Gaussian Error Linear Units (GELUs) (Hendrycks & Gimpel, 2016).
Subject
GELU (Gaussian Error Linear Unit)
Predicate
introduced_in_paper
Object
Gaussian Error Linear Units (GELUs) (Hendrycks & Gimpel, 2016)
Primary source · preprint · 2016-06-27
Gaussian Error Linear Units (GELUs) — arXiv (Dan Hendrycks, Kevin Gimpel)