RMSNorm (Root Mean Square Layer Normalization) introduced in paper: Root Mean Square Layer Normalization (Zhang & Sennrich, 2019).
Subject
RMSNorm (Root Mean Square Layer Normalization)
Predicate
introduced_in_paper
Object
Root Mean Square Layer Normalization (Zhang & Sennrich, 2019)
Primary source · preprint · 2019-10-16
Root Mean Square Layer Normalization — arXiv (Biao Zhang, Rico Sennrich — Edinburgh + Zurich)