Studying Scaling Laws for Transformer Architecture … | Shola Oyedele | OpenAI Scholars Demo Day 2021

Transcript

um so i'll get started um hey everyone um my name is shola um i'm going to be talking about scaling laws for transformer architecture variants um and so today's talk is going to be broken down into three main sections first a discussion of the problem and context behind pursuing this research an overview of the research and any findings from the ex... Read More