the scaling law introduced in this research is vital for learning scenarios where the number of labels is dynamic. More information: Ella Koresh et al, Scaling in Deep and Shallow Learning ...
There are just empirical observations that hold true just like Moore’s Law did for a long period ... a meme mocking the idea that scaling deep learning would hit a wall. Indeed, as recently ...