'Deep Network Approximation: Beyond ReLU to Diverse Activation Functions', by Shijun Zhang, Jianfeng Lu, Hongkai Zhao.
http://jmlr.org/papers/v25/23-0912.html #activation #sigmoid #expressive
Mastodon is the best way to keep up with what's happening.
Follow anyone across the fediverse and see it all in chronological order. No algorithms, ads, or clickbait in sight.