In recent work concerned with the approximation and expressive powers of deep neural networks, Daubechies, DeVore, Foucart, Hanin, and Petrova introduced a system of piecewise linear functions, which can be easily reproduced by artificial neural networks with the ReLU activation function, and showed that it forms a Riesz basis of \( L_2([0, 1]) \).
Their work was subsequently generalized to the multivariate setting by Schneider and Vybiral. In this talk, we show that this system serves as a Riesz basis also for Sobolev spaces \( W^s([0,1]^d) \) and Barron classes \( {\mathbb B}^s([0,1]^d) \) with smoothness 0<s<1. We apply this fact to re-prove some recent results on the approximation of functions from these classes by deep neural networks. Our proof method avoids using local approximations and allows us to track also the implicit constants as well as to show that we can avoid the curse of dimension.  Moreover, we also study how well one can approximate Sobolev and Barron functions by neural networks if only function values are known.

This is joint work with Mario Ullrich (Linz) and Jan Vybiral (Prague).