Approximating Boolean Functions with Depth-2 Circuits
Eric Blais, Li-Yang Tan · SIAM Journal on Computing · 2015
We study the complexity of approximating Boolean functions with disjunctive normal forms (DNFs) and other depth-2 circuits, exploring two main directions: universal bounds on the approximability of all Boolean functions, and the approximability of the parity function. In the first direction, our main positive results are the first nontrivial universal upper bounds on approximability by DNFs: (a) every Boolean function can be $\epsilon$-approximated by a DNF of size $O_\epsilon(2^n/\log n)$, and (b) every Boolean function can be $\epsilon$-approximated by a DNF of width $c_\epsilon\, n$, where $c_\epsilon < 1$. Our techniques extend broadly to give strong universal upper bounds on approximability by various depth-2 circuits that generalize DNFs, including the intersection of halfspaces, low-degree Polynomial threshold functions, and unate functions. We show that the parameters of our constructions almost match the information-theoretic inapproximability of a random function. In the second direction our main positive result is the construction of an explicit DNF that approximates the following parity function: ${\sf PAR}_n$ can be $\epsilon$-approximated by a DNF of size $2^{(1-2\epsilon)n}$ and width $(1-2\epsilon)n$. Using Fourier analytic tools we show that our construction is essentially optimal not just within the class of DNFs but also within the far more expressive classes of the intersection of halfspaces and intersection of unate functions.