Abstract.
Given any linear threshold function f on n Boolean variables, we construct a linear threshold function g which disagrees with f on at most an ε fraction of inputs and has integer weights each of magnitude at most \({\sqrt{n}\cdot}2^{{\tilde{O}}(1/ \epsilon^{2})}\) We show that the construction is optimal in terms of its dependence on n by proving a lower bound of \(\Omega(\sqrt{n})\) on the weights required to approximate a particular linear threshold function. We give two applications. The first is a deterministic algorithm for approximately counting the fraction of satisfying assignments to an instance of the zero-one knapsack problem to within an additive ± ε. The algorithm runs in time polynomial in n (but exponential in \({1}/{\epsilon^{2}}\)). In our second application, we show that any linear threshold function f is specified to within error ε by estimates of its Chow parameters (degree 0 and 1 Fourier coefficients) which are accurate to within an additive \(\pm{1}/({n}\cdot 2^{{\tilde{O}}(1/ \epsilon^{2})})\). This is the first such accuracy bound which is inverse polynomial in n, and gives the first polynomial bound (in terms of n) on the number of examples required for learning linear threshold functions in the “restricted focus of attention” framework.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Author information
Authors and Affiliations
Corresponding author
Additional information
Manuscript received 10 September 2006
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License ( https://creativecommons.org/licenses/by-nc/2.0 ), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Servedio, R.A. Every Linear Threshold Function has a Low-Weight Approximator. comput. complex. 16, 180–209 (2007). https://doi.org/10.1007/s00037-007-0228-7
Issue Date:
DOI: https://doi.org/10.1007/s00037-007-0228-7