Abstract
The lower bound Ω(n log2 n) for the complexity of an arbitrary depth-two information network with n inputs and n outputs is proved providing the inputs are independent, the outputs are independent, and the total information of any input and any output is n times less than the entropy of any input or output. A similar estimate for Boolean depth-two circuits of functional elements is obtained as a corollary.
Similar content being viewed by others
References
O. B. Lupanov, Asymptotic Estimates for the Complexity of Control Systems, (Moscow State Univ., Moscow, 1984) [in Russian].
C. Shannon, Papers on Information Theory and Cybernetics, (IL, Moscow, 1963) [in Russian].
D. Yu. Cherukhin, “The Lower Estimate of Complexity in the Class of Schemes of Depth 2 without Restrictions on a Basis,” Vestn. Mosk. Univ., Matem. Mekhan., No 4, 54 (2005) [Moscow Univ. Math. Bull. 60 (4), 42 (2005)].
P. Pudlák and P. Savický, “On Shifting Networks,” Theor. Comput. Sci. 116, 415 (1993).
P. Pudlák, V. Rödl, and J. Sgall, “Boolean Circuits, Tensor Ranks and Communication Complexity,” SIAM J. Comput. 26(3), 605 (1997).
Author information
Authors and Affiliations
Additional information
Original Russian Text © D.Yu.Cherukhin, 2009, published in Vestnik Moskovskogo Universiteta, Matematika. Mekhanika, 2009, Vol. 64, No. 1, pp. 16–19.
About this article
Cite this article
Cherukhin, D.Y. The complexity of depth-two information networks. Moscow Univ. Math. Bull. 64, 16–19 (2009). https://doi.org/10.3103/S0027132209010045
Received:
Published:
Issue Date:
DOI: https://doi.org/10.3103/S0027132209010045