Circuit complexity

Example Boolean circuit. The nodes are AND gates, the nodes are OR gates, and the nodes are NOT gates

In theoretical computer science, circuit complexity is a branch of computational complexity theory in which Boolean functions are classified according to the size or depth of the Boolean circuits that compute them. A related notion is the circuit complexity of a recursive language that is decided by a uniform family of circuits (see below).

Proving lower bounds on size of Boolean circuits computing explicit Boolean functions is a popular approach to separating complexity classes. For example, a prominent circuit class P/poly consists of Boolean functions computable by circuits of polynomial size. Proving that would separate P and NP (see below).

Complexity classes defined in terms of Boolean circuits include AC0, AC, TC0, NC1, NC, and P/poly.

Size and depth

A Boolean circuit with input bits is a directed acyclic graph in which every node (usually called gates in this context) is either an input node of in-degree 0 labelled by one of the input bits, an AND gate, an OR gate, or a NOT gate. One of these gates is designated as the output gate. Such a circuit naturally computes a function of its inputs. The size of a circuit is the number of gates it contains and its depth is the maximal length of a path from an input gate to the output gate.

There are two major notions of circuit complexity[1] The circuit-size complexity of a Boolean function is the minimal size of any circuit computing . The circuit-depth complexity of a Boolean function is the minimal depth of any circuit computing .

These notions generalize when one considers the circuit complexity of any language that contains strings with different bit lengths, especially infinite formal languages. Boolean circuits, however, only allow a fixed number of input bits. Thus, no single Boolean circuit is capable of deciding such a language. To account for this possibility, one considers families of circuits where each accepts inputs of size . Each circuit family will naturally generate the language by circuit outputting when a length string is a member of the family, and otherwise. We say that a family of circuits is size minimal if there is no other family that decides on inputs of any size, , with a circuit of smaller size than (respectively for depth minimal families). Thus, circuit complexity is meaningful even for non-recursive languages. The notion of a uniform family enables variants of circuit complexity to be related to algorithm based complexity measures of recursive languages. However, the non-uniform variant is helpful to find lower bounds on how complex any circuit family must be in order to decide given languages.

Hence, the circuit-size complexity of a formal language is defined as the function , that relates a bit length of an input, , to the circuit-size complexity of a minimal circuit that decides whether inputs of that length are in . The circuit-depth complexity is defined similarly.

Uniformity

Boolean circuits are one of the prime examples of so-called non-uniform models of computation in the sense that inputs of different lengths are processed by different circuits, in contrast with uniform models such as Turing machines where the same computational device is used for all possible input lengths. An individual computational problem is thus associated with a particular family of Boolean circuits where each is the circuit handling inputs of n bits. A uniformity condition is often imposed on these families, requiring the existence of some possibly resource-bounded Turing machine that, on input n, produces a description of the individual circuit . When this Turing machine has a running time polynomial in n, the circuit family is said to be P-uniform. The stricter requirement of DLOGTIME-uniformity is of particular interest in the study of shallow-depth circuit-classes such as AC0 or TC0. When no resource bounds are specified, a language is recursive (i.e., decidable by a Turing machine) if and only if the language is decided by a uniform family of Boolean circuits.

Polynomial-time uniform

A family of Boolean circuits is polynomial-time uniform if there exists a deterministic Turing machine M, such that

  • M runs in polynomial time
  • For all , M outputs a description of on input

Logspace uniform

A family of Boolean circuits is logspace uniform if there exists a deterministic Turing machine M, such that

  • M runs in logarithmic work space (i.e. M is a log-space transducer)
  • For all , M outputs a description of on input

History

Circuit complexity goes back to Shannon in 1949,[2] who proved that almost all Boolean functions on n variables require circuits of size Θ(2n/n). Despite this fact, complexity theorists have so far been unable to prove a superlinear lower bound for any explicit function.

Superpolynomial lower bounds have been proved under certain restrictions on the family of circuits used. The first function for which superpolynomial circuit lower bounds were shown was the parity function, which computes the sum of its input bits modulo 2. The fact that parity is not contained in AC0 was first established independently by Ajtai in 1983[3][4] and by Furst, Saxe and Sipser in 1984.[5] Later improvements by Håstad in 1987[6] established that any family of constant-depth circuits computing the parity function requires exponential size. Extending a result of Razborov,[7] Smolensky in 1987[8] proved that this is true even if the circuit is augmented with gates computing the sum of its input bits modulo some odd prime p.

The k-clique problem is to decide whether a given graph on n vertices has a clique of size k. For any particular choice of the constants n and k, the graph can be encoded in binary using bits, which indicate for each possible edge whether it is present. Then the k-clique problem is formalized as a function such that outputs 1 if and only if the graph encoded by the string contains a clique of size k. This family of functions is monotone and can be computed by a family of circuits, but it has been shown that it cannot be computed by a polynomial-size family of monotone circuits (that is, circuits with AND and OR gates but without negation). The original result of Razborov in 1985[7] was later improved to an exponential-size lower bound by Alon and Boppana in 1987.[9] In 2008, Rossman[10] showed that constant-depth circuits with AND, OR, and NOT gates require size to solve the k-clique problem even in the average case. Moreover, there is a circuit of size that computes .

In 1999, Raz and McKenzie later showed that the monotone NC hierarchy is infinite.[11]

The Integer Division Problem lies in uniform TC0.[12]

Circuit lower bounds

Circuit lower bounds are generally difficult. Known results include

  • Parity is not in nonuniform AC0, proved by Ajtai in 1983[3][4] as well as by Furst, Saxe and Sipser in 1984.[5]
  • Uniform TC0 is strictly contained in PP, proved by Allender.[13]
  • The classes SP
    2
    , PP[nb 1] and MA/1[14] (MA with one bit of advice) are not in SIZE(nk) for any constant k.
  • While it is suspected that the nonuniform class ACC0 does not contain the majority function, it was only in 2010 that Williams proved that .[15]

It is open whether NEXPTIME has nonuniform TC0 circuits.

Proofs of circuit lower bounds are strongly connected to derandomization. A proof that would imply that either or that permanent cannot be computed by nonuniform arithmetic circuits (polynomials) of polynomial size and polynomial degree.[16]

In 1997, Razborov and Rudich showed that many known circuit lower bounds for explicit Boolean functions imply the existence of so called natural properties useful against the respective circuit class.[17] On the other hand, natural properties useful against P/poly would break strong pseudorandom generators. This is often interpreted as a "natural proofs" barrier for proving strong circuit lower bounds. In 2016, Carmosino, Impagliazzo, Kabanets and Kolokolova proved that natural properties can be also used to construct efficient learning algorithms.[18]

Complexity classes

Many circuit complexity classes are defined in terms of class hierarchies. For each non-negative integer i, there is a class NCi, consisting of polynomial-size circuits of depth , using bounded fan-in AND, OR, and NOT gates. The union NC of all of these classes is a subject to discussion. By considering unbounded fan-in gates, the classes ACi and AC (which is equal to NC) can be constructed. Many other circuit complexity classes with the same size and depth restrictions can be constructed by allowing different sets of gates.

Relation to time complexity

If a certain language, , belongs to the time-complexity class for some function , then has circuit complexity . If the Turing Machine that accepts the language is oblivious (meaning that it reads and writes the same memory cells regardless of input), then has circuit complexity .[19]

Monotone circuits

A monotone Boolean circuit is one that has only AND and OR gates, but no NOT gates. A monotone circuit can only compute a monotone Boolean function, which is a function where for every , , where means that for all .

See also

Notes

  1. ^ See proof.

References

  1. ^ Sipser, Michael (1997). Introduction to the theory of computation (1 ed.). Boston, USA: PWS Publishing Company. p. 324.
  2. ^ Shannon, Claude Elwood (1949). "The synthesis of two-terminal switching circuits". Bell System Technical Journal. 28 (1): 59–98. doi:10.1002/j.1538-7305.1949.tb03624.x.
  3. ^ a b Ajtai, Miklós (1983). "-formulae on finite structures". Annals of Pure and Applied Logic. 24: 1–24. doi:10.1016/0168-0072(83)90038-6.
  4. ^ a b Ajtai, Miklós; Komlós, János; Szemerédi, Endre (1983). "An sorting network". Proceedings of the 15th Annual ACM Symposium on Theory of Computing, 25–27 April, 1983, Boston, Massachusetts, USA. Association for Computing Machinery. pp. 1–9. doi:10.1145/800061.808726.
  5. ^ a b Furst, Merrick L.; Saxe, James Benjamin; Sipser, Michael Fredric (1984). "Parity, circuits, and the polynomial-time hierarchy". Mathematical Systems Theory. 17 (1): 13–27. doi:10.1007/BF01744431. MR 0738749. S2CID 6306235.
  6. ^ Håstad, Johan Torkel (1987). Computational limitations of small depth circuits (PDF) (Ph.D. thesis). Massachusetts Institute of Technology.
  7. ^ a b Razborov, Aleksandr Aleksandrovich (1985). "Lower bounds on the monotone complexity of some Boolean functions". Soviet Mathematics - Doklady. 31: 354–357. ISSN 0197-6788.
  8. ^ Smolensky, Roman (1987). "Algebraic methods in the theory of lower bounds for Boolean circuit complexity". Proceedings of the 19th Annual ACM Symposium on Theory of Computing. Association for Computing Machinery. pp. 77–82. doi:10.1145/28395.28404.
  9. ^ Alon, Noga; Boppana, Ravi B. (1987). "The monotone circuit complexity of Boolean functions". Combinatorica. 7 (1): 1–22. CiteSeerX 10.1.1.300.9623. doi:10.1007/bf02579196. S2CID 17397273.
  10. ^ Rossman, Benjamin E. (2008). "On the constant-depth complexity of k-clique". STOC 2008: Proceedings of the 40th annual ACM symposium on Theory of computing. Association for Computing Machinery. pp. 721–730. doi:10.1145/1374376.1374480.
  11. ^ Raz, Ran; McKenzie, Pierre (1999). "Separation of the monotone NC hierarchy". Combinatorica. 19 (3): 403–435. doi:10.1007/s004930050062.
  12. ^ Hesse, William (2001). "Division is in uniform TC0". Proceedings of the 28th International Colloquium on Automata, Languages and Programming. Springer Verlag. pp. 104–114.
  13. ^ Allender, Eric (1996). "Circuit complexity before the dawn of the new millennium". In Chandru, Vijay; Vinay, V. (eds.). Foundations of Software Technology and Theoretical Computer Science, 16th Conference, Hyderabad, India, December 18–20, 1996, Proceedings. Lecture Notes in Computer Science. Vol. 1180. Springer. pp. 1–18. doi:10.1007/3-540-62034-6_33.
  14. ^ Santhanam, Rahul (2007). "Circuit lower bounds for Merlin-Arthur classes". STOC 2007: Proceedings of the thirty-ninth annual ACM symposium on Theory of computing. pp. 275–283. CiteSeerX 10.1.1.92.4422. doi:10.1145/1250790.1250832.
  15. ^ Williams, Richard Ryan (2011). "Non-Uniform ACC Circuit Lower Bounds" (PDF). CCC 2011: Proceedings of the 26th Annual IEEE Conference on Computational Complexity. pp. 115–125. doi:10.1109/CCC.2011.36.
  16. ^ Kabanets, Valentine; Impagliazzo, Russell Graham (2004). "Derandomizing polynomial identity tests means proving circuit lower bounds". Computational Complexity. 13 (1): 1–46. doi:10.1007/s00037-004-0182-6. S2CID 12451799.
  17. ^ Razborov, Aleksandr Aleksandrovich; Rudich, Steven (1997). "Natural proofs". Journal of Computer and System Sciences. Vol. 55. pp. 24–35.
  18. ^ Carmosino, Marco; Impagliazzo, Russell Graham; Kabanets, Valentine; Kolokolova, Antonina (2016). "Learning algorithms from natural proofs". Computational Complexity Conference.
  19. ^ Pippenger, Nicholas; Fischer, Michael J. (1979). "Relations Among Complexity Measures". Journal of the ACM. 26 (3): 361–381. doi:10.1145/322123.322138. S2CID 2432526.

Further reading

Read other articles:

Star in the constellation Camelopardalis 11 Camelopardalis A light curve for BV Camelopardalis, plotted from Hipparcos data[1] Observation dataEpoch J2000.0      Equinox J2000.0 Constellation Camelopardalis Right ascension 05h 06m 08.45273s[2] Declination +58° 58′ 20.5432″[2] Apparent magnitude (V) 5.08[3] Characteristics Spectral type B3 Ve[4] B−V color index −0.080[5&...

Tomasz Welna Datos personalesNacimiento Ciechanów, Polonia27 de enero de 1993 (30 años)Nacionalidad(es) Altura 1.87 metrosCarrera deportivaDeporte FútbolClub profesionalDebut deportivo 2011(Dolcan Ząbki)Club Polonia VarsoviaPolonia PoloniaLiga II Liga de PoloniaPosición Defensor[editar datos en Wikidata] Tomasz Welna (Ciechanów, Polonia, 27 de enero de 1993) es un futbolista polaco. Juega de defensor y su equipo actual es el Polonia Varsovia de la I Liga de Polonia. ...

Este artigo ou seção pode conter informações desatualizadas. Se tem conhecimento sobre o tema abordado, edite a página e inclua as informações mais recentes, citando fontes fiáveis e independentes. —Encontre fontes: ABW  • CAPES  • Google (N • L • A) Esta página cita fontes, mas que não cobrem todo o conteúdo. Ajude a inserir referências. Conteúdo não verificável pode ser removido.—Encontre fontes: ABW  R...

احتفال جورج دبليو بوش أثناء التوقيع على قانون سياسة الطاقة لعام 2005 الذي قدم حوافز لبناء مفاعل نووي أمريكي بما في ذلك دعم تجاوز التكاليف بما يصل إلى ملياري دولار لستة محطات نووية جديدة.[1][2] بناء اثنين من المفاعلات في عام 2011 منAP1000 النهضة النووية في الولايات المتحدة ب�...

Technological college in New York, U.S. National Technical Institute for the DeafTypePrivate-Public partnershipEstablished1965PresidentGerard BuckleyLocationHenrietta, New York43°05′14″N 77°40′06″W / 43.0871°N 77.6683°W / 43.0871; -77.6683Websiterit.edu/ntid The National Technical Institute for the Deaf (NTID) is the first and largest technological college in the world for students who are deaf or hard of hearing.[1] As one of nine colleges within t...

Public college in Mahwah, New Jersey, US Ramapo College of New Jersey (RCNJ)TypePublic liberal arts collegeEstablished1969; 54 years ago (1969)Academic affiliationsSea-grant, Space-grantEndowment$21.2 million (2020)[1]PresidentCindy JebbStudents5,732[2]Undergraduates5,145Postgraduates587LocationMahwah, New Jersey, U.S.CampusSuburban, 300 acres (120 ha)Colors    Maroon & whiteSporting affiliationsNCAA Division IIIMascotRoadrunnerWebsitewww.r...

Egyptian writer Youssef RakhaNative nameيوسف رخاBorn (1976-06-12) June 12, 1976 (age 47)Cairo, EgyptLanguageEnglish, ArabicAlma materUniversity of Hull (BA)SubjectCairo; Islam; the Arab SpringYears active1999–presentNotable worksThe Book of the Sultan's SealSpouseHeba El Nahhas (m. 2011)Websitetherakha.net Literature portal Youssef Rakha (Arabic: يوسف رخا; born on 12 June 1976 in Cairo, Egypt) is an Egyptian writer. His work explores language and identi...

List of autoracing series circuts The following is a list of circuits that have hosted International Motor Sports Association (IMSA) SportsCar Championship races from the inaugural season in 1971 up to and including the 2023 season. The list includes the combined IMSA history of races held as part of the IMSA GT Championship, the Grand-Am Rolex Sports Car Series, the American Le Mans Series and the current WeatherTech SportsCar Championship.[1][2] Several nations have hosted a...

Iago Informações pessoais Nome completo Iago Amaral Borduchi Data de nascimento 23 de março de 1997 (26 anos) Local de nascimento Monte Azul Paulista, São Paulo, Brasil Nacionalidade brasileiro Altura 1,81 m Pé canhoto Informações profissionais Clube atual Augsburg Número 22 Posição lateral-esquerdo Clubes de juventude 2011–20122013–2016 Atlético Monte AzulInternacional Clubes profissionais2 Anos Clubes Jogos e gol(o)s 2017–20192019– InternacionalAugsburg 0081 000...

تفكك تشيكوسلوفاكيا (بالتشيكية: Zánik Československa) بالسلوفاكية: Rozdelenie Česko-Slovenska) بدأ هذا الحدث بتاريخ 1 يناير 1993 بتقسيم دولة تشيكوسلوفاكيا الفيدرالية إلى التشيك وسلوفاكيا.[1]  قادت الثورة المخملية في عام 1989 لإنهاء حكم الحزب الشيوعي التشيكوسلوفاكي وت...

Pour les articles homonymes, voir Royaume d'Italie. Cet article présente la liste des Rois d'Italie de 787 à 1946 et les actuels prétendants. Roi d'ItalieRe d'Italia Armoiries royales d'Italie Dernier roi d'ItalieHumbert II(1946) Création 15 avril 787 (premier roi d'Italie) Abrogation 13 juin 1946 Premier titulaire Pépin Ier (roi d'Italie) Dernier titulaire Humbert II (roi d'Italie) modifier  Historique Le concept de royaume d'Italie renvoie à des réalités historiques différente...

Indian politician (1927 - 1994) M. BasavarajuMember of Karnataka Legislative AssemblyIn office1967–1972Member of Rajya SabhaIn office3 April 1980 – 2 April 1986 Personal detailsBorn(1927-11-01)1 November 1927Died10 May 1994(1994-05-10) (aged 66)Political partyIndian National CongressSpouseShrimati ChikkananjammanniChildren4 sons and 2 daughters.ParentHasan Muddanna (father) M. Basavaraju ( 1 November 1927 - 10 May 1994) was an Indian politician of the Indian National Congres...

  1985 San Marino Grand PrixRace detailsRace 12 of 12 races in the1985 Grand Prix motorcycle racing seasonDate1 September 1985Official nameGrand Prix San Marino[1]LocationCircuito Internazionale Santa MonicaCoursePermanent racing facility3.488 km (2.167 mi)500 ccPole positionRider Eddie LawsonTime 1:19.630Fastest lapRider Eddie LawsonTime 1:20.460PodiumFirst Eddie LawsonSecond Wayne GardnerThird Randy Mamola250 ccPole positionRider Carlos LavadoTime 1:22.550Fastest...

Historic district in North Carolina, United States United States historic placeHayes Barton Historic DistrictU.S. National Register of Historic PlacesU.S. Historic district Vance Street neighborhoodShow map of North CarolinaShow map of the United StatesLocationRoughly bounded by St. Mary's St., Fairview Rd., W. Roanoke Park Dr., Scales St. and Williamson Dr., Raleigh, North CarolinaCoordinates35°48′14″N 78°38′57″W / 35.80389°N 78.64917°W / 35.80389; -78.649...

BPRS Bhakti SumekarLogo BPRS Bhakti SumekarJenisBank Pembiayaan Rakyat SyariahIndustriPerbankanDidirikan16 September 2002KantorpusatSumenep, IndonesiaWilayah operasiSumenep dan PamekasanProdukTabungan Deposito Gadai emasPemilikPemkab SumenepSitus webhttp://bhaktisumekar.co.id/ BPRS Bhakti Sumekar (dahulu bernama BPR Bhakti Sumekar) adalah sebuah Badan Usaha Milik Daerah (BUMD) Kabupaten Sumenep. Bank ini didirikan pada tanggal 16 September 2002 dengan bentuk perseroan terbatas (PT), kemudian ...

Pour les articles homonymes, voir Cantal. CantalPays d’origine FranceRégion Auvergne, Cantal, Auvergne-Rhône-AlpesPâte pressée non cuite, pressée (en)Appellation Appellation d'origine contrôlée (1956)appellation d'origine protégéeNommé en référence à Monts du CantalVolume commercialisé 13 186 t (2017)Aire de production 1 000 000 ha (2005)modifier - modifier le code - modifier Wikidata Le cantal (ou fourme de cantal) est un fromage français à pâte pressée non...

This X-ray film reveals a poor crown-to-root ratio for tooth #21 (right), the lower left first premolar. The tooth exhibits 50% bone loss, adding roughly 5-7 mm to the clinical crown of what is actually anatomical root. The fulcrum, existing somewhere immediately apical to the height of the bone, does not allow for any adjacent bone to avoid compression or tension, resulting in virtually complete widening of the PDL and a grim prognosis, due to secondary occlusal trauma. Crown-to-root-ratio i...

Serbian officer and military writer You can help expand this article with text translated from the corresponding article in Serbian. (February 2022) Click [show] for important translation instructions. View a machine-translated version of the Serbian article. Machine translation, like DeepL or Google Translate, is a useful starting point for translations, but translators must revise errors as necessary and confirm that the translation is accurate, rather than simply copy-pasting machine-...

Gustavo de Arístegui Embajador de España en la India 15 de abril de 2012-13 de diciembre de 2015 Diputado en las Cortes Generalespor Guipúzcoa, Ciudad Real y Zamora 27 de marzo de 2000-13 de diciembre de 2011 Información personalNombre en inglés Gustavo De Aristegui Nacimiento 6 de junio de 1963 (60 años)Madrid, EspañaNacionalidad EspañolaFamiliaPadre Pedro Manuel de Arístegui y Petit Información profesionalOcupación AbogadoPartido político Partido PopularSitio web gustavodea...

Assembly constituency in Maharashtra Sindkhed Raja Assembly constituency is one of the 288 constituencies of the Maharashtra Vidhan Sabha and one of the seven which are located in the Buldhana district. Sindkhed RajaConstituency No. 24 for the Maharashtra Legislative AssemblyConstituency detailsCountryIndiaRegionWestern IndiaStateMaharashtraDistrictBuldhanaLS constituencyBuldhanaReservationNoneMember of Legislative Assembly14th Maharashtra Legislative AssemblyIncumbent Dr. Shingne Rajendra Bh...