Linus's law

In software development, Linus's law is the assertion that "given enough eyeballs, all bugs are shallow". The law was formulated by Eric S. Raymond in his essay and book The Cathedral and the Bazaar (1999), and was named in honor of Linus Torvalds.[1][2]

A more formal statement is: "Given a large enough beta-tester and co-developer base, almost every problem will be characterized quickly and the fix obvious to someone." Presenting the code to multiple developers with the purpose of reaching consensus about its acceptance is a simple form of software reviewing. Researchers and practitioners have repeatedly shown the effectiveness of reviewing processes in finding bugs and security issues.[3]

Validity

In Facts and Fallacies about Software Engineering, Robert Glass refers to the law as a "mantra" of the open source movement, but calls it a fallacy due to the lack of supporting evidence and because research has indicated that the rate at which additional bugs are uncovered does not scale linearly with the number of reviewers; rather, there is a small maximum number of useful reviewers, between two and four, and additional reviewers above this number uncover bugs at a much lower rate.[4] While closed-source practitioners also promote stringent, independent code analysis during a software project's development, they focus on in-depth review by a few and not primarily the number of "eyeballs".[5]

The persistence of the Heartbleed security bug in a critical piece of code for two years has been considered as a refutation of Raymond's dictum.[6][7][8][9] Larry Seltzer suspects that the availability of source code may cause some developers and researchers to perform less extensive tests than they would with closed source software, making it easier for bugs to remain.[9] In 2015, the Linux Foundation's executive director Jim Zemlin argued that the complexity of modern software has increased to such levels that specific resource allocation is desirable to improve its security. Regarding some of 2014's largest global open source software vulnerabilities, he says, "In these cases, the eyeballs weren't really looking".[8] Large scale experiments or peer-reviewed surveys to test how well the mantra holds in practice have not been performed.[10]

Empirical support of the validity of Linus's law[11] was obtained by comparing popular and unpopular projects of the same organization. Popular projects are projects with the top 5% of GitHub stars (7,481 stars or more). Bug identification was measured using the corrective commit probability, the ratio of commits determined to be related to fixing bugs. The analysis showed that popular projects had a higher ratio of bug fixes (e.g., Google's popular projects had a 27% higher bug fix rate than Google's less popular projects). Since it is unlikely that Google lowered its code quality standards in more popular projects, this is an indication of increased bug detection efficiency in popular projects.

See also

References

  1. ^ Raymond, Eric S. "The Cathedral and the Bazaar". catb.org.
  2. ^ Raymond, Eric S. (1999). The Cathedral and the Bazaar. O'Reilly Media. p. 30. ISBN 1-56592-724-9.
  3. ^ Pfleeger, Charles P.; Pfleeger, Shari Lawrence (2003). Security in Computing, 4th Ed. Prentice Hall PTR. pp. 154–157. ISBN 0-13-239077-9.
  4. ^ Glass, Robert L. (2003). Facts and Fallacies of Software Engineering. Addison-Wesley. p. 174. ISBN 0-321-11742-5. ISBN 978-0321117427.
  5. ^ Howard, Michael; LeBlanc, David (2003). Writing Secure Code, 2nd. Ed. Microsoft Press. pp. 44–45, 615, 726. ISBN 0-7356-1722-8.
  6. ^ Byfield, Bruce (April 14, 2014). "Does Heartbleed Disprove 'Open Source is Safer'?". Datamation.
  7. ^ Felten, Edward W.; Kroll, Joshua A. (2014). "Help Wanted on Internet Security". Scientific American. 311 (1): 14. Bibcode:2014SciAm.311a..14F. doi:10.1038/scientificamerican0714-14. PMID 24974688.
  8. ^ a b Kerner, Sean Michael (February 20, 2015). "Why All Linux (Security) Bugs Aren't Shallow". eSecurity Planet. Retrieved February 21, 2015.
  9. ^ a b Seltzer, Larry (April 14, 2014). "Did open source matter for Heartbleed?". ZDNet.
  10. ^ Arceneaux, Kevin; Gerber, Alan S.; Green, Donald P. (January 2006). "Comparing Experimental and Matching Methods Using a Large-Scale Voter Mobilization Experiment". Political Analysis. 14 (1): 37–62. doi:10.1093/pan/mpj001. ISSN 1047-1987.
  11. ^ Amit, Idan; Feitelson, Dror G. (2020). "The Corrective Commit Probability Code Quality Metric". arXiv:2007.10912 [cs.SE].

Further reading

Read other articles:

Kōichirō Genba

Kōichirō Genba玄葉 光一郎 Menteri Urusan Luar NegeriMasa jabatan2 September 2011 – 26 Desember 2012Perdana MenteriYoshihiko Noda PendahuluTakeaki MatsumotoPenggantiFumio Kishida Informasi pribadiLahir20 Mei 1964 (umur 59)Tamura, Fukushima, JepangPartai politikPartai DemokratikAlma materUniversitas SophiaSunting kotak info • L • B Kōichirō Genba (玄葉 光一郎code: ja is deprecated , Genba Kōichirō, kelahiran 20 Mei 1964) adalah politisi Jepang dan m...

 

Aksi T4

Aksi T4 (bahasa Jerman: Aktion T4) adalah program Nazi yang resminya berlangsung antara tahun 1939 dan 1941, dan sepanjang masa tersebut Adolf Hitler telah melakukan pembunuhan secara sistematis terhadap 200.000 hingga 250.000 penderita kelainan genetika.[1] Setelah tahun 1941, pembunuhan tersebut menjadi tidak resmi dan tidak terlalu sistematis lagi.[2] Kode T4 adalah singkatan dari kata Tiergartenstrasse 4, yaitu nama sebuah jalan di pusat kota Berlin di wilayah Tiergarten. ...

 

1844 Democratic National Convention

U.S. political event held in Baltimore, Maryland 1844 Democratic National Convention1844 presidential election Nominees Polk and DallasConventionDate(s)May 27–30, 1844CityBaltimore, MarylandVenueOdd Fellows HallCandidatesPresidential nomineeJames K. Polk of TennesseeVice presidential nomineeGeorge M. Dallas of Pennsylvania‹ 1840 · 1848 › The 1844 Democratic National Convention was a presidential nominating convention held in Baltimore, Maryland from May 27 through 3...

Youel (Gnosticism)

Gnostic term for Angel   Part of a series onGnosticism Gnostic concepts Adam kasia Adam pagria Aeon Anima mundi Archon Barbelo Demiurge Five Seals Gnosis Kenoma Luminary Manda Monad Ogdoad Pleroma Sophia Uthra World of Light World of Darkness Yaldabaoth Gnostic sects and founders List of Gnostic sects Proto-Gnosticism Maghāriya Thomasines Judean / Israelite Adam Mandaeism Elksai Elkasaites Samaritan Baptist Dositheos Simon Magus (Simonians) Menander Quqites Christian Gnosticism Apelles ...

 

MMDMA

Chemical compound The topic of this article may not meet Wikipedia's general notability guideline. Please help to demonstrate the notability of the topic by citing reliable secondary sources that are independent of the topic and provide significant coverage of it beyond a mere trivial mention. If notability cannot be shown, the article is likely to be merged, redirected, or deleted.Find sources: MMDMA – news · newspapers · books · scholar · JSTOR (Nove...

 

Criminal Investigation Department (Bangladesh)

Bangladesh Police unit Criminal Investigation Department(C.I.D.)অপরাধ তদন্ত বিভাগSeal of Criminal Investigation DepartmentFlag of Criminal Investigation DepartmentAgency overviewFormed1971JurisdictionGovernment of BangladeshHeadquartersMalibagh, DhakaAgency executiveAddl. IGP Mohammad Ali Mia, BPM, PPM, Chief ExecutiveParent agencyBangladesh PoliceWebsitewww.cid.gov.bd The Criminal Investigation Department (CID)[1] is a specialized intelligence and invest...

Girish Kasaravalli

Girish Kasaravalliಗಿರೀಶ್ ಕಾಸರವಳ್ಳಿLahir03 Desember 1950 (umur 73)Kesaluru, Thirthahalli, Shimoga, Mysuru, IndiaPekerjaanSutradara, produser, penulis latarSuami/istriVaishali KasaravalliPenghargaanPenghargaan Film Nasional berganda[1] Girish Kasaravalli (bahasa Kannada: ಗಿರೀಶ್ ಕಾಸರವಳ್ಳಿ); (kelahiran 3 Desember 1950)[2] adalah sebuah sutradara India, dalam sinema Kannada, dan salah satu pelopor Sinema Paralel....

 

Currency crisis

When a country's central bank lacks the foreign reserves to maintain a fixed exchange rate A currency crisis is a type of financial crisis, and is often associated with a real economic crisis. A currency crisis raises the probability of a banking crisis or a default crisis. During a currency crisis the value of foreign denominated debt will rise drastically relative to the declining value of the home currency. Generally doubt exists as to whether a country's central bank has sufficient foreig...

 

Andrew Dabb

Dabb di San Diego Comic-Con International. Andrew Dabb (lahir di Ogden, Utah; saat ini tinggal di Los Angeles) adalah seorang penulis Amerika, yang bekerja di bidang televisi, film dan novel grafis. Karier Karya-karya Andrew Dabb mencakup Ghostbusters: Legion, Happydale: Devils in the Desert, dan Atomika; serta seri G.I. Joe dan Dungeons & Dragons. Dabb juga menulis seri komik daring berjudul Slices pada situs opi8.com.[butuh rujukan] Dabb saat ini menulis untuk acara televisi Sup...

Princess Caroline of Great Britain

British princess (1713-1757) Princess CarolinePortrait by Jacopo Amigoni, c. 1730sBorn(1713-06-10)10 June 1713 (New Style)Herrenhausen Palace, HanoverDied28 December 1757(1757-12-28) (aged 44)St James's Palace, LondonBurial5 January 1758Westminster Abbey, LondonHouseHanoverFatherGeorge II of Great BritainMotherCaroline of Ansbach Princess Caroline Elizabeth of Great Britain (10 June 1713 – 28 December 1757) was the fourth child and third daughter of King George II of Great Britai...

 

Horatio Seymour 1868 presidential campaign

Horatio Seymour for PresidentCampaignU.S. presidential election, 1868CandidateHoratio SeymourFrancis Preston Blair Jr.AffiliationDemocratic PartyStatusLost general election In 1868, the Democrats nominated former New York Governor Horatio Seymour for President and Francis Preston Blair Jr. (a Representative from Missouri) for Vice President.[1] The Seymour-Blair ticket ran on a platform which supported national reconciliation and states' rights, opposed Reconstruction, and opposed bo...

 

Armenian Taekwondo Federation

Sporting Organization Armenian Taekwondo Federation logo The Armenian Taekwondo Federation (Armenian: Հայաստանի թաեքվոնդոյի ֆեդերացիա), is the regulating body of taekwondo in Armenia, governed by the Armenian Olympic Committee. The headquarters of the federation is located in Yerevan.[1] History The Federation is currently led by president Karen Grigoryan. The Federation became a member of World Taekwondo in 1996, and subsequently became a full member of t...

Garrulus

Genus of birds Garrulus G. glandarius glaszneri, Cyprus Scientific classification Domain: Eukaryota Kingdom: Animalia Phylum: Chordata Class: Aves Order: Passeriformes Family: Corvidae Genus: GarrulusBrisson, 1760 Type species Garrulus glandariusLinnaeus, 1758 Species Garrulus glandarius Garrulus lanceolatus Garrulus lidthi Garrulus is a genus of Old World jays, passerine birds in the family Corvidae. Taxonomy and systematics The genus was established by French zoologist Mathurin Jacques Bris...

 

乌克兰总理

 烏克蘭總理Прем'єр-міністр України烏克蘭國徽現任杰尼斯·什米加尔自2020年3月4日任命者烏克蘭總統任期總統任命首任維托爾德·福金设立1991年11月后继职位無网站www.kmu.gov.ua/control/en/（英文） 乌克兰 乌克兰政府与政治系列条目 宪法 政府 总统 弗拉基米尔·泽连斯基 總統辦公室 国家安全与国防事务委员会 总统代表（英语：Representatives of the President of Ukraine） 总...

 

Військово-музичне управління Збройних сил України

Військово-музичне управління Збройних сил України Тип військове формуванняЗасновано 1992Країна  Україна Емблема управління Військово-музичне управління Збройних сил України — структурний підрозділ Генерального штабу Збройних сил України призначений для планува...

Battle of Salamanca

1812 battle during the Peninsular War This article is about the battle in the Peninsular War. For the battle in Mexico during the Reform War, see Battle of Salamanca (1858). This article includes a list of general references, but it lacks sufficient corresponding inline citations. Please help to improve this article by introducing more precise citations. (July 2011) (Learn how and when to remove this message) Battle of SalamancaPart of the Peninsular WarWellington at Salamanca by William Heat...

 

White House

Official residence and workplace of the president of the United States 1600 Pennsylvania Avenue redirects here. For other uses, see 1600 Pennsylvania Avenue (disambiguation) and White House (disambiguation). White HouseTop: the Executive Residence's northern facade with a columned portico facing the North Lawn and Lafayette Square Bottom: the Executive Residence's southern facade with a semi-circular portico facing the South Lawn and The EllipseLocation of the White House in Washington, D.C.S...

 

Google Terjemahan

Google TranslateBeranda Google TerjemahanURLtranslate.google.comTipeStatistik dan mesin neuralBersifat komersial?YaPendaftaranOpsionalBahasa109 bahasa, lihat dibawahPenggunaLebih dari 500 juta pengguna setiap hariPemilikGooglePembuatGoogle Web DeveloperGoogle Berdiri sejak28 April 2006; 18 tahun lalu (2006-04-28) (Sebagai mesin terjemahan statistik)15 November 2016; 7 tahun lalu (2016-11-15) (sebagai mesin terjemahan neural)StatusAktifBlog resmihttps://blog.google/products/translate...

Cuisine of the Midwestern United States

Regional cuisine of the United States This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: Cuisine of the Midwestern United States – news · newspapers · books · scholar · JSTOR (November 2019) (Learn how and when to remove this message) Minnesota potluck Part of a series onAmerican cuisine Regional cuisines North...

 

دالة التقسيم (الفيزياء)

هذه المقالة بحاجة لصندوق معلومات. فضلًا ساعد في تحسين هذه المقالة بإضافة صندوق معلومات مخصص إليها. يفتقر محتوى هذه المقالة إلى الاستشهاد بمصادر. فضلاً، ساهم في تطوير هذه المقالة من خلال إضافة مصادر موثوق بها. أي معلومات غير موثقة يمكن التشكيك بها وإزالتها. (ديسمبر 2020) دالة ا...