There are unknown unknowns

Rumsfeld during a Pentagon news briefing in February 2002

"There are unknown unknowns" is a phrase from a response United States Secretary of Defense Donald Rumsfeld gave to a question at a U.S. Department of Defense (DoD) news briefing on February 12, 2002, about the lack of evidence linking the government of Iraq with the supply of weapons of mass destruction to terrorist groups.[1] Rumsfeld stated:

Reports that say that something hasn't happened are always interesting to me, because as we know, there are known knowns; there are things we know we know. We also know there are known unknowns; that is to say we know there are some things we do not know. But there are also unknown unknowns—the ones we don't know we don't know. And if one looks throughout the history of our country and other free countries, it is the latter category that tends to be the difficult ones.[1]

The statement became the subject of much commentary. In The Decision Book (2013), author Mikael Krogerus [de] refers to it as the "Rumsfeld matrix".[2] The statement also features in a 2013 documentary film, The Unknown Known, directed by Errol Morris.[3]

Known unknowns refers to "risks you are aware of, such as canceled flights",[4] whereas unknown unknowns are risks that come from situations that are so unexpected that they would not be considered.

With respect to awareness and understanding, unknown unknowns can be compared to other types of problems in the following matrix:

Awareness–understanding matrix[5]
Aware Not aware
Understand Known knowns:
Things we are aware of and understand 		Unknown knowns:
Things we are not aware of but do understand or know implicitly
Don't understand Known unknowns:
Things we are aware of but don't understand 		Unknown unknowns:
Things we are neither aware of nor understand

Origins

Rumsfeld's statement brought attention to the concepts of known knowns, known unknowns, and unknown unknowns, but national security and intelligence professionals have long used an analysis technique referred to as the Johari window. The idea of unknown unknowns was created in 1955 by two American psychologists, Joseph Luft and Harrington Ingham in their development of the Johari window.[citation needed] They used it as a technique to help people better understand their relationship with themselves as well as others.

The term was also commonly used inside NASA.[6] Rumsfeld cited NASA administrator William Graham in his memoir; he wrote that he had first heard "a variant of the phrase" from Graham when they served together on the Commission to Assess the Ballistic Missile Threat to the United States during the late 1990s.[7] Kirk Borne, an astrophysicist who was employed as a data scientist at NASA Goddard Space Flight Center at the time, said in an April 2013 TED talk that he had used the phrase "unknown unknowns" in a talk to personnel at the Homeland Security Transition Planning Office a few days prior to Rumsfeld's remarks, and speculated that the term may have percolated up to Rumsfeld and other high-ranking officials in the Defense Department.[8]

The terms "known unknowns" and "unknown unknowns" are often used in project management and strategic planning[9] circles.

Contemporary usage is largely consistent with the earliest known usages. For example, the term was used in evidence given to the British Columbia Royal Commission of Inquiry into Uranium Mining in 1979:

Site conditions always pose unknowns, or uncertainties, which may become known during construction or operation to the detriment of the facility and possibly lead to damage of the environment or endanger public health and safety. The risk posed by unknowns is somewhat dependent on the nature of the unknown relative to past experience. This has led me to classify unknowns into one of the following two types: 1. known unknowns (expected or foreseeable conditions), which can be reasonably anticipated but not quantified based on past experience as exemplified by case histories (in Appendix A) and 2. Unknown unknowns (unexpected or unforeseeable conditions), which pose a potentially greater risk simply because they cannot be anticipated based on past experience or investigation. Known unknowns result from recognized but poorly understood phenomena. On the other hand, unknown unknowns are phenomena which cannot be expected because there has been no prior experience or theoretical basis for expecting the phenomena.[10]

The term also appeared in a 1982 New Yorker article on the aerospace industry, which cites the example of metal fatigue, the cause of crashes in de Havilland Comet airliners in the 1950s.[11]

Reaction

Canadian columnist Mark Steyn called it "in fact a brilliant distillation of quite a complex matter".[12] Australian economist and blogger John Quiggin wrote: "Although the language may be tortured, the basic point is both valid and important."[13]

Psychoanalytic philosopher Slavoj Žižek says that beyond these three categories there is a fourth, the unknown known, that which one intentionally refuses to acknowledge that one knows: "If Rumsfeld thinks that the main dangers in the confrontation with Iraq were the 'unknown unknowns', that is, the threats from Saddam whose nature we cannot even suspect, then the Abu Ghraib scandal shows that the main dangers lie in the "unknown knowns"—the disavowed beliefs, suppositions and obscene practices we pretend not to know about, even though they form the background of our public values."[14]

German sociologists Christopher Daase and Oliver Kessler agreed that the cognitive frame for political practice may be determined by the relationship between "what we know, what we do not know, what we cannot know", but stated that Rumsfeld left out "what we do not like to know".[15]

The event has been used in multiple books to discuss risk assessment.[3][16]

Rumsfeld named his 2011 autobiography Known and Unknown: A Memoir. In the author's note at the start of the book, he expressly acknowledges the source of his memoir's title and mentions a few examples of his statement's prominence.[17] The Unknown Known is the title of Errol Morris's 2013 biographical documentary film about Rumsfeld.[18] In it, Rumsfeld initially defines "unknown knowns" as "the things you think you know, that it turns out you did not", and toward the end of the film he defines the term as "things that you know, that you don't know you know".[19]

Rumsfeld's comment earned the 2003 Foot in Mouth Award from the British Plain English Campaign.[20]

Historical context

The concept of unknown unknowns, a recognition of things that are not only outside of one's knowledge but outside of one's awareness, has historical precedence in Persian literature. A notable example is a poem from the 14th-century Ibn Yamin, which categorizes knowledge and ignorance into four states:[21][22]

  • Known knowns: One who knows and knows that they know. Someone capable of transcending limits ("Their horse of wisdom will reach the skies").
  • Unknown knowns: One who knows, but doesn’t know that they know. Someone asleep, requiring enlightenment.
  • Known unknowns: One who doesn’t know, but knows that they don’t know. Someone capable of overcoming challenges ("Can manage to bring their limping mule home").
  • Unknown unknowns: One who doesn’t know and doesn’t know that they don’t know. Someone eternally lost in compound ignorance.

In the unknown unknowns category, compound ignorance refers to ignorance that is compounded by the lack of self-awareness about one's limitations.

Analytical sciences

The term "known unknowns" has been applied to the identification of chemical substances using analytical chemistry approaches, specifically mass spectrometry. In many cases, an unknown to an investigator that is detected in an experiment is actually known in the chemical literature, a reference database, or an Internet resource. These types of compounds are termed "known unknowns". The term was originally coined by Little et al.[23] and reported a number of times in the literature since then as a general approach.[24][25][26][27]

See also

References

  1. ^ a b "Defense.gov News Transcript: DoD News Briefing – Secretary Rumsfeld and Gen. Myers". United States Department of Defense. February 12, 2002. Archived from the original on April 6, 2016.
  2. ^ Krogerus, Mikael (2012). The Decision Book: Fifty Models for Strategic Thinking. Roman Tschäppeler, Jenny Piening (1st American ed.). New York: W.W. Norton & Co. pp. 86–87. ISBN 978-0-393-07961-6. OCLC 738350045.
  3. ^ a b Girard, John; Girard, JoAnn (June 1, 2009). A Leader's Guide to Knowledge Management: Drawing on the Past to Enhance Future Performance. Business Expert Press. pp. 55–. ISBN 9781606490198. Retrieved February 10, 2014.
  4. ^ Biafore, Bonnie (December 14, 2011). "Project Management Fundamentals". Lynda.com. Lynda.com/LinkedIN. Retrieved October 17, 2015.
  5. ^ The Rumsfeld Matrix (Chapter 13) - The Climate Demon, Saravanan R., Cambridge University Press (2021) Online ISBN 9781009039604, DOI https://doi.org/10.1017/9781009039604
  6. ^ "NASA Program Management and Procurement Procedures and Practices: Hearings Before the Subcommittee on Space Science and Applications of the Committee on Science and Technology, U.S. House of Representatives, Ninety-seventh Congress, First Session, June 24, 25, 1981". 1981.
  7. ^ Rumsfeld, Donald (2011). Known and Unknown: A Memoir. New York: Penguin Group. p. xiv. ISBN 9781101502495.
  8. ^ "Big Data, Small World: Kirk Borne at TEDxGeorgeMasonU". YouTube. June 10, 2013. Archived from the original on December 22, 2021. Retrieved September 14, 2015.
  9. ^ Courtney, Hugh; Kirkland, Jane; Viguerie, Patrick (November 1997). "Strategy Under Uncertainty". Harvard Business Review. 75 (6): 66–79. PMID 10174798.
  10. ^ "Phase V: Waste Disposal". Statement of Evidence of E. D'Appolonia, D'Appolonia Consulting Engineers, Pittsburgh, Pennsylvania. Proceedings of the British Columbia Royal Commission of Inquiry into Uranium Mining. 1979. ISBN 978-0-7718-8198-5. 0005037606.
  11. ^ Newhouse, J. (June 14, 1982), "A reporter at large: a sporty game; 1-betting the company", New Yorker, pp. 48–105.
  12. ^ Steyn, Mark (December 9, 2003). "Rummy speaks the truth, not gobbledygook". Daily Telegraph. Retrieved October 30, 2008.
  13. ^ Quiggin, John (February 10, 2004). "In Defense of Rumsfeld". johnquiggin.com. Retrieved January 5, 2024.
  14. ^ Žižek, Slavoj (May 21, 2004). "What Rumsfeld Doesn't Know That He Knows About Abu Ghraib". In These Times. Retrieved February 23, 2009 – via lacan.com.
  15. ^ Daase, Christopher; Kessler, Oliver (December 2007). "Knowns and Unknowns in the 'War on Terror': Uncertainty and the Political Construction of Danger". Security Dialogue. 38 (4): 411–434. doi:10.1177/0967010607084994. ISSN 0967-0106. S2CID 145253344.
  16. ^ Neve, Geert de; Luetchford, Peter (2008). Hidden Hands in the Market: Ethnographies of Fair Trade, Ethical Consumption, and Corporate Social Responsibility. Emerald Group Publishing. pp. 252–. ISBN 9781848550582. Retrieved February 10, 2014.
  17. ^ Rumsfeld, Donald (2011). Known and Unknown: A Memoir. New York: Penguin Group. p. xiii. ISBN 9781101502495.
  18. ^ Scott (2014). "Not Giving an Inch in a Battle of Wits and Words; Deciphering Donald H. Rumsfeld in 'The Unknown Known'". The New York Times. Retrieved April 4, 2014.
  19. ^ Morris, Errol (Director) (December 13, 2013). The Unknown Known (Motion picture). Los Angeles, CA: The Weinstein Company.
  20. ^ "Rum remark wins Rumsfeld an award". BBC News. December 2, 2003. Retrieved September 30, 2012.
  21. ^ "He will be eternally lost in his hopeless oblivion!". July 26, 2016.
  22. ^ "Donald Rumsfeld and The Unknown Unknowns - The surprising source of the (in)famous quote". November 29, 2021.
  23. ^ Little, J.L.; Cleven, C.D.; Brown, S.D. (2011). "Identification of "Known Unknowns" utilizing accurate mass data and chemical abstracts service databases". J. Am. Soc. Mass Spectrom. 22 (2): 348–359. Bibcode:2011JASMS..22..348L. doi:10.1007/s13361-010-0034-3. PMID 21472594.
  24. ^ Little, James L. (2011). "Identification of "known unknowns" utilizing accurate mass data and ChemSpider". Journal of the American Society for Mass Spectrometry. 23 (1): 179–185. doi:10.1007/s13361-011-0265-y. PMID 22069037.
  25. ^ Stein, S. (2012). "Mass Spectral Reference Libraries: An Ever-Expanding Resource for Chemical Identification". Analytical Chemistry. 84 (17): 7274–7282. doi:10.1021/ac301205z. PMID 22803687.
  26. ^ McEachran, Andrew D.; Sobus, Jon R.; Williams, Antony J. (2016). "Identifying known unknowns using the US EPA's CompTox Chemistry Dashboard". Analytical and Bioanalytical Chemistry. 409 (7): 1729–1735. doi:10.1007/s00216-016-0139-z. PMID 27987027. S2CID 31754962.
  27. ^ Schymanski, Emma L.; Williams, Antony J. (2017). "Open Science for Identifying "Known Unknown" Chemicals". Environmental Science and Technology. 51 (10): 5357–5359. Bibcode:2017EnST...51.5357S. doi:10.1021/acs.est.7b01908. PMC 6260822. PMID 28475325.

Read other articles:

Coyolxauhqui

Piringan yang menggambarkan Coyolxauhqui yang terpotong-potong. Piringan ini ditemukan pada tahun 1978 di Ciudad de Mexico. Dalam mitologi Aztek, Coyolxauhqui (Nahuatl Klasik: Coyolxāuhqui [kojoɬˈʃaːʍki]) adalah putri dari Coatlicue dan Mixcoatl, dan merupakan pemimpin Centzon Huitznahuas, dewa-dewa bintang selatan. Coyolxauhqui adalah penyihir yang kuat dan memimpin saudara-saudaranya menyerang Coatlicue karena Coatlicue sedang hamil dan hal tersebut membuat mereka merasa malu. Nam...

 

East Room

East Room adalah ruangan untuk acara dan resepsi di Executive Residence, sebuah bangunan dalam kompleks Gedung Putih, tempat tinggal presiden Amerika Serikat. Ruang Timur adalah ruangan terbesar di Executive Residence; digunakan untuk tarian, resepsi, konferensi pers, upacara, konser, dan pesta makan. Ruang Timur merupakan salah satu ruangan terakhir yang selesai dan dihias, dan telah mengalami renovasi substansial selama dua abad terakhir. Sejak tahun 1964, Komite Pelestarian Gedung Putih, m...

 

List of Asian astronauts

This is a list of astronauts, who are in a restricted sense, Asians. If Asian is restricted to refer to people from the continent of Asia, exclusive of Asian Russia and Turkey, who are not of predominantly European, African, or American ancestry, then the list is as follows: The first country listed is that of citizenship; the second, if any, is that of the Asian country of birth and/or ancestry, where different. Those of Asian ancestry but were born outside Asia are excluded. The table list...

Bay Road (Bristol County, Massachusetts)

United States historic placeBay RoadU.S. National Register of Historic PlacesU.S. Historic district Bay Road at Wheaton Farm in EastonLocationEaston, MassachusettsNRHP reference No.72000118[1]Added to NRHPMay 5, 1972 United States historic placeOld Bay RoadU.S. National Register of Historic PlacesU.S. Historic district Bay Road near Winnicunnet Pond in NortonLocationNorton, MassachusettsBuilt1640NRHP reference No.74000362[1]Added to NRHPNovember 8, 1974 Bay...

 

Nikita Rukavytsya

Nikita Rukavytsya Rukavytsya bersama Beitar Jerusalem pada 2015Informasi pribadiNama lengkap Nikita Vadimovich Rukavytsya[1]Tanggal lahir 22 Juni 1987 (umur 36)Tempat lahir Mykolaiv, RSS UkrainaTinggi 1,85 m (6 ft 1 in)Posisi bermain PenyerangInformasi klubKlub saat ini Western UnitedNomor 13Karier junior2000 Torpedo Mykolaiv2001–2003 Inglewood United2003–2004 Perth SC2005–2006 AISKarier senior*Tahun Tim Tampil (Gol)2007–2009 Perth Glory 42 (16)2009–2010...

 

Old Stock Americans

Americans who are descended from the original settlers of the Thirteen Colonies Old Stock AmericansPioneer Stock, Anglo-AmericansRegions with significant populationsUnited States and Canada[1]LanguagesAmerican English, Pennsylvania German, historical minority Jersey Dutch, Swedish, Finnish, and French.ReligionChristianity (primarily Protestantism, with some Catholicism especially in Maryland) and minority JudaismRelated ethnic groupsBritish, English, Irish, Welsh, Scots, Ulster-Scots,...

Natrium

Halaman ini berisi artikel tentang unsur kimia. Untuk nutrisi yang umum disebut natrium, lihat garam. Untuk penggunaan lain, lihat natrium (disambiguasi). 11NaNatriumLogam natrium murni Garis spektrum natriumSifat umumNama, lambangnatrium, NaPengucapan/natrium/[1] Penampilanmetalik putih keperakanNatrium dalam tabel periodik 11Na Hidrogen Helium Lithium Berilium Boron Karbon Nitrogen Oksigen Fluor Neon Natrium Magnesium Aluminium Silikon Fosfor Sulfur Clor Argon Potasium Kalsium ...

 

Pammakaristos Church

Greek Orthodox Byzantine church in Istanbul, Turkey Fethiye Mosque redirects here. For other uses, see Fethiye Mosque (disambiguation). Pammakaristos ChurchΜονή ΠαμμακάριστουFethiye CamiiPammakaristos ChurchReligionAffiliationIslam (currently) Greek Orthodox Church (previously)LocationLocationIstanbul, TurkeyLocation within the Fatih district of IstanbulGeographic coordinates41°01′45″N 28°56′47″E / 41.02917°N 28.94639°E / 41.02917; 28.94639...

 

Holbæk

Town in northern Zealand, Denmark You can help expand this article with text translated from the corresponding article in Danish. (January 2023) Click [show] for important translation instructions. Machine translation, like DeepL or Google Translate, is a useful starting point for translations, but translators must revise errors as necessary and confirm that the translation is accurate, rather than simply copy-pasting machine-translated text into the English Wikipedia. Do not translate t...

Bendera Swiss

Rasio 1:1 Bendera Swiss diperkenalkan sejak tahun 1889. Bendera ini pertama kali ditemukan pada abad ke-12. Bendera ini terdiri dari palang putih yang terdiri dari latar belakang berwarna merah. Bendera ini memiliki perbandingan panjang dan lebar 1:1. Saat ini hanya ada dua negara berdaulat yang memiliki bendera dengan perbandingan 1:1, selain Swiss yaitu Vatikan. lbsBendera di duniaBendera negara berdaulat · Daerah dependensiAfrika Afrika Selatan Afrika Tengah Aljazair Angola Benin Bot...

 

Pohnpei

Kota Kolonia. Peta Pulau Pohnpei. Pohnpei di atas (pohn) altar batu (pei) (sebelumnya disebut Ponape) adalah sebuah pulau di Kepulauan Senyavin. Pulau ini merupakan bagian dari negara bagian Pohnpei, salah satu dari empat negara bagian di Federasi Mikronesia. Ibu kota Federasi Mikronesia, Palikir, terletak di pulau Pohnpei. Bandar Udara Internasional Pohnpei (IATA kode PNI) terletak di dekat Kolonia, di sebuah pulau kecil di pantai utara Pohnpei yang disebut Deketik. Pulau Pohnpei adalah pula...

 

N1 (rocket)

This article is about the Soviet rocket. For the Japanese rocket, see N-I (rocket). Soviet super heavy-lift launch vehicle N1/L3Mockup at the Baikonur Cosmodrome in late 1967FunctionCrewed lunar launch vehicle/Super heavy-lift launch vehicleManufacturerOKB-1Country of originUSSRSizeHeight105.3 meters (345 ft)[1]Diameter17.0 meters (55.8 ft)[2]Mass2,750 tonnes (6,060,000 lb)Stages5Capacity Payload to LEOMass95 t (209,000 lb)[2]Payload to TLIMass...

News media endorsements in the 2020 United States presidential primaries

2020 U.S. presidential election Timeline 2017–2019 January–October 2020 November 2020 – January 2021 Presidential debates Parties Polling national statewide News media endorsements primary general Fundraising Russian interference Presidential electors (fake electors) Electoral College vote count Presidential transition Subsequent voting restrictions Attempts to overturn Protests inauguration week Lawsuits pre-election post-election Texas v. Pennsylvania January 6 Capitol attack timelin...

 

Almeley railway station

Former railway station in Herefordshire, England AlmeleyAlmeley station platformGeneral informationLocationAlmeley, HerefordshireEnglandCoordinates52°09′31″N 2°58′56″W / 52.1587°N 2.9822°W / 52.1587; -2.9822Grid referenceSO329516Platforms1Other informationStatusDisusedHistoryOriginal companyKington and Eardisley RailwayPre-groupingGreat Western RailwayPost-groupingGreat Western RailwayKey dates3 August 1874Station opened1 January 1917Station closed11 Decemb...

 

Lionel Bertrand

Canadian politician (1906–1979) Lionel BertrandMember of the Canadian Parliamentfor TerrebonneIn office1940–1957Preceded byLouis-Étienne ParentSucceeded byRaymond Raymond Personal detailsBorn(1906-03-10)March 10, 1906St. Jovite, QuebecDiedMarch 26, 1979(1979-03-26) (aged 73)NationalityCanadianPolitical partyIndependent Liberal (1940-1944), Liberal Party (1945-) Lionel Bertrand (March 10, 1906 – March 26, 1979) was a Canadian politician, journalist and newspaper editor. Born in St....

Piacenza Football Club 1995-1996

Voce principale: Piacenza Calcio 1919. Piacenza FCStagione 1995-1996Sport calcio Squadra Piacenza Allenatore Luigi Cagni All. in seconda Gian Nicola Pinotti Presidente Leonardo Garilli Serie A14º Coppa ItaliaSecondo turno Maggiori presenzeCampionato: Caccia, Di Francesco, Taibi (33)Totale: Caccia, Di Francesco, Taibi (34) Miglior marcatoreCampionato: Caccia (14)Totale: Caccia (15) StadioStadio Galleana Abbonati7.815 1994-1995 1996-1997 Si invita a seguire il modello di voce Questa voce...

 

Coda (music)

Passage that brings a musical piece to an end In music, a coda (pronounced [ˈkoːda]; Italian for 'tail'; plural code) is a passage that brings a piece (or a movement) to an end. It may be as simple as a few measures, or as complex as an entire section.[1] In classical music Coda from Mozart's Piano Sonata no. 7 in C Major, K. 309, I, mm. 152–155 Playⓘ.[2] The presence of a coda as a structural element in a movement is especially clear in works written in ...

 

Tausend Fenster

Cet article est une ébauche concernant une chanson, le Concours Eurovision de la chanson et l’Autriche. Vous pouvez partager vos connaissances en l’améliorant (comment ?) selon les recommandations des projets correspondants. Tausend Fenster Chanson de Karel Gott auConcours Eurovision de la chanson 1968 Sortie 1968 Langue Allemand Genre Schlager, pop Auteur Walter Brandin Compositeur Udo Jürgens Classement 13e (ex æquo) (2 points) Chansons représentant l'Autriche au Concour...

Nepal

Der Titel dieses Artikels ist mehrdeutig. Weitere Bedeutungen sind unter Nepal (Begriffsklärung) aufgeführt. Demokratische Bundesrepublik Nepal सङ्घीय लोकतान्त्रिक गणतन्त्र नेपाल Saṅghīya Loktāntrik Gaṇatantra Nepāl Flagge Emblem Wahlspruch: जननी जन्मभूमिश्च स्वर्गादपि गरीयसी „Janani Janmabhumischa Swargadapi Gariyoshi“ (Sanskrit für „Mutter und Mutterla...

 

Aboriginal title in the Marshall Court

Court era recognizing Native American tribal rights Chief Justice John Marshall composed several early and influential opinions on aboriginal title in the United States. The Marshall Court (1801–1835) issued some of the earliest and most influential opinions by the Supreme Court of the United States on the status of aboriginal title in the United States, several of them written by Chief Justice John Marshall himself. However, without exception, the remarks of the Court on aboriginal tit...