ISO/IEC 29119

ISO/IEC/IEEE 29119 Software and systems engineering -- Software testing[1] is a series of five international standards for software testing. First developed in 2007[2] and released in 2013, the standard "defines vocabulary, processes, documentation, techniques, and a process assessment model for testing that can be used within any software development lifecycle."[3]

History and revisions

Development of the set of ISO/IEC/IEEE 29119 software testing standards began in May 2007, based on existing standards such as the Institute of Electrical and Electronics Engineers's IEEE 829 (test documentation), and IEEE 1008 (unit testing); and the BSI Group's BS 7925-1 (vocabulary) and -2 (software components).[2][4]

At first the International Organization for Standardization (ISO) had no working group with significant software testing experience, so the ISO created WG26, which by 2011 was represented by more than 20 different countries.[2] Initially four sections were developed for the standard: Concepts and definitions (1), Test processes (2), Test documentation (3), and Test techniques (4).[2] A fifth part concerning process assessment was considered for addition, ultimately becoming ISO/IEC 33063:2015, which ties to 29119-2's test processes.[2][5] The actual fifth part of 29119 was published in November 2016 concerning the concept of keyword-driven testing.[6]

As of June 2018, no major revisions have occurred to the five parts of the standard. These parts are, from most recent to oldest:

  • ISO/IEC/IEEE 29119-5:2016, Part 5: Keyword-driven testing, published in November 2016[6]
  • ISO/IEC/IEEE 29119-4:2015, Part 4: Test techniques, published in December 2015[7]
  • ISO/IEC/IEEE 29119-3:2013, Part 3: Test documentation, published in September 2013[8]
  • ISO/IEC/IEEE 29119-2:2013, Part 2: Test processes, published in September 2013[9]
  • ISO/IEC/IEEE 29119-1:2013, Part 1: Concepts and definitions, published in September 2013[1]

Structure and contents

ISO/IEC/IEEE 29119-1:2013, Part 1: Concepts and definitions

ISO/IEC/IEEE 29119 Part 1 facilitates the use of the other parts of the standard by introducing the vocabulary on which the standard is built and provides examples of its application in practice.[4] Part 1 provides definitions, a description of the concepts of software testing, and ways to apply these definitions and concepts to the other parts of the standard.[1]

ISO/IEC/IEEE 29119-2:2013, Part 2: Test processes

Part 2 defines a generic test process model for software testing that is intended for use by organizations when performing software testing. It comprises test process descriptions that define the software testing processes at the organizational level, test management (project) level, and dynamic test process levels (WG26 couldn't get consensus on the inclusion of static testing).[2][3][10] The processes defined in this standard can be used in conjunction with different software development lifecycle models.[9]

ISO/IEC/IEEE 29119-3:2013, Part 3: Test documentation

This part deals with software test documentation and includes templates and test documentation examples that are produced during the test process. The templates support the three primary test process levels of Part 2, and the standard also includes mapping to other existing standards.[2][8]

The documents that are defined in ISO/IEC/IEEE 29119-3 are as follows:[2][4]

Organizational Test Process Documentation:
- Test Policy
- Organizational Test Strategy
Test Management Process Documentation:
- Test Plan (including a Test Strategy)
- Test Status
- Test Completion
Dynamic Test Process Documentation:
- Test Design Specification
- Test Case Specification
- Test Procedure Specification
- Test Data Requirements
- Test Data Readiness Report
- Test Environment Requirements
- Test Environment Readiness Report
- Actual Results
- Test Result
- Test Execution Log
- Test Incident Report

ISO/IEC/IEEE 29119-4:2015, Part 4: Test techniques

Part 4 provides standard definitions of software test design techniques (also known as test case design techniques or test methods) and corresponding coverage measures that can be used during the test design and implementation processes defined in Part 2.[7] Techniques of Part 4 are intended to support or be used separately from Part 2. The standard's test design techniques are categorized into three main categories: Specification-, Structure-, and Experience-Based Test Design Techniques.[2][11]

Specification-based test design techniques

These techniques are based on the (functional) specification of the system under test. They are also called black-box testing techniques.

Suggested test design techniques in this group are:[2][11]

Structure-based test design techniques

These structural testing techniques are based on the (internal) structure of the system under test. They are also called white-box testing techniques.

Suggested test design techniques in this group are:[2][11]

Experience-based test design techniques

These exploratory testing techniques rely on the experience of the human tester.

Suggested test design techniques in this group are:[11]

ISO/IEC/IEEE 29119-5:2016, Part 5: Keyword-driven testing

This standard covers keyword-driven testing, an approach to specifying software tests (normally automated) used in the software testing industry.[12] This standard is intended for users "who want to create keyword-driven test specifications, create corresponding frameworks, or build test automation based on keywords."[6]

Controversy

Upon introduction of ISO/IEC/IEEE 29119, culminating in the summer of 2014, some software testers and associated organizations began making calls for the ISO to rescind the standard.[13][14][15][16][17][18][19] Notable organizations that protested the standard included the Association for Software Testing[18] and the International Society for Software Testing[20] Some reasons for opposition to the standard included:

  • lack of true consensus of content—as required by ISO/IEC—among professional testers[13][20][15][16]
  • heavy focus on documentation will detract from the actual process of software testing[13][14][18]
  • ISO 29119 is inconsistent with the way that people work on cognitively demanding tasks, while reinforcing the way they cling to unhelpful practices while doing complex, stressful organisations [19]
  • the standard fails to take account of relevant work elsewhere on the balance of rules and principles in regulation and standards; the standard is unclear about the principles that should govern testing, while being over-prescriptive about the detail, leading to a confusion of means and ends[19]
  • the standard effectively excludes context-driven testing[16][17]
  • standardization of software testing in general is unnecessary[15][18]
  • the standard has political and monetary connotations and is too prescriptive, which doesn't benefit the industry[13][17][18]

Dr. Stuart Reid, convenor of WG26, replied to some of these and other opposing viewpoints in September 2014,[21] though it's not clear if any further action by WG26 was taken due to software testers' complaints.

References

  1. ^ a b c "ISO/IEC/IEEE 29119-1:2013". Standards catalogue. International Organization for Standardization. September 2013. Retrieved 24 June 2018.
  2. ^ a b c d e f g h i j k Reid, S. (2012). "The New Software Testing Standard". In Dale, C.; Anderson, T. (eds.). Achieving Systems Safety: Proceedings of the Twentieth Safety-Critical Systems Symposium, Bristol, UK, 7-9th February 2012. Springer Science & Business Media. pp. 237–56. ISBN 9781447124948.
  3. ^ a b Shoemaker, D.; Sigler, K. (2014). "Chapter 6: Software Impelementation Process Group". Cybersecurity: Engineering a Secure Information Technology Organization. Cengage Learning. pp. 117–34. ISBN 9781305443471.
  4. ^ a b c Pröll, R.; Bauer, B. (2018). "Toward a Consistent and Strictly Model-Based Interpretation of the ISO/IEC/IEEE 29119 for Early Testing Activities". Proceedings of the 6th International Conference on Model-Driven Engineering and Software Development (MODELSWARD 2018): 699–706. doi:10.5220/0006749606990706. ISBN 978-989-758-283-7.
  5. ^ "ISO/IEC 33063:2015". Standards catalogue. International Organization for Standardization. August 2015. Retrieved 24 June 2018.
  6. ^ a b c "ISO/IEC/IEEE 29119-5:2016". Standards catalogue. International Organization for Standardization. November 2016. Retrieved 24 June 2018.
  7. ^ a b "ISO/IEC/IEEE 29119-4:2015". Standards catalogue. International Organization for Standardization. December 2015. Retrieved 24 June 2018.
  8. ^ a b "ISO/IEC/IEEE 29119-3:2013". Standards catalogue. International Organization for Standardization. September 2013. Retrieved 24 June 2018.
  9. ^ a b "ISO/IEC/IEEE 29119-2:2013". Standards catalogue. International Organization for Standardization. September 2013. Retrieved 24 June 2018.
  10. ^ Kasurinen, J.; Runeson, P.; Riungu, L.; et al. (2011). "A Self-assessment Framework for Finding Improvement Objectives with ISO/IEC 29119 Test Standard". In Connor, R.V.; Pries-Heje, J.; Messnarz, R. (eds.). Systems, Software and Services Process Improvement: 18th European Conference, EuroSPI 2011, Roskilde, Denmark, June 27-29, 2011, Proceedings. Springer Science & Business Media. pp. 25–36. ISBN 9783642222054.
  11. ^ a b c d "ISO/IEC/IEEE 29119-4:2015-12 (E) Table of Contents". Normenausschuss Informationstechnik und Anwendungen (NIA). Deutsches Institut für Normung e. V. Archived from the original on 25 June 2018. Retrieved 24 June 2018.
  12. ^ Faught, D.R. (5 November 2004). "Keyword-Driven Testing". StickyMinds. TechWell Corp. Retrieved 24 June 2018.
  13. ^ a b c d Krill, P. (22 August 2014). "Software testers balk at ISO 29119 standards proposal". InfoWorld. IDG Communications, Inc. Retrieved 24 June 2018.
  14. ^ a b Demman, J. (9 September 2014). "Software testers petition to stop ISO 29119". TechTarget SearchSoftwareQuality. TechTarget, Inc. Retrieved 24 June 2018.
  15. ^ a b c McCowatt, I. (24 August 2014). "STOP 29119". Exploring Uncertainty: A Software Testing Blog. Archived from the original on 13 October 2014. Retrieved 24 June 2018.
  16. ^ a b c Bach, J. (25 August 2014). "How Not to Standardize Testing (ISO 29119)". Satisfice Blog. Satisfice, Inc. Retrieved 24 June 2018.
  17. ^ a b c Kaner, C. (28 August 2014). "Please sign the Petition to Stop ISO 29119". context-driven-testing.com. Retrieved 24 June 2018.
  18. ^ a b c d e "The ISO29119 debate". Association for Software Testing. 5 September 2014. Retrieved 24 June 2018.
  19. ^ a b c Christie, J. (28 August 2015). "Why ISO 29119 Is a Flawed Quality Standard". Better Software Magazine. Retrieved 23 July 2018.
  20. ^ a b "Petition against ISO 29119". International Society for Software Testing. 19 August 2014. Archived from the original on 8 February 2017. Retrieved 24 June 2018.
  21. ^ Marnane, T.; Reid, S. (10 September 2014). "Response to Stop 29119 Petition". SoftwareTestingStandard.org. Archived from the original on 16 February 2020. Retrieved 24 June 2018.

Read other articles:

Danelaw

Part of England ruled by Danes (878–954) DanelawDanelagen (Danish)Dena lagu (Old English)878–954England, 878StatusConfederacy under the Kingdom of DenmarkCommon languagesOld NorseOld EnglishReligion Norse paganism (mostly Norsemen) Christianity (mostly Anglo-Saxons) History • Treaty of Wedmore 878• Scandinavian York merges with Wessex[1][2] 927• Fully conquered 954 Preceded by Succeeded by Northumbria Mercia East Anglia Kingdom of E...

 

 

قرية دانيمورا (نيويورك)

قرية دانيمورا   الإحداثيات 44°43′15″N 73°43′08″W / 44.7208°N 73.7189°W / 44.7208; -73.7189  [1] تقسيم إداري  البلد الولايات المتحدة[2]  التقسيم الأعلى مقاطعة كلينتون  خصائص جغرافية  المساحة 3.127197 كيلومتر مربع2.972604 كيلومتر مربع (1 أبريل 2010)  ارتفاع 431 متر،  و43...

 

 

2013 United States Senate special election in Massachusetts

US special election held on June 25, 2013 2013 United States Senate special election in Massachusetts ← 2008 June 25, 2013 2014 →   Nominee Ed Markey Gabriel E. Gomez Party Democratic Republican Popular vote 645,429 525,307 Percentage 54.80% 44.60% County results Municipality results Precinct resultsMarkey:      40–50%      50–60%      60–70%      70–80% ...

Rising Tide Charter Public School

Public charter school in the United StatesRising Tide Charter Public SchoolLocation59 Armstrong Road (Middle and High School)Plymouth, MA 02360United StatesInformationTypePublic charterEstablished1998; 26 years ago (1998)School districtRising Tide Charter Public SchoolSuperintendentMichael O'Keefe (Head of School)PrincipalZahra WilliamsFaculty46.7[2]Grades5-12Enrollment660[1]Color(s)Dark Blue, GreyTeam nameHeronsWebsiteRising Tide Charter Rising Tide Charter ...

 

 

Gadolinium

64GdGadoliniumSampel gadolinium Garis spektrum gadoliniumSifat umumNama, lambanggadolinium, GdPengucapan/gadolinium/[1] Penampilanputih keperakanGadolinium dalam tabel periodik 64Gd Hidrogen Helium Lithium Berilium Boron Karbon Nitrogen Oksigen Fluor Neon Natrium Magnesium Aluminium Silikon Fosfor Sulfur Clor Argon Potasium Kalsium Skandium Titanium Vanadium Chromium Mangan Besi Cobalt Nikel Tembaga Seng Gallium Germanium Arsen Selen Bromin Kripton Rubidium Strontium Yttrium Zirc...

 

 

Lada Riva

This article is about the compact car known as the Lada Riva or Lada Nova in some countries. It is not to be confused with the 4×4 vehicle formerly known as the Lada Niva. Motor vehicle Lada RivaLada Riva (VAZ 2105)OverviewManufacturerAvtoVAZAlso calledDennis / Lada Signet (Canada)[1]Lada 1500 (Colombia, Canada)Lada 2104 / VAZ 2104Lada 2105 / VAZ 2105Lada 2107 / VAZ 2107Lada ClassicLada Clásico (Ecuador)Lada Nova (Denmark & West Germany)Lada Kalinka (France, East Germany, P...

Волынка

У этого термина существуют и другие значения, см. Волынка (значения). Волынка Пример звучания Классификация Духовой язычковый музыкальный инструмент  Медиафайлы на Викискладе Волы́нка — традиционный музыкальный духовой язычковый[1] инструмент многих народов �...

 

 

200 років Миколаївській астрономічній обсерваторії (монета)

200 років Миколаївській астрономічній обсерваторії УкраїнаНомінал 5 гривеньМаса 16,54 гДіаметр 35,0 ммГурт рифленийМетал нейзильберРоки карбування 2021Аверс Реверс «200 ро́ків Микола́ївській астрономі́чній обсервато́рії» — пам'ятна монета номіналом 5 гривень, вип�...

 

 

Raute people

Hari tribe of Nepal This article includes a list of general references, but it lacks sufficient corresponding inline citations. Please help to improve this article by introducing more precise citations. (May 2016) (Learn how and when to remove this message) Raute elder drums at public dance in Jajarkot District, Nepal. Photo: J. Fortier Raute are a nomadic traveling ethnic group officially recognized by the Government of Nepal. They are known for subsistence hunting of langur and macaque monk...

1981 New South Wales state election

State election for New South Wales, Australia in March 1981 1981 New South Wales state election ← 1978 19 September 1981 (1981-09-19) 1984 → All 99 seats in the New South Wales Legislative Assembly and 15 (of the 44) seats in the New South Wales Legislative Council50 Assembly seats were needed for a majority   First party Second party   Leader Neville Wran Bruce McDonald Party Labor Liberal/National coalition Leader since 17 November 1973 1 ...

 

 

Susan Walsh (swimmer)

American swimmer Susan WalshWalsh at the 1981 UniversiadePersonal informationFull nameSusan WalshNicknameSueNational team United StatesBorn1962Hamburg, New YorkSportSportSwimmingStrokesBackstrokeCollege teamUniversity of North CarolinaCoachFrank Comfort(UNC) Medal record Women's swimming Representing the United States World Championships 1982 Guayaquil 4×100 m medley 1982 Guayaquil 100 m backstroke Pan American Games 1983 Caracas 4×100 m medley 1983 Caracas 100 m backstroke 1...

 

 

Синапное

У этого топонима есть и другие значения, см. Зелёное. СелоСинапноеукр. Синапне, крымскотат. Ulu Sala 44°40′30″ с. ш. 34°00′40″ в. д.HGЯO Страна  Россия/ Украина[1] Регион Республика Крым[2]/Автономная Республика Крым[3] Район Бахчисарайский район Община Вер�...

West Branch Mad River

River in New Hampshire, United StatesWest Branch Mad RiverThe West Branch upstream from the West Branch Road bridge in Waterville ValleyShow map of New HampshireShow map of the United StatesLocationCountryUnited StatesStateNew HampshireCountyGraftonTownWaterville ValleyPhysical characteristicsSourceMount Tecumseh • locationWaterville Valley • coordinates43°58′19″N 71°33′28″W / 43.97194°N 71.55778°W / 43.97194; -71.55778&...

 

 

Retenue collinaire

Cet article est une ébauche concernant l’agriculture et la montagne. Vous pouvez partager vos connaissances en l’améliorant (comment ?) selon les recommandations des projets correspondants. Une petite retenue collinaire au Royaume-Uni. Les retenues collinaires sont des ouvrages de stockage de l'eau qui sont remplies par les eaux de ruissellement et déconnectés du réseau hydrographique. Elles font partie de lacs artificiels (lacs de barrage) qui sont des lacs de retenue. Descrip...

 

 

Salvador

Pour les articles homonymes, voir Salvador (homonymie). République du Salvador(es) República de El Salvador Drapeau du Salvador Armoiries du Salvador Devise en espagnol : Dios, Unión, Libertad (« Dieu, union, liberté ») Hymne en espagnol : Himno Nacional de El Salvador (« Hymne national du Salvador ») Fête nationale 15 septembre · Événement commémoré Indépendance vis-à-vis de l'Espagne (1821) Administration Forme de l'Ét...

Hoàng đạo

Hoàng đạo hay mặt phẳng hoàng đạo là đường đi biểu kiến của Mặt Trời trên thiên cầu.[1][2] Các nhà thiên văn cũng xét đến mặt phẳng chứa hoàng đạo, nó đồng phẳng với quỹ đạo của Trái Đất quanh Mặt Trời (và do vậy trở thành quỹ đạo biểu kiến của Mặt Trời quanh Trái Đất). Đường đi của Mặt Trời thường ít được chú ý tới khi nhìn từ bề mặt Trái Đất do...

 

 

Velociraptor

VelociraptorRentang fosil: Kapur Akhir, 75–71 jtyl PreЄ Є O S D C P T J K Pg N ↓ Pajangan replika V. mongoliensis di Institut Sains Alam Belgia Klasifikasi ilmiah Kerajaan: Animalia Filum: Chordata (tanpa takson): Dinosauria (tanpa takson): Saurischia (tanpa takson): Theropoda Famili: †Dromaeosauridae (tanpa takson): †Eudromaeosauria Subfamili: †Velociraptorinae Genus: †VelociraptorOsborn, 1924 Spesies tipe †Velociraptor mongoliensisOsborn, 1924 Spesies lain †V.? o...

 

 

نبل (حلب)

في هذه المقالة ألفاظ تعظيم تمدح موضوع المقالة، وهذا مخالف لأسلوب الكتابة الموسوعية. فضلاً، أَزِل ألفاظ التفخيم واكتفِ بعرض الحقائق بصورة موضوعية ومجردة ودون انحياز. (نقاش) (يونيو 2014) نبل   الاسم الرسمي نُبّل الإحداثيات 36°22′51″N 36°59′40″E / 36.38083°N 36.99444°E / 36.38083; 3...

Air terjun Cipamingkis

Pemandangan Air Terjun Cipamingkis Air Terjun Cipamingkis merupakan salah satu destinasi Wisata Air Terjun di Kawasan Wisata Puncak Dua Jonggol, tepatnya berada di Desa Warga Jaya, Kecamatan Sukamakmur, Bogor, Jawa Barat. Curug Cipamingkis terletak di ketinggian 1100 mdpl di kawasan hutan milik Perhutani dengan luas 16,5 hektar. Curug Cipamingkis dibuka tahun 2010 bekerja sama dengan LMDH (Lembaga Masyarakat Desa Hutan) Puncak Mandiri Desa Warga Jaya, Kecamatan Sukamakmur, Jonggol. Wisata ini...

 

 

Hassan Bchara

Questa voce sull'argomento lottatori è solo un abbozzo. Contribuisci a migliorarla secondo le convenzioni di Wikipedia. Hassan BecharaNazionalità Libano Altezza180 cm Lotta SpecialitàLotta greco-romana Termine carriera? Palmarès Competizione Ori Argenti Bronzi Olimpiadi 0 0 1 Vedi maggiori dettagli  Modifica dati su Wikidata · Manuale Hassan Ali Bechara (in arabo حسن علي بشارة‎?; Beirut, 17 marzo 1945 – 24 luglio 2017[1]) è stato un l...