Scalability

Scalability is the property of a system to handle a growing amount of work. One definition for software systems specifies that this may be done by adding resources to the system.[1]

In an economic context, a scalable business model implies that a company can increase sales given increased resources. For example, a package delivery system is scalable because more packages can be delivered by adding more delivery vehicles. However, if all packages had to first pass through a single warehouse for sorting, the system would not be as scalable, because one warehouse can handle only a limited number of packages.[2]

In computing, scalability is a characteristic of computers, networks, algorithms, networking protocols, programs and applications. An example is a search engine, which must support increasing numbers of users, and the number of topics it indexes.[3] Webscale is a computer architectural approach that brings the capabilities of large-scale cloud computing companies into enterprise data centers.[4]

In distributed systems, there are several definitions according to the authors, some considering the concepts of scalability a sub-part of elasticity, others as being distinct. According to Marc Brooker: "a system is scalable in the range where marginal cost of additional workload is nearly constant." Serverless technologies fit this definition but you need to consider total cost of ownership not just the infra cost. [5]

In mathematics, scalability mostly refers to closure under scalar multiplication.

In industrial engineering and manufacturing, scalability refers to the capacity of a process, system, or organization to handle a growing workload, adapt to increasing demands, and maintain operational efficiency. A scalable system can effectively manage increased production volumes, new product lines, or expanding markets without compromising quality or performance. In this context, scalability is a vital consideration for businesses aiming to meet customer expectations, remain competitive, and achieve sustainable growth. Factors influencing scalability include the flexibility of the production process, the adaptability of the workforce, and the integration of advanced technologies. By implementing scalable solutions, companies can optimize resource utilization, reduce costs, and streamline their operations. Scalability in industrial engineering and manufacturing enables businesses to respond to fluctuating market conditions, capitalize on emerging opportunities, and thrive in an ever-evolving global landscape.[citation needed]

Examples

The Incident Command System (ICS) is used by emergency response agencies in the United States. ICS can scale resource coordination from a single-engine roadside brushfire to an interstate wildfire. The first resource on scene establishes command, with authority to order resources and delegate responsibility (managing five to seven officers, who will again delegate to up to seven, and on as the incident grows). As an incident expands, more senior officers assume command.[6]

Dimensions

Scalability can be measured over multiple dimensions, such as:[7]

  • Administrative scalability: The ability for an increasing number of organizations or users to access a system.
  • Functional scalability: The ability to enhance the system by adding new functionality without disrupting existing activities.
  • Geographic scalability: The ability to maintain effectiveness during expansion from a local area to a larger region.
  • Load scalability: The ability for a distributed system to expand and contract to accommodate heavier or lighter loads, including, the ease with which a system or component can be modified, added, or removed, to accommodate changing loads.
  • Generation scalability: The ability of a system to scale by adopting new generations of components.
  • Heterogeneous scalability is the ability to adopt components from different vendors.

Domains

  • A routing protocol is considered scalable with respect to network size, if the size of the necessary routing table on each node grows as O(log N), where N is the number of nodes in the network. Some early peer-to-peer (P2P) implementations of Gnutella had scaling issues. Each node query flooded its requests to all nodes. The demand on each peer increased in proportion to the total number of peers, quickly overrunning their capacity. Other P2P systems like BitTorrent scale well because the demand on each peer is independent of the number of peers. Nothing is centralized, so the system can expand indefinitely without any resources other than the peers themselves.
  • A scalable online transaction processing system or database management system is one that can be upgraded to process more transactions by adding new processors, devices and storage, and which can be upgraded easily and transparently without shutting it down.
  • The distributed nature of the Domain Name System (DNS) allows it to work efficiently, serving billions of hosts on the worldwide Internet.

Horizontal (scale out) and vertical scaling (scale up)

Resources fall into two broad categories: horizontal and vertical.[8]

Horizontal or scale out

Scaling horizontally (out/in) means adding or removing nodes, such as adding a new computer to a distributed software application. An example might involve scaling out from one web server to three. High-performance computing applications, such as seismic analysis and biotechnology, scale workloads horizontally to support tasks that once would have required expensive supercomputers. Other workloads, such as large social networks, exceed the capacity of the largest supercomputer and can only be handled by scalable systems. Exploiting this scalability requires software for efficient resource management and maintenance.[7]

Vertical or scale up

Scaling vertically (up/down) means adding resources to (or removing resources from) a single node, typically involving the addition of CPUs, memory or storage to a single computer.[7]

Benefits to scale-up include avoiding increased management complexity, more sophisticated programming to allocate tasks among resources and handling issues such as throughput, latency, and synchronization across nodes. Moreover some applications do not scale horizontally.

Network scalability

Network function virtualization defines these terms differently: scaling out/in is the ability to scale by adding/removing resource instances (e.g., virtual machine), whereas scaling up/down is the ability to scale by changing allocated resources (e.g., memory/CPU/storage capacity).[9]

Database scalability

Scalability for databases requires that the database system be able to perform additional work given greater hardware resources, such as additional servers, processors, memory and storage. Workloads have continued to grow and demands on databases have followed suit.

Algorithmic innovations include row-level locking and table and index partitioning. Architectural innovations include shared-nothing and shared-everything architectures for managing multi-server configurations.

Strong versus eventual consistency (storage)

In the context of scale-out data storage, scalability is defined as the maximum storage cluster size which guarantees full data consistency, meaning there is only ever one valid version of stored data in the whole cluster, independently from the number of redundant physical data copies. Clusters which provide "lazy" redundancy by updating copies in an asynchronous fashion are called 'eventually consistent'. This type of scale-out design is suitable when availability and responsiveness are rated higher than consistency, which is true for many web file-hosting services or web caches (if you want the latest version, wait some seconds for it to propagate). For all classical transaction-oriented applications, this design should be avoided.[10]

Many open-source and even commercial scale-out storage clusters, especially those built on top of standard PC hardware and networks, provide eventual consistency only, such as some NoSQL databases like CouchDB and others mentioned above. Write operations invalidate other copies, but often don't wait for their acknowledgements. Read operations typically don't check every redundant copy prior to answering, potentially missing the preceding write operation. The large amount of metadata signal traffic would require specialized hardware and short distances to be handled with acceptable performance (i.e., act like a non-clustered storage device or database).[citation needed]

Whenever strong data consistency is expected, look for these indicators:[citation needed]

  • the use of InfiniBand, Fibrechannel or similar low-latency networks to avoid performance degradation with increasing cluster size and number of redundant copies.
  • short cable lengths and limited physical extent, avoiding signal runtime performance degradation.
  • majority / quorum mechanisms to guarantee data consistency whenever parts of the cluster become inaccessible.

Indicators for eventually consistent designs (not suitable for transactional applications!) are:[citation needed]

  • write performance increases linearly with the number of connected devices in the cluster.
  • while the storage cluster is partitioned, all parts remain responsive. There is a risk of conflicting updates.

Performance tuning versus hardware scalability

It is often advised to focus system design on hardware scalability rather than on capacity. It is typically cheaper to add a new node to a system in order to achieve improved performance than to partake in performance tuning to improve the capacity that each node can handle. But this approach can have diminishing returns (as discussed in performance engineering). For example: suppose 70% of a program can be sped up if parallelized and run on multiple CPUs instead of one. If is the fraction of a calculation that is sequential, and is the fraction that can be parallelized, the maximum speedup that can be achieved by using P processors is given according to Amdahl's Law:

Substituting the value for this example, using 4 processors gives

Doubling the computing power to 8 processors gives

Doubling the processing power has only sped up the process by roughly one-fifth. If the whole problem was parallelizable, the speed would also double. Therefore, throwing in more hardware is not necessarily the optimal approach.

Universal Scalability Law

In distributed systems, you can use Universal Scalability Law (USL) to model and to optimize scalability of your system. USL is coined by Neil J. Gunther and quantifies scalability based on parameters such as contention and coherency. Contention refers to delay due to waiting or queueing for shared resources. Coherence refers to delay for data to become consistent. For example, having a high contention indicates sequential processing that could be parallelized, while having a high coherency suggests excessive dependencies among processes, prompting you to minimize interactions. Also, with help of USL, you can, in advance, calculate the maximum effective capacity of your system: scaling up your system beyond that point is a waste. [11]

Weak versus strong scaling

High performance computing has two common notions of scalability:

  • Strong scaling is defined as how the solution time varies with the number of processors for a fixed total problem size.
  • Weak scaling is defined as how the solution time varies with the number of processors for a fixed problem size per processor.[12]

See also

References

  1. ^ Bondi, André B. (2000). Characteristics of scalability and their impact on performance. Proceedings of the second international workshop on Software and performance – WOSP '00. p. 195. doi:10.1145/350391.350432. ISBN 158113195X.
  2. ^ Hill, Mark D. (1990). "What is scalability?" (PDF). ACM SIGARCH Computer Architecture News. 18 (4): 18. doi:10.1145/121973.121975. S2CID 1232925. and
    Duboc, Leticia; Rosenblum, David S.; Wicks, Tony (2006). A framework for modelling and analysis of software systems scalability (PDF). Proceedings of the 28th international conference on Software engineering – ICSE '06. p. 949. doi:10.1145/1134285.1134460. ISBN 1595933751.
  3. ^ Laudon, Kenneth Craig; Traver, Carol Guercio (2008). E-commerce: Business, Technology, Society. Pearson Prentice Hall/Pearson Education. ISBN 9780136006459.
  4. ^ "Why web-scale is the future". Network World. 2020-02-13. Retrieved 2017-06-01.
  5. ^ Building Serverless Applications on Knative. O'Reilly Media. ISBN 9781098142049.
  6. ^ Bigley, Gregory A.; Roberts, Karlene H. (2001-12-01). "The Incident Command System: High-Reliability Organizing for Complex and Volatile Task Environments". Academy of Management Journal. 44 (6): 1281–1299. doi:10.5465/3069401 (inactive 1 November 2024). ISSN 0001-4273.{{cite journal}}: CS1 maint: DOI inactive as of November 2024 (link)
  7. ^ a b c Hesham El-Rewini and Mostafa Abd-El-Barr (April 2005). Advanced Computer Architecture and Parallel Processing. John Wiley & Sons. p. 66. ISBN 978-0-471-47839-3.
  8. ^ Michael, Maged; Moreira, Jose E.; Shiloach, Doron; Wisniewski, Robert W. (March 26, 2007). Scale-up x Scale-out: A Case Study using Nutch/Lucene. 2007 IEEE International Parallel and Distributed Processing Symposium. p. 1. doi:10.1109/IPDPS.2007.370631. ISBN 978-1-4244-0909-9.
  9. ^ "Network Functions Virtualisation (NFV); Terminology for Main Concepts in NFV". Archived from the original (PDF) on 2020-05-11. Retrieved 2016-01-12.
  10. ^ Sadek Drobi (January 11, 2008). "Eventual consistency by Werner Vogels". InfoQ. Retrieved April 8, 2017.
  11. ^ Gunther, Neil (2007). Guerrilla Capacity Planning: A Tactical Approach to Planning for Highly Scalable Applications and Services. ISBN 978-3540261384.
  12. ^ "The Weak Scaling of DL_POLY 3". STFC Computational Science and Engineering Department. Archived from the original on March 7, 2014. Retrieved March 8, 2014.

Read other articles:

Kue keranjang Potongan kue keranjang Pekerja sedang mengayak tepung kue keranjang Kue keranjang (ada yang menyebutnya kue bakul, dodol Tionghoa, dodol Cina atau jenang Cina dalam bahasa Jawa) yang disebut juga sebagai nián gāo (年糕) dalam bahasa Mandarin atau tiⁿ-kóe (甜棵) dalam bahasa Hokkien,[1] yang mendapat nama dari wadah cetaknya yang berbentuk keranjang,[2] adalah kue yang terbuat dari tepung ketan dan gula,[3] serta mempunyai tekstur yang kenyal dan ...

 

2014 American filmThink Like a Man TooTheatrical release postersDirected byTim StoryWritten by David A. Newman Keith Merryman Based onAct Like a Lady, Think Like a Manby Steve HarveyProduced byWill PackerStarring Michael Ealy Jerry Ferrara Meagan Good Regina Hall Taraji P. Henson Terrence J Romany Malco Wendi McLendon-Covey Gary Owen Gabrielle Union La La Anthony Kevin Hart CinematographyChristopher DuskinEdited byPeter S. ElliotMusic byChristopher LennertzProductioncompanyWill Packer Produc...

 

British clearing house group Not to be confused with the historic Bankers' Clearing House in London, that performed cheque clearing, now operated by the Cheque and Credit Clearing Company. LCH GroupCompany typePrivateIndustryFinancialFounded1888; 136 years ago (1888)HeadquartersLondon, England, UKProductsClearing houseOwnerLondon Stock Exchange Group (82.61%)Websitewww.lch.com LCH (originally London Clearing House) is a financial market infrastructure company headquartered i...

Universitas Islam MakassarLogo Universitas Islam MakassarJenisPerguruan Tinggi SwastaDidirikan21 Februari 1966Afiliasi keagamaanIslamRektorProf. Dr. H. Muammar Bakri, Lc. M.Ag.Jumlah mahasiswa8.421 orangJumlah mahasiswa lain214LokasiKota MakassarKampusUrbanAlamatJl. Perintis Kemerdekaan KM.9 No.29 Kota MakassarWarna  HijauNama julukanUIM, Kampus Biru, Al-GhazaliSitus webhttps://uim-makassar.ac.id/ Universitas Islam Makassar yang kemudian disingkat UIM, merupakan sebuah perguruan tinggi Islam...

 

Islam menurut negara Afrika Aljazair Angola Benin Botswana Burkina Faso Burundi Kamerun Tanjung Verde Republik Afrika Tengah Chad Komoro Republik Demokratik Kongo Republik Kongo Djibouti Mesir Guinea Khatulistiwa Eritrea Eswatini Etiopia Gabon Gambia Ghana Guinea Guinea-Bissau Pantai Gading Kenya Lesotho Liberia Libya Madagaskar Malawi Mali Mauritania Mauritius Maroko Mozambik Namibia Niger Nigeria Rwanda Sao Tome dan Principe Senegal Seychelles Sierra Leone Somalia Somaliland Afrika Selatan ...

 

В состав Житомирской области Украины входят 12 городов. Русскоеназвание Украинскоеназвание Район Население,чел.[1] Основан Статусгорода Герб Координаты Андрушёвка Андрушівка Бердичевский 8 951 1683 1975 50°01′08″ с. ш. 29°01′09″ в. д.HGЯO Барановка Баранівка Новоград-...

1950 children's fantasy novel by C.S. Lewis For the film adaptation of the novel, see The Chronicles of Narnia: The Lion, the Witch and the Wardrobe. For other uses (disambiguation), see The Lion, the Witch and the Wardrobe (disambiguation). The Lion, the Witch and the Wardrobe First edition dustjacketAuthorC. S. LewisIllustratorPauline BaynesCover artistPauline BaynesCountryUnited KingdomLanguageEnglishSeriesThe Chronicles of NarniaGenreChildren's fantasy, Christian literatureSet i...

 

Artikel ini bukan mengenai Huruf latin H. Huruf Kiril En Penggunaan Fonetis:[n]Nama:нашьNomor Kiril:50Sampel suaranoicon sumber · bantuan Alfabet KirilHuruf SlaviaАА́А̀А̂А̄ӒБВГҐДЂЃЕЕ́ÈЕ̂ЁЄЖЗЗ́ЅИИ́ЍИ̂ЙІЇЈКЛЉМНЊОŌПРСС́ТЋЌУУ́ У̀У̂ӮЎФХЦЧЏШЩЪЫЬЭЮЯHuruf non-SlaviaӐА̊А̃Ӓ̄ӔӘӘ́Ә̃ӚВ̌ҒГ̑Г̣Г̌ҔӺҒ̌ӶД̌Д̣Д̆ӖЕ̄Е̃Ё̄Є̈ӁҖӜҘӞЗ̌З̱З̣ԐԐ̈ӠӢИ̃ҊӤҚӃҠҞҜК̣Ԛ...

 

OTAN vs.Pacte de Varsovie Chars M48 Patton de la 7e armée des États-Unis face aux T-55 de l'Armée de terre soviétique à Checkpoint Charlie, Berlin, en octobre 1961. Informations générales Date 1955 à 1991 Lieu Europe Issue Chute des régimes communistes en Europe entraînant la dissolution du pacte de Varsovie Belligérants Pays membres de l'OTAN[1],[2] Pays membres du pacte de Varsovie[3],[4] Forces en présence États-Unis (en Europe) : 326 400 RFA : 494 300 Gde...

Russian writer and playwright Mikhail ArtsybashevBorn(1878-11-05)November 5, 1878Kharkov, Russian EmpireDiedMarch 3, 1927(1927-03-03) (aged 48)Warsaw, PolandPeriod1900s-1920sGenreFiction, dramaLiterary movementNaturalismChildrenBoris Artzybasheff Mikhail Petrovich Artsybashev (Russian: Михаи́л Петро́вич Арцыба́шев; Polish: Michał Arcybaszew; Ukrainian: Михайло Петрович Арцибашев; November 5, 1878 – March 3, 1927) was a Russian writer a...

 

Questa voce sugli argomenti circondari della Germania e Baviera è solo un abbozzo. Contribuisci a migliorarla secondo le convenzioni di Wikipedia. Circondario di Weilheim-SchongaucircondarioLandkreis Weilheim-Schongau LocalizzazioneStato Germania Land Baviera Distretto Alta Baviera AmministrazioneCapoluogoWeilheim in Oberbayern TerritorioCoordinatedel capoluogo47°50′N 11°09′E / 47.833333°N 11.15°E47.833333; 11.15 (Circondario di Weilheim-Schongau...

 

United States Law Indian Reorganization ActOther short titlesIndian New DealIndian Reorganization Act of 1934Long titleAn Act to conserve and develop Indian lands and resources; to extend to Indians the right to form business and, other organizations; to establish a credit system for Indians; to grant certain rights of home rule to Indians; to provide for vocational education for Indians; and for other purposes.NicknamesWheeler–Howard ActEnacted bythe 73rd United States CongressEffecti...

هذه المقالة تحتاج للمزيد من الوصلات للمقالات الأخرى للمساعدة في ترابط مقالات الموسوعة. فضلًا ساعد في تحسين هذه المقالة بإضافة وصلات إلى المقالات المتعلقة بها الموجودة في النص الحالي. (سبتمبر 2023) هذه المقالة يتيمة إذ تصل إليها مقالات أخرى قليلة جدًا. فضلًا، ساعد بإضافة وصلة...

 

2020年夏季奥林匹克运动会波兰代表團波兰国旗IOC編碼POLNOC波蘭奧林匹克委員會網站olimpijski.pl(英文)(波兰文)2020年夏季奥林匹克运动会(東京)2021年7月23日至8月8日(受2019冠状病毒病疫情影响推迟,但仍保留原定名称)運動員206參賽項目24个大项旗手开幕式:帕维尔·科热尼奥夫斯基(游泳)和马娅·沃什乔夫斯卡(自行车)[1]闭幕式:卡罗利娜·纳亚(皮划艇)&#...

 

Place in Buenos Aires, ArgentinaVilla MaipúVilla MaipúLocation in Greater Buenos AiresCoordinates: 34°34′S 58°32′W / 34.567°S 58.533°W / -34.567; -58.533Country ArgentinaProvince Buenos AiresPartidoGeneral San MartínElevation28 m (92 ft)Population (2001 census [INDEC]) • Total24,447CPA BaseB 1650Area code+54 11 Villa Maipú is a localidad (district) of the General San Martín Partido in Buenos Aires Province, Argentina. It for...

Bosnian basketball player Kenan BajramovićBajramović with Beşiktaş in 2014Personal informationBorn (1981-05-24) May 24, 1981 (age 42)Zenica, SR Bosnia and HerzegovinaSFR YugoslaviaNationalityBosnianListed height2.06 m (6 ft 9 in)Listed weight104 kg (229 lb)Career informationNBA draft2003: undraftedPlaying career1997–2019PositionPower forwardNumber51Career history1997–2003Čelik Zenica2003–2005Bosna2005–2007Azovmash Mariupol2007–2008Lietuvos rytas200...

 

Campionati mondiali di biathlonSport Biathlon Tipoindividuale FederazioneIBU OrganizzatoreInternational Biathlon Union TitoloCampione del mondo Cadenzaannuale StoriaFondazione1958 Ultima edizioneCampionati mondiali di biathlon 2024 Prossima edizioneCampionati mondiali di biathlon 2025 Modifica dati su Wikidata · Manuale Un momento della gara di staffetta maschile ai Mondiali del 2007, ad Anterselva (Italia) I Campionati mondiali di biathlon sono una competizione sportiva organizzata dal...

 

العلاقات الكورية الجنوبية الميانمارية كوريا الجنوبية ميانمار   كوريا الجنوبية   ميانمار تعديل مصدري - تعديل   العلاقات الكورية الجنوبية الميانمارية هي العلاقات الثنائية التي تجمع بين كوريا الجنوبية وميانمار.[1][2][3][4][5] مقارنة بين البلدين ...

British stay-behind units in the Second World War This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: Auxiliary Units – news · newspapers · books · scholar · JSTOR (September 2023) (Learn how and when to remove this message) The Auxiliary Units, Home Guard Shock Squads[1] or GHQ Auxiliary Units were spec...

 

Final Piala Liga Inggris 1981TurnamenPiala Liga Inggris 1980–1981 Liverpool West Ham United Liverpool West Ham United 1 1 Tanggal14 Maret 1981StadionStadion Wembley, LondonWasitClive Thomas (Treorchy)[1]Penonton100.000Pertandingan ulangan West Ham United Liverpool 2 1 Tanggal1 April 1981StadionVilla Park, BirminghamWasitClive Thomas (Treorchy)Penonton36.693← 1980 1982 → Final Piala Liga Inggris 1981 adalah pertandingan final ke-21 dari turnamen sepak bola Piala Liga Ingg...