BLOOM (language model)

This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these messages)

This article relies excessively on references to primary sources. Please improve this article by adding secondary or tertiary sources.
Find sources: "BLOOM" language model – news · newspapers · books · scholar · JSTOR (October 2022) (Learn how and when to remove this message)

(Learn how and when to remove this message)

BigScience Large Open-science Open-access Multilingual Language Model (BLOOM)^[1]^[2] is a 176-billion-parameter transformer-based autoregressive large language model (LLM). The model, as well as the code base and the data used to train it, are distributed under free licences.^[3] BLOOM was trained on approximately 366 billion (1.6TB) tokens from March to July 2022.^[4]^[5]

BLOOM is the main outcome of the BigScience collaborative initiative,^[6] a one-year-long research workshop that took place between May 2021 and May 2022. BigScience was led by HuggingFace and involved several hundreds of researchers and engineers from France and abroad representing both the academia and the private sector. BigScience was supported by a large-scale public compute grant on the French public supercomputer Jean Zay, managed by GENCI and IDRIS (CNRS), on which it was trained.^{[citation needed]}

BLOOM's training corpus, named ROOTS, combines data extracted from the then-latest version of the web-based OSCAR corpus (38% of ROOTS) and newly collected data extracted from a manually selected and documented list of language data sources. It encompasses 46 natural languages (in amounts ranging from 30% of the whole dataset for English to 0.00002% for Chi Tumbuka) and 13 programming languages.^[7]

References

^ "BigScience Large Open-science Open-access Multilingual Language Model". Retrieved 2022-10-01.
^ Le Scao T, Fan A, Akiki C, Pavlick E, Ilić S, Hesslow D, Castagné R, Luccioni A, Yvon F, Gallé M, Tow J, Rush AM, Biderman S, Webson A, Sasanka Ammanamanchi P, Wang T, Sagot B, Muennighoff N, Villanova del Moral A, Ruwase O, Bawden R, Bekman S, McMillan-Major A, Beltagy I, Nguyen H, Saulnier L, Tan S, Ortiz Suarez P, Sanh V, Laurençon H, Jernite Y, Launay J, Mitchell M, Raffel C, et al. (2022). "BLOOM: A 176B-Parameter Open-Access Multilingual Language Model". arXiv:2211.05100 [cs.CL].
^ "The BigScience RAIL license". Retrieved 2024-01-10.
^ Heikkilä, Melissa (2022-07-12). "BLOOM: Inside the radical new project to democratize AI". MIT Technology Review. Retrieved 2023-12-26.
^ "Release of largest trained open-science multilingual language model ever". French National Centre for Scientific Research. 2022-07-12. Retrieved 2023-12-26.
^ "BigScience". Retrieved 2024-01-10.
^ Laurençon H, Saulnier L, Wang T, Akiki C, Villanova del Moral A, Le Scao T, Von Werra L, Mou C, González Ponferrada C, Nguyen H, Frohberg J, Šaško M, Lhoest Q, McMillan-Major A, Dupont G, Biderman S, Rogers A, Ben allal L, De Toni F, Pistilli G, Nguyen O, Nikpoor S, Masoud M, Colombo P, de la Rosa J, Villegas P, Thrush T, Longpre S, Nagel S, Weber L, Muñoz M, Zhu J, Van Strien D, Alyafeai Z, Almubarak K, Vu MC, Gonzalez-Dios I, Soroa A, Lo K, Dey M, Ortiz Suarez P, Gokaslan A, Bose S, Adelani D, Phan L, Tran H, Yu I, Pai S, Chim J, Lepercq V, Ilic S, Mitchell M, Luccioni S, Jernite Y (2022). "The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset". arXiv:2303.03915 [cs.CL].

Artificial intelligence

Concepts

Applications

Implementations

Audio–visual	AlexNet WaveNet Human image synthesis HWR OCR Speech synthesis ElevenLabs Speech recognition Whisper Facial recognition AlphaFold Text-to-image models Aurora DALL-E Firefly Flux Ideogram Imagen Midjourney Stable Diffusion Text-to-video models Dream Machine Gen-3 Alpha Hailuo AI Kling Sora Veo Music generation Suno AI Udio
Text	Word2vec Seq2seq GloVe BERT T5 Llama Chinchilla AI PaLM GPT 1 2 3 J ChatGPT 4 4o o1 o3 Claude Gemini chatbot Grok LaMDA BLOOM Project Debater IBM Watson IBM Watsonx Granite PanGu-Σ
Decisional	AlphaGo AlphaZero OpenAI Five Self-driving car MuZero Action selection AutoGPT Robot control

People

Architectures

Portals
- Technology
Categories
- Artificial neural networks
- Machine learning
List
- Companies
- Projects

This computational linguistics-related article is a stub. You can help Wikipedia by expanding it.

Read other articles:

Black Swan Songs

Black Swan Songs (album)Album studio karya Epik HighDirilis13 Februari 2006GenreK-pop, hip hop, rapBahasaKorea, InggrisLabelWoollim EntertainmentCJ MusicKronologi Epik High Swan Songs(2005)Swan Songs2005 Black Swan Songs(2006) Remapping the Human Soul(2007)Remapping the Human Soul2007 Black Swan Songs adalah album remix dari grup hip hop Korea Selatan, Epik High yang dirilis pada tahun 2006. Ini merupakan album repackage pertama dari grup ini.[1] Daftar lagu Disc 1 Artikel utama: ...

Bandar Udara Lloydminster

Bandar Udara LloydminsterBandar Udara LloydminsterIATA: YLLICAO: CYLLWMO: 71871InformasiJenisPublicPengelolaCity of LloydminsterMelayaniLloydminster, AlbertaKetinggian dpl699 mdplSitus webwww.lloydminster.ca/airport.htmlPetaCYLLLokasi di AlbertaLandasan pacu Arah Panjang Permukaan kaki m 08/26 5,579 1,700 Asphalt 12/30 1,500 457 Turf Statistik (2010)Pergerakan pesawat12,857Sumber: Canada Flight Supplement[1]Environment Canada[2]Movements from Statistics Canada[3&...

Harpocrates

God-child of the Greek mythology Not to be confused with Hippocrates or Carpocrates.HarpocratesPtolemaic bronze Harpocrates, Calouste Gulbenkian Foundation, LisbonMajor cult centerAlexandriaParentsIsis and Osiris or SerapisOne of two known Phoenician Harpocrates statues Harpocrates (Ancient Greek: Ἁρποκράτης, Phoenician: 𐤇𐤓𐤐𐤊𐤓𐤈,[1] romanized: ḥrpkrṭ, Coptic: ϩⲁⲣⲡⲟⲕⲣⲁⲧⲏⲥ harpokrates) was the god of silence, secrets and confidentiali...

ريتشارد براور

تحتاج هذه المقالة إلى الاستشهاد بمصادر إضافية لتحسين وثوقيتها. فضلاً ساهم في تطوير هذه المقالة بإضافة استشهادات من مصادر موثوق بها. من الممكن التشكيك بالمعلومات غير المنسوبة إلى مصدر وإزالتها. (يناير 2019) ريتشارد براور (بالألمانية: Richard Dagobert Brauer)‏ معلومات شخصية اسم ا�...

Золотой век Грузии

История Грузииსაქართველოს ისტორია Доисторическая Грузия Шулавери-шомутепинская культураКуро-араксская культураТриалетская культураКолхидская культураКобанская культураДиаухиМушки Древняя история КолхидаАриан-КартлиИберийское царство ФарнавазидыГруз�...

趙家驤

追晉陸軍二級上將趙家驤將軍个人资料出生1910年大清河南省衛輝府汲縣逝世1958年8月23日(1958歲—08—23)（47—48歲） † 中華民國福建省金門縣国籍中華民國政党中國國民黨获奖青天白日勳章（追贈）军事背景效忠中華民國服役國民革命軍中華民國陸軍服役时间1924年－1958年军衔二級上將（追晉）部队四十七師指挥東北剿匪總司令部參謀長陸軍�...

Parian Chronicle

Greek chronology inscribed on a stele Parian Marble redirects here. For marble from Paros, see Parian marble. Detail from the shorter fragment base of the stele, found in 1897, that is in a museum on Paros. It contains chronicle entries for the years 336–299 BC. The Parian Chronicle or Parian Marble (Latin: Marmor Parium, abbr. Mar. Par.) is a Greek chronology, covering the years from 1582 BC to 299 BC, inscribed on a stele. Found on the island of Paros in two sections, and sold in...

قائمة السنوات في الولايات المتحدة

يفتقر محتوى هذه المقالة إلى الاستشهاد بمصادر. فضلاً، ساهم في تطوير هذه المقالة من خلال إضافة مصادر موثوق بها. أي معلومات غير موثقة يمكن التشكيك بها وإزالتها. (ديسمبر 2018) هذه قائمة السنوات في الولايات المتحدة. القرن 18 عقد 1770: 1776 1777 1778 1779 عقد 1780: 1780 1781 1782 1783 1784 1785 1786 1787 1788 1789 عقد 179...

Shanksville, Pennsylvania

Jalanan utama di Shanksville Shanksville ialah sebuah borough di Somerset County, Pennsylvania, Amerika Serikat. Shanksville berpenduduk 245 jiwa pada tahun 2000. Nama Shanksville menyeruak di media internasional akibat serangan 11 September 2001, di mana United Airlines Penerbangan 93 jatuh di sini. Sebuah monumen akan dibangun di sini, dan pembangunannya akan selesai pada tahun 2011. Geografi Menurut United States Census Bureau, luas daerah ini mencapai 0,5 km², yang seluruhnya berupa...

Paris–Roubaix

Paris–Roubaix Paris–Roubaix 2014Rincian balapanPelaksanaanAwal AprilLokasiPrancis UtaraNama dalam bahasa InggrisParis–RoubaixNama lokalParis–Roubaix (Prancis)JulukanNeraka di UtaraRatu para KlasikBalap PaskahSatu Minggu di NerakaL'enfer du NordDisiplinJalan rayaKompetisiUCI World TourTipeSatu hariPengelolaAmaury Sport OrganisationDirektur balapanJean-François PescheuxSejarahEdisi pertama[[1896 (1896)]]Edisi terbaru112 (pada 2014)Juara pertama J...

Perundungan di sekolah

Penindasan merugikan kesehatan dan perkembangan siswa.[1] Perundungan di sekolah adalah jenis perundungan yang terjadi sehubungan dengan pendidikan yang berulang paling terjadi dan sering kali selama periode waktu yang panjang[2][3] dan menyebabkan kerusakan permanen pada korban. Perundungan dapat dilakukan secara fisik, verbal dan emosional. Referensi ^ Student Reports of Bullying, Results From the 2001 School Crime Supplement to the National Crime Victimization Surve...

Clément Russo

Questa voce sull'argomento ciclisti francesi è solo un abbozzo. Contribuisci a migliorarla secondo le convenzioni di Wikipedia. Segui i suggerimenti del progetto di riferimento. Clément RussoClément Russo in azione su Ciclocross nel 2019Nazionalità Francia Altezza186 cm Peso73 kg Ciclismo SpecialitàStrada, cross Squadra Groupama-FDJ CarrieraSquadre di club 2014-2015Charvieu-Chavagneux IC2015-2017Espoir Cycliste Saint-Étienne Loire2017 AG2R La Mondiale(stagista)2018&...

10-та морська авіаційна бригада (Україна)

У Вікіпедії є статті про інші значення цього терміна: 10-та бригада. 10-та морська авіаційна бригада Нарукавна емблема бригадиЗасновано 20 серпня 2004Країна УкраїнаВид Військово-морські силиТип Морська авіаціяЧисельність бригадаПункт базування в/ч А1688, (м. Миколаїв)до...

Adil El Arbi and Bilall Fallah

Belgian film and television directors Adil El Arbi and Bilall FallahFallah (left) and El Arbi (right), 2018BornAdil El Arbi (1988-06-30) June 30, 1988 (age 36)Edegem, BelgiumBilall Fallah (1986-01-04) January 4, 1986 (age 38)Vilvoorde, BelgiumAlma materLUCA School of Arts, BrusselsOccupationsFilm directorsscreenwritersfilm editorsYears active2010–present Adil El Arbi (born June 30, 1988) and Bilall Fallah (born January 4, 1986) are Belgian film and television directors. ...

Fiona O'Sullivan

Fiona O'Sullivan Bermain untuk Irlandia pada bulan Mei 2015Informasi pribadiNama lengkap Fiona Julia O'Sullivan[1]Tanggal lahir 17 September 1986 (umur 37)Tempat lahir San Geronimo, California, Amerika SerikatTinggi 5 ft 10 in (1,78 m)Posisi bermain PenyerangInformasi klubKlub saat ini San Francisco Dons (asisten pelatih)Karier junior2004–2007 San Francisco DonsKarier senior*Tahun Tim Tampil (Gol)2006–2007 Sonoma County Sol 2009–2010 California Storm 2010 Ch...

The Deluge (film)

1974 Polish historical drama film Not to be confused with Deluge (film). The DelugeDirected byJerzy HoffmanWritten byJerzy HoffmanAdam KerstenWojciech ZukrowskiBased onThe Delugeby Henryk SienkiewiczStarringDaniel OlbrychskiMałgorzata BraunekTadeusz ŁomnickiWładysław HańczaCinematographyJerzy WójcikEdited byZenon PióreckiMusic byKazimierz SerockiProductioncompanyZespoły FilmoweRelease date 1974 (1974) Running time287 minutesCountriesPoland, USSRLanguagePolish The Deluge (Polish: ...

19 tháng 9

Ngày 19 tháng 9 là ngày thứ 262 (263 trong năm nhuận) trong lịch Gregory. Còn 103 ngày trong năm. << Tháng 9 năm 2024 >> CN T2 T3 T4 T5 T6 T7 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 Sự kiện 1356 – Chiến tranh Trăm Năm: Quân Anh đánh bại quân Pháp và bắt giữ quốc vương của Pháp là Jean II trong trận Poitiers. 1442 – Vụ án Lệ Chi Viên: Đại thần Nguyễn Trãi của nhà Hậu L...

.rw

.rw البلد رواندا تعديل مصدري - تعديل rw. هو نطاق إنترنت من صِنف مستوى النطاقات العُليا في ترميز الدول والمناطق، للمواقع التي تنتمي إلى رواندا.[1][2] مراجع ^ النطاق الأعلى في ترميز الدولة (بالإنجليزية). ORSN [الإنجليزية]. Archived from the original on 2019-05-07. Retrieved 2017-08-07. ^ النطاق الأ...

سيتي سنتر الإسكندرية

لمعانٍ أخرى، طالع سيتي سنتر (توضيح). سيتي سنتر الإسكندريةالشعارمعلومات عامةنوع المبنى مجمع تجاري المكان الإسكندرية البلد مصر المالك مجموعة ماجد الفطيم الأبعادالمساحة 60٬000 متر مربع معلومات أخرىموقع الويب citycentrealexandria.com (الإنجليزية) الإحداثيات 31°10′05″N 29°55′55″Eþ...

パレスチナ人の帰還権

国連総会決議194（英語版）にちなんで「Resolution 194」と名付けられた作品。鍵は1948年に難民となった多くのパレスチナ人がいつの日かの帰還を待って保管していることから帰還権の象徴となった[1][2]。パレスチナ人の帰還権（パレスチナじんのきかんけん、アラビア語: حق العودة الفلسطيني‎; 短縮形はالعودة, al-ʻAwdah）は、1948年のナクバや19...