基础模型

基础模型（英語：foundation model或base model）指一类大型机器学习模型[1]，它们经大规模数据训练而成（通常以自监督学习或半监督学习方式进行）[2]，以适应各种下游任务[3][4]。基础模型帮助实现了人工智能系统构建方式的重大革新，例如为聊天机器人和其他面向用户的人工智能提供支持。斯坦福人类中心人工智能研究所（Stanford Institute for Human-Centered Artificial Intelligence）旗下的基础模型研究中心（Center for Research on Foundation Models，简称CRFM）推广了“基础模型”这一术语的使用。[3]

早期的基础模型包括一些预训练语言模型，比如Google开发的BERT和各种早期的GPT基础模型，特别是OpenAI的“GPT-n”系列模型。这类用途广泛的模型可以通过进一步开发以适用于特定的任务或领域。[5]

除文本模型外，还先后诞生了各种视觉或多模式的基础模型，如DALL-E、Flamingo[6]、Florence和NOOR[7]等。视觉基础模型（visual foundation model，简称VFM）已与基于文本的大型语言模型相结合以构建适应特定任务的复杂模型。[8]此外，还有Meta AI开发的用于通用图像分割的Segment Anything[9]以及Google DeepMind开发的强化学习智能体Gato（英语：Gato (DeepMind)）等。[10] [11]

参考文献

  1. ^ Perrigo, Billy. The A to Z of Artificial Intelligence. Time. 13 April 2023 [22 May 2023]. （原始内容存档于2023-06-16）. 
  2. ^ Goled, Shraddha. Self-Supervised Learning Vs Semi-Supervised Learning: How They Differ. Analytics India Magazine. 7 May 2021 [22 May 2023]. （原始内容存档于2023-06-18）. 
  3. ^ 3.0 3.1 Introducing the Center for Research on Foundation Models (CRFM). Stanford HAI. [11 June 2022]. （原始内容存档于2023-06-04）. 
  4. ^ Goldman, Sharon. Foundation models: 2022's AI paradigm shift. VentureBeat. 2022-09-13 [2022-10-24]. （原始内容存档于2023-11-28）. 
  5. ^ Steinberg, Ethan; Jung, Ken; Fries, Jason A.; Corbin, Conor K.; Pfohl, Stephen R.; Shah, Nigam H. Language models are an effective representation learning technique for electronic health record data. Journal of Biomedical Informatics. January 2021, 113: 103637. ISSN 1532-0480. PMC 7863633 可免费查阅. PMID 33290879. doi:10.1016/j.jbi.2020.103637. 
  6. ^ Tackling multiple tasks with a single visual language model, 28 April 2022 [13 June 2022], （原始内容存档于2022-04-28） 
  7. ^ Technology Innovation Institute Announces Launch of NOOR, the World's Largest Arabic NLP Model. [2023-12-07]. （原始内容存档于2023-01-15）. 
  8. ^ Chenfei Wu; et al. Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models. Cornell University. 2023. arXiv:2303.04671 可免费查阅. 
  9. ^ Segment Anything | Meta AI. segment-anything.com. [2023-06-21]. （原始内容存档于2023-12-11） （英语）. 
  10. ^ A Generalist Agent. www.deepmind.com. [2023-06-21]. （原始内容存档于2022-08-02） （英语）. 
  11. ^ RoboCat: A self-improving robotic agent. www.deepmind.com. [2023-06-21]. （原始内容存档于2023-10-06） （英语）. 

Read other articles:

Pahae Julu, Tapanuli Utara

Pahae JuluKecamatanPeta lokasi Kecamatan Pahae JuluNegara IndonesiaProvinsiSumatera UtaraKabupatenTapanuli UtaraPemerintahan • CamatHudson Jones Siagian, S.SosPopulasi (2020)[1] • Total13.494 jiwa • Kepadatan81/km2 (210/sq mi)Kode pos22463Kode Kemendagri12.02.05 Kode BPS1205070 Luas165,90 km²Desa/kelurahan18 desa1 kelurahan Pahae Julu adalah sebuah kecamatan di Kabupaten Tapanuli Utara, Sumatera Utara, Indonesia. Ibu kota kecamatan i...

 

WikiLeaks

WikiLeaks tak ada hubungannya dengan Wikipedia ataupun Yayasan Wikimedia. WikiLeaksURLwikileaks.orgEponimwiki TipeArsip dokumenPerdagangan ?TidakRegistration (en)Tidak adaLangueInggris Mesin perangkat lunakMediaWiki PemilikThe Sunshine Press[1]PembuatJulian AssangeWeb DeveloperJulian Assange Service entry (en)Desember 2006NegaraAustralia Penghargaan(2011)  José Couso award (en)  Walkley Award for Most Outstanding Contribution to Journalism (en) Peringkat Alexa16.899 (2...

 

1984 United States presidential election in New Hampshire

Election in New Hampshire Main article: 1984 United States presidential election 1984 United States presidential election in New Hampshire ← 1980 November 6, 1984 1988 →   Nominee Ronald Reagan Walter Mondale Party Republican Democratic Home state California Minnesota Running mate George H. W. Bush Geraldine Ferraro Electoral vote 4 0 Popular vote 267,051 120,395 Percentage 68.66% 30.95% County Results Municipality Results Reagan   50-6...

Bangor Bypass

Bangor BypassNew South WalesRoad sign at the eastern end of Bangor BypassWest endEast endCoordinates 34°01′24″S 151°00′28″E / 34.023469°S 151.007800°E / -34.023469; 151.007800 (West end) 34°01′20″S 151°02′22″E / 34.022237°S 151.039337°E / -34.022237; 151.039337 (East end) General informationTypeRoadLength2.8 km (1.7 mi)[1]OpenedFebruary 2005GazettedFebruary 2009[2]Major junctionsWest end...

 

Bandar Udara Edinburgh

Bandar Udara EdinburghPort-adhair Dhùn ÈideannIATA: EDIICAO: EGPHInformasiJenisPublikPemilikGlobal Infrastructure PartnersPengelolaEdinburgh Airport Ltd.MelayaniEdinburghLothianFifeScottish BordersCentral ScotlandLokasiTurnhouse, EdinburghKetinggian dpl41 mdplSitus webwww.edinburghairport.comPetaEGPHLokasi bandar udara di EdinburghLandasan pacu Arah Panjang Permukaan m kaki 06/24 2,556 8,386 Aspal 12/30 1,797 5,896 Aspal Statistik (2011)Penumpang9,385,245Perubahan penumpang 10-119...

 

Base aérienne de Fürstenfeldbruck

Cet article est une ébauche concernant l'US Air Force et l’Allemagne. Vous pouvez partager vos connaissances en l’améliorant (comment ?) selon les recommandations des projets correspondants. Pour les articles homonymes, voir FEL. Base aérienne de FürstenfeldbruckFlugplatz Fürstenfeldbruck (de) Localisation Pays Allemagne Coordonnées 48° 12′ 15″ nord, 11° 15′ 03″ est Altitude 519 m (1 703 ft) Informations aéronautiques Code IATA FEL...

Livio Luppi

Questa voce sull'argomento calciatori italiani è solo un abbozzo. Contribuisci a migliorarla secondo le convenzioni di Wikipedia. Segui i suggerimenti del progetto di riferimento. Livio Luppi Luppi alla Pistoiese nella stagione 1979-80 Nazionalità  Italia Calcio Ruolo Attaccante Carriera Giovanili 1960-1963 Mirandolese Squadre di club1 1963-1964 Mirandolese2 (0)1964-1965 Messina5 (1)1965-1966 Empoli11 (2)1966-1970 Messina79 (14)1970-1972 Torino19 (1)...

 

Kolpino

This article is about the city. For other uses, see Kolpino (disambiguation). 59°44′N 30°36′E / 59.733°N 30.600°E / 59.733; 30.600 Location of Kolpino within the federal city of Saint Petersburg (2006) Troitsky sobor, Izhora river, and the bridge The memorial devoted to victims of World War II. Brotherhood cemetery of about 888 soviet soldiers. Street of Vera Slutskaya, Kolpino. Coat of arms of Kolpino Flag of Kolpino Old coat of arms of Kolpino (1881) Kolpino ...

 

Silas

1st century AD Christian saint and bishop This article is about the first century figure from early Christianity. For other uses, see Silas (disambiguation). For other saints named Silvanus, see Silvanus. This article uses texts from within a religion or faith system without referring to secondary sources that critically analyze them. Please help improve this article. (December 2022) (Learn how and when to remove this message) SaintSilasApostle, Disciple, Missionary, Bishop, and MartyrDied65�...

Население Татарстана

Численность населения республики по данным Росстата составляет 4 003 016[1] чел. (2024). Татарстан занимает 8-е место по численности населения среди субъектов Российской Федерации[2]. Плотность населения — 59,00 чел./км² (2024). Городское население — 76,72[3] % (20...

 

Cesare Bonelli

Pour les articles homonymes, voir Bonelli. Cesare Bonelli Fonctions Ministre de la Guerre du royaume d'Italie 24 octobre 1878 – 19 décembre 1878(1 mois et 25 jours) Monarque Humbert Ier (roi d'Italie) Gouvernement Benedetto Cairoli Législature XIIIe Prédécesseur Giovanni Bruzzo Successeur Gustavo Mazè de la Roche 14 juillet 1879 – 13 juillet 1880(11 mois et 29 jours) Législature XIIIe et XIVe Prédécesseur Gustavo Mazè de la Roche Successeur Ferdinando Acton M...

 

Six Days of Zürich

Cycling race Six Days of ZürichSix days ZürichRace detailsRegionZürich, SwitzerlandDisciplineTrackTypeSix-day racingWeb sitewww.sixdays-zuerich.ch HistoryFirst edition1954 (1954)Final edition2014First winner Hugo Koblet (SUI)  Armin von Büren (SUI)Final winner Mark Cavendish (GBR)  Iljo Keisse (BEL) The Six Days of Zürich was a six-day track cycling race held annually in Zürich, Switzerland. The event was first held i...

俄亥俄州

  「俄亥俄」重定向至此。关于其他用法，请见「俄亥俄 (消歧义)」。 俄亥俄州 美國联邦州State of Ohio 州旗州徽綽號：七葉果之州地图中高亮部分为俄亥俄州坐标：38°27'N－41°58'N, 80°32'W－84°49'W国家 美國加入聯邦1803年3月1日，在1953年8月7日追溯頒定（第17个加入联邦）首府哥倫布（及最大城市）政府 • 州长（英语：List of Governors of {{{Name}}}]]） •&...

 

Illinois Route 390

Highway in northeastern Illinois This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: Illinois Route 390 – news · newspapers · books · scholar · JSTOR (October 2023) (Learn how and when to remove this message) Illinois Route 390 TollElgin–O'Hare TollwayIL 390 highlighted in redRoute informationMaintained by IST...

 

IPhone 14

artikel ini perlu dirapikan agar memenuhi standar Wikipedia. Tidak ada alasan yang diberikan. Silakan kembangkan artikel ini semampu Anda. Merapikan artikel dapat dilakukan dengan wikifikasi atau membagi artikel ke paragraf-paragraf. Jika sudah dirapikan, silakan hapus templat ini. (Pelajari cara dan kapan saatnya untuk menghapus pesan templat ini) Artikel ini tidak memiliki referensi atau sumber tepercaya sehingga isinya tidak bisa dipastikan. Tolong bantu perbaiki artikel ini dengan menamba...

كارلا بويد

هذه المقالة يتيمة إذ تصل إليها مقالات أخرى قليلة جدًا. فضلًا، ساعد بإضافة وصلة إليها في مقالات متعلقة بها. (فبراير 2019) كارلا بويد معلومات شخصية الميلاد 31 أكتوبر 1975 (49 سنة)  الطول 185 سنتيمتر  مركز اللعب مدافع مسدد الهدف  الجنسية أستراليا  الوزن 80 كيلوغرام  الحياة ا�...

 

توباراو

  توباراو   توباراو توباراو  خريطة الموقع تاريخ التأسيس 27 مايو 1870  تقسيم إداري البلد البرازيل  [1][2] التقسيم الأعلى سانتا كاتارينا  خصائص جغرافية إحداثيات 28°28′01″S 49°00′25″W / 28.466944444444°S 49.006944444444°W / -28.466944444444; -49.006944444444   [3] المساحة 301٫75...

 

Sam Brownback 2008 presidential campaign

2008 Presidential campaign of Sam Brownback Sam Brownback 2008Campaign2008 United States presidential electionCandidateSam BrownbackU.S. Senator from KansasAffiliationRepublican PartyStatusDropped out on October 19, 2007AnnouncedDecember 4, 2006(Exploratory committee)January 20, 2007Websitewww.brownback.com(Archived on October 11, 2007) The 2008 presidential campaign of Sam Brownback, a U.S. Senator from Kansas, began on December 4, 2006, with the formation of an exploratory committee. Severa...

El reino (película)

El reino Parte del equipo artístico, de izquierda a derecha: Mariela Besuievsky (productora), Álex de Pablo (director de fotografía), Mercedes Gamero (productora), Isabel Peña (guionista), Rodrigo Sorogoyen (director y guionista), Olivier Arson (músico) y Alberto del Campo (montador).Ficha técnicaDirección Rodrigo SorogoyenGuion Rodrigo Sorogoyen Isabel PeñaFotografía Álex de PabloProtagonistas Antonio de la TorreJosep María PouBárbara LennieNacho FresnedaAna Wagener Ver todos los...

 

Pandemi Covid-19 di Missouri

Pandemi COVID-19 di MissouriPenyakitCOVID-19Galur virusSARS-CoV-2LokasiMissouri, ASKasus pertamaSt. Louis CountyTanggal kemunculan6 Maret 2020Kasus terkonfirmasi8.754Kematian358Situs web resmiMissouri Department of Health & Senior Services Pandemi COVID-19 dikonfirmasi mencapai negara bagian Missouri pada Maret 2020. Pada 4 Mei 2020, Missouri Department of Health and Senior Services mengkonfirmasikan 8.754 kasus dan 358 kematian di negara bagian tersebut.[1] Referensi ^ COVID-19 O...