Amazon S3

Amazon S3
Type of site
Cloud storage
Available inEnglish
OwnerAmazon.com
URLaws.amazon.com/s3/
IPv6 supportYes
CommercialYes
RegistrationRequired (included in free tier layer)
LaunchedMarch 14, 2006; 18 years ago (2006-03-14)
Current statusActive

Amazon Simple Storage Service (S3) is a service offered by Amazon Web Services (AWS) that provides object storage through a web service interface.[1][2] Amazon S3 uses the same scalable storage infrastructure that Amazon.com uses to run its e-commerce network.[3] Amazon S3 can store any type of object, which allows uses like storage for Internet applications, backups, disaster recovery, data archives, data lakes for analytics, and hybrid cloud storage. AWS launched Amazon S3 in the United States on March 14, 2006,[1][4] then in Europe in November 2007.[5]

Technical details

Design

Amazon S3 manages data with an object storage architecture[6] which aims to provide scalability, high availability, and low latency with high durability.[3] The basic storage units of Amazon S3 are objects which are organized into buckets. Each object is identified by a unique, user-assigned key.[7] Buckets can be managed using the console provided by Amazon S3, programmatically with the AWS SDK, or the REST application programming interface. Objects can be up to five terabytes in size.[8][9] Requests are authorized using an access control list associated with each object bucket and support versioning[10] which is disabled by default.[11] Since buckets are typically the size of an entire file system mount in other systems, this access control scheme is very coarse-grained. In other words, unique access controls cannot be associated with individual files.[citation needed] Amazon S3 can be used to replace static web-hosting infrastructure with HTTP client-accessible objects,[12] index document support, and error document support.[13] The Amazon AWS authentication mechanism allows the creation of authenticated URLs, valid for a specified amount of time. Every item in a bucket can also be served as a BitTorrent feed. The Amazon S3 store can act as a seed host for a torrent and any BitTorrent client can retrieve the file. This can drastically reduce the bandwidth cost for the download of popular objects. A bucket can be configured to save HTTP log information to a sibling bucket; this can be used in data mining operations.[14] There are various User Mode File System (FUSE)–based file systems for Unix-like operating systems (for example, Linux) that can be used to mount an S3 bucket as a file system. The semantics of the Amazon S3 file system are not that of a POSIX file system, so the file system may not behave entirely as expected.[15]

Amazon S3 storage classes

Amazon S3 offers nine different storage classes with different levels of durability, availability, and performance requirements.[16]

  • Amazon S3 Standard is the default. It is general purpose storage for frequently accessed data.
  • Amazon S3 Express One Zone is a single-digit millisecond latency storage for frequently accessed data and latency-sensitive applications. It stores data only in one availability zone.[17]
  • Amazon S3 Standard-Infrequent Access (Standard-IA) is designed for less frequently accessed data, such as backups and disaster recovery data.
  • Amazon S3 One Zone-Infrequent Access (One Zone-IA) performs like the Standard-IA, but stores data only in one availability zone.
  • Amazon S3 Intelligent-Tiering moves objects automatically to a more cost-efficient storage class.
  • Amazon S3 on Outposts brings storage to installations not hosted by Amazon.
  • Amazon S3 Glacier Instant Retrieval is a low-cost storage for rarely accessed data, but which still requires rapid retrieval.
  • Amazon S3 Glacier Flexible Retrieval is also a low-cost option for long-lived data; it offers 3 retrieval speeds, ranging from minutes to hours.
  • Amazon S3 Glacier Deep Archive is the lowest cost storage for long-lived archive data that is accessed less than once per year and is retrieved asynchronously.

The Amazon S3 Glacier storage classes above are distinct from Amazon Glacier, which is a separate product with its own APIs.

File size limits

An object in S3 can be between 0 bytes and 5TB. If an object is larger than 5TB, it must be divided into chunks prior to uploading. When uploading, Amazon S3 allows a maximum of 5GB in a single upload operation; hence, objects larger than 5GB must be uploaded via the S3 multipart upload API.[18]

Uses

Notable users

  • Photo hosting service SmugMug has used Amazon S3 since April 2006. They experienced a number of initial outages and slowdowns, but after one year they described it as being "considerably more reliable than our own internal storage" and claimed to have saved almost $1 million in storage costs.[19]
  • Netflix uses Amazon S3 as their system of record. Netflix implemented a tool, S3mper,[20] to address the Amazon S3 limitations of eventual consistency.[21] S3mper stores the filesystem metadata: filenames, directory structure, and permissions in Amazon DynamoDB.[22]
  • Reddit is hosted on Amazon S3.[23]
  • Bitcasa,[24] and Tahoe-LAFS-on-S3,[25] among others, use Amazon S3 for online backup and synchronization services. In 2016, Dropbox stopped using Amazon S3 services and developed its own cloud server.[26][27]
  • Swiftype's CEO has mentioned that the company uses Amazon S3.[28]

S3 API and competing services

The broad adoption of Amazon S3 and related tooling has given rise to competing services based on the S3 API. These services use the standard programming interface but are differentiated by their underlying technologies and business models.[29] A standard interface enables better competition from rival providers and allows economies of scale in implementation, among other benefits.[30]

History

At AWS Summit 2013 NYC, CTO Werner Vogels announces 2 trillion objects stored in S3.

Amazon Web Services introduced Amazon S3 in 2006.[31][32]

Date Number of Items Stored
October 2007 10 billion[33]
January 2008 14 billion[33]
October 2008 29 billion[34]
March 2009 52 billion[35]
August 2009 64 billion[36]
March 2010 102 billion[37]
April 2013 2 trillion[38]
March 2021 100 trillion[39]
March 2023 280 trillion[40]
November 2024 400 trillion[40]

In November 2017 AWS added default encryption capabilities at bucket level.[41]

Limitations of Service Level Agreement

Amazon S3 provides a durability guarantee of 99.999999999% (referred to as "11 nines"), primarily addressing data loss from hardware failures. However, this guarantee does not extend to losses resulting from human errors (such as accidental deletion), misconfigurations, third-party failures and subsequent data corruptions, natural disasters, force majeure events, or security breaches. Customers are responsible for monitoring SLA compliance and must submit claims for any unmet SLAs within a designated timeframe. They should understand how deviations from SLAs are calculated, as these parameters may differ from those of other AWS services. These requirements can impose a significant burden on customers. Additionally, SLA percentages and conditions can vary from those of other AWS services. In cases of data loss due to hardware failure attributable to Amazon, the company does not provide monetary compensation; instead, affected users may receive credits if they meet the eligibility criteria. [42][43][44][45][46]

See also

References

Citations

  1. ^ a b "Amazon Web Services Launches "Amazon S3"" (Press release). 2006-03-14. Archived from the original on 2018-11-15. Retrieved 2018-11-14.
  2. ^ Huang, Dijiang; Wu, Huijun (2017-09-08). Mobile Cloud Computing: Foundations and Service Models. Morgan Kaufmann. p. 67. ISBN 9780128096444. Archived from the original on 2018-11-15. Retrieved 2018-11-15.
  3. ^ a b "Cloud Object Storage - Store & Retrieve Data Anywhere - Amazon Simple Storage Service". Amazon Web Services, Inc. Archived from the original on 2018-05-17. Retrieved 2018-05-17.
  4. ^ "5 Key Events in the history of Cloud Computing - DZone Cloud". dzone.com. Archived from the original on 2018-09-29. Retrieved 2018-09-28.
  5. ^ "Amazon Web Services Offers European Storage for Amazon S3" (Press release). 2007-11-06. Archived from the original on 2018-11-15. Retrieved 2018-11-14.
  6. ^ "What is Cloud Object Storage? – AWS". Amazon Web Services, Inc. 2019-10-16. Archived from the original on 2018-09-20. Retrieved 2018-07-09.
  7. ^ "Tech Blog » Starting Websphere in Cloud and saving the data in S3". techblog.aasisvinayak.com. Archived from the original on 2010-03-12.
  8. ^ "open-guides/og-aws". GitHub. Archived from the original on 2018-01-03. Retrieved 2018-05-17.
  9. ^ "Error Responses - Amazon Simple Storage Service". docs.aws.amazon.com. Archived from the original on 2017-12-24. Retrieved 2018-05-21.
  10. ^ "Using versioning in S3 buckets - Amazon Simple Storage Service".
  11. ^ "Introduction to Amazon S3 - Amazon Simple Storage Service". docs.aws.amazon.com. Archived from the original on 2018-05-12. Retrieved 2018-05-17.
  12. ^ "How to use Amazon S3 for Web Hosting". bucketexplorer.com. Archived from the original on 2008-04-08. Retrieved 2008-05-06.
  13. ^ Amazon Simple Storage Service Archived 2011-02-20 at the Wayback Machine Docs.amazonwebservices.com. Retrieved on 2013-08-09.
  14. ^ http://docs.aws.amazon.com/AmazonS3/latest/dev/ServerLogs.html Archived 2014-12-23 at the Wayback Machine Server Access Logging
  15. ^ "Comparison of S3QL and other S3 file systems". Archived from the original on 2012-08-05. Retrieved 2012-06-29.
  16. ^ "Cloud Storage Classes – Amazon Simple Storage Service (S3) – AWS". Amazon Web Services, Inc. Archived from the original on 2018-06-13. Retrieved 2018-05-17.
  17. ^ "Announcing the new Amazon S3 Express One Zone high performance storage class | AWS News Blog". aws.amazon.com. 2023-11-28. Retrieved 2023-12-01.
  18. ^ "How to Upload Large Files to S3". June 21, 2022. Archived from the original on October 1, 2022. Retrieved June 22, 2022.
  19. ^ "Amazon S3: Show Me the Money". SmugMug Blog. SmugMug. November 10, 2006. Archived from the original on 2017-03-03. Retrieved 2017-03-03.
  20. ^ "S3mper: Consistency in the Cloud". Archived from the original on 2016-04-24. Retrieved 2016-05-01.
  21. ^ "Introduction to Amazon S3". Amazon. Archived from the original on 2017-12-25. Retrieved 28 December 2017.
  22. ^ Hern, Alex (2017-02-02). "Amazon Web Services: the secret to the online retailer's future success". the Guardian. Archived from the original on 2018-05-02. Retrieved 2018-04-23.
  23. ^ "AWS Case Study: reddit". aws.amazon.com. 2015. Archived from the original on 2015-03-17. Retrieved March 18, 2015.
  24. ^ "What is Tahoe-LAFS-on-S3?". August 21, 2012. Archived from the original on 2013-05-06. Retrieved 2012-08-21.
  25. ^ "The Epic Story of Dropbox's Exodus From the Amazon Cloud Empire". WIRED. Archived from the original on 2018-01-25. Retrieved 2018-04-23.
  26. ^ "Dropbox saved almost $75 million over two years by building its own tech infrastructure". GeekWire. 2018-02-23. Archived from the original on 2018-04-23. Retrieved 2018-04-23.
  27. ^ "Swiftype Explains Their Cloud Stack". July 1, 2013. Archived from the original on 2014-12-08. Retrieved 2014-12-08.
  28. ^ Watters, Audrey (12 July 2010). "Cloud Community Debates, Is Amazon S3's API the Standard? (And Should It Be?)". SAY Media, Inc. Archived from the original on 2013-02-17. Retrieved 19 December 2012.
  29. ^ Crossroads of Information Technology Standards. Committee on Standards Workshop Planning, Board on Telecommunications and Computer Applications, Commission on Engineering and Technical Systems, National Research Council. Washington, DC: The National Academies Press, 1990. 1990. pp. 36–37. doi:10.17226/10440. ISBN 978-0-309-58171-4. Archived from the original on 2014-03-25. Retrieved 2014-03-25.{{cite book}}: CS1 maint: others (link)
  30. ^ Overview of Amazon Web Services, 2018, https://docs.aws.amazon.com/whitepapers/latest/aws-overview/introduction.html Archived 2017-11-18 at the Wayback Machine
  31. ^ Garfinkel, Simson L. 2007. An Evaluation of Amazon's Grid Computing Services: EC2, S3, and SQS. Harvard Computer Science Group Technical Report TR-08-07. https://dash.harvard.edu/bitstream/handle/1/24829568/tr-08-07.pdf?sequence=1 Archived 2018-07-29 at the Wayback Machine
  32. ^ a b Vogels, Werner (2008-03-19). "Happy Birthday, Amazon S3!". All Things Distributed. Archived from the original on 2008-05-09. Retrieved 2008-05-23.
  33. ^ "Amazon S3 - Busier Than Ever". 2008-10-08. Archived from the original on 2008-10-11. Retrieved 2008-10-09.
  34. ^ "Celebrating S3's Third Birthday With Special Anniversary Pricing - Amazon Web Services". typepad.com. 31 March 2009. Archived from the original on 2011-07-07. Retrieved 2009-04-01.
  35. ^ "Amazon's Head Start in the Cloud Pays Off". eweek.com.[permanent dead link‍]
  36. ^ "Amazon S3 Now Hosts 100 Billion Objects". datacenterknowledge.com. 9 March 2010. Archived from the original on 2010-03-12. Retrieved 2010-03-09.
  37. ^ "Amazon S3 – Two Trillion Objects, 1.1 Million Requests / Second - Amazon Web Services". typepad.com. 18 April 2013.
  38. ^ "Celebrate 15 Years of Amazon S3 with 'Pi Week' Livestream Events". amazon.com. 14 March 2021.
  39. ^ a b "Celebrate Amazon S3's 17th birthday at AWS Pi Day 2023". amazon.com. 14 March 2023.
  40. ^ "AWS re:Invent 2024 - Dive deep on Amazon S3 (STG302)". 9 December 2024.
  41. ^ Cloud Security and Privacy An Enterprise Perspective on Risks and Compliance. O'Reilly Media. September 4, 2009. ISBN 9781449379513.
  42. ^ Requirements Engineering for Service and Cloud Computing. Springer International Publishing. April 10, 2017. ISBN 9783319513102.
  43. ^ Srinivasan (May 14, 2014). Cloud Computing Basics. Springer. ISBN 9781461476993.
  44. ^ Murugesan, San (August 2016). Encyclopedia of Cloud Computing. John Wiley & Sons. ISBN 9781118821978.
  45. ^ Genomics in the AWS Cloud Analyzing Genetic Code Using Amazon Web Services. ISBN 9781119573401.

Sources

Read other articles:

List of Consuls-General of the United Kingdom in Shanghai

Consul-General of the United Kingdom in ShanghaiCoat of Arms of the United KingdomIncumbentMatt Burneysince September 2023StyleHis ExcellencyResidenceShanghaiInaugural holderGeorge BalfourFormation1 December 1842WebsiteBritish Consulate-General Shanghai The Consul-General from the United Kingdom in Shanghai is the United Kingdom's diplomatic representative within the city of Shanghai in the People's Republic of China. From 1842 to 1949 the Consul-General's office and residence was locat...

 

Easement

Right to use or enter real property For spiral easements on railroads, see Track transition curve. Property law Part of the common law series Types Personal property Community property Real property Unowned property Acquisition Gift Adverse possession Deed Conquest Discovery Accession Lost, mislaid, and abandoned property Treasure trove Bailment License Alienation Estates in land Allodial title Fee simple Fee tail Life estate Defeasible estate Future interest remainder Concurrent estate Lease...

 

Élisabeth Guigou

Pour les articles homonymes, voir Guigou. Élisabeth Guigou Élisabeth Guigou en 2013. Fonctions Présidente de la commission des Affaires étrangères de l'Assemblée nationale 28 juin 2012 – 20 juin 2017(4 ans, 11 mois et 23 jours) Législature XIVe (Cinquième République) Prédécesseur Axel Poniatowski Successeur Marielle de Sarnez Vice-présidente de l'Assemblée nationale 5 octobre 2010 – 2 octobre 2011(11 mois et 27 jours) Président Bernard Accoyer Légi...

Cimetière de La Madeleine (Amiens)

Pour les articles homonymes, voir cimetière de La Madeleine. Cimetière de La MadeleineGrille d'entrée.Pays FranceRégion Hauts-de-FranceDépartement SommeCommune AmiensReligion(s) Catholique, protestanteSuperficie 18 hectaresMise en service 1817Patrimonialité  Classé MH (1995)Coordonnées 49° 54′ 50″ N, 2° 17′ 01″ EIdentifiantsSauvons nos tombes 1003 Géolocalisation sur la carte : Hauts-de-France Géolocalisation sur la carte ...

 

شانيكا نولز

يفتقر محتوى هذه المقالة إلى الاستشهاد بمصادر. فضلاً، ساهم في تطوير هذه المقالة من خلال إضافة مصادر موثوق بها. أي معلومات غير موثقة يمكن التشكيك بها وإزالتها. (مارس 2023) تفتقر سيرة هذه الشخصية الحيّة إلى الاستشهاد بمصدر موثوق به يمكن التحقق منه. فضلاً، ساهم في تطويرها من خلال �...

 

David Dastmalchian

David Dastmalchian nel 2023 David Dastmalchian (Allentown, 21 luglio 1977) è un attore statunitense. Indice 1 Biografia 1.1 Vita privata 2 Filmografia 2.1 Attore 2.1.1 Cinema 2.1.2 Televisione 2.2 Doppiatore 2.3 Sceneggiatore 2.4 Produttore 3 Teatro 4 Doppiatori italiani 5 Note 6 Altri progetti 7 Collegamenti esterni Biografia Originario della Pennsylvania, Dastmalchian cresce a Overland Park, in Kansas.[1] Appassionatosi alla recitazione alle scuole superiori, frequenta la scuola di...

Thomas Dawson (cook)

Title page of 1596 edition of Thomas Dawson's The Good Huswifes Jewell, first published 1585 Thomas Dawson (active 1585–1620) was an English author of cookery and housekeeping books. Life Thomas Dawson was an author of popular cookery and housekeeping books in the late 16th century. His best-known works include The Good Huswifes Jewell (1585), The Booke of Carving and Sewing (1597), and his Booke of Cookerie (1620).[1][2][3] Books Main article: The Good Huswifes Jewe...

 

中华人民共和国国家元首列表

  提示：此条目页的主题不是中華人民共和國最高領導人。 中华人民共和国 中华人民共和国政府与政治系列条目 执政党 中国共产党 党章、党旗党徽 主要负责人、领导核心 领导集体、民主集中制 意识形态、组织 以习近平同志为核心的党中央 两个维护、两个确立 全国代表大会 （二十大） 中央委员会 （二十届） 总书记：习近平 中央政治局 常务委员会 中央书记处 �...

 

西遊記大結局之仙履奇緣

本條目存在以下問題，請協助改善本條目或在討論頁針對議題發表看法。 此條目需要編修，以確保文法、用詞、语气、格式、標點等使用恰当。 (2013年8月6日)請按照校對指引，幫助编辑這個條目。（幫助、討論） 此條目剧情、虛構用語或人物介紹过长过细，需清理无关故事主轴的细节、用語和角色介紹。 (2020年10月6日)劇情、用語和人物介紹都只是用於了解故事主軸，輔助�...

Masjid Jongaya

Artikel ini sebatang kara, artinya tidak ada artikel lain yang memiliki pranala balik ke halaman ini.Bantulah menambah pranala ke artikel ini dari artikel yang berhubungan atau coba peralatan pencari pranala.Tag ini diberikan pada Oktober 2022. Masjid Jongaya atau Masjid Babul Firdaus adalah salah satu masjid yang terletak di wilayah bagian barat daya dari Kecamatan Tamalate, Kota Makassar. Bentuk masjid ini menyerupai Joglo dan berada di kawasan permukiman penduduk. Masjid Jongaya mulai diba...

 

Academic ranks in France

Academic ranks worldwide Argentina Australia Brazil Canada China Colombia Czech Republic Denmark Egypt Finland France Germany Hungary India Israel Italy Jordan Kenya Malaysia Netherlands New Zealand Norway Portugal Russia Serbia Slovakia South Africa Spain Sweden Thailand United Kingdom United States vte Overview of academic ranks in France The following summarizes basic academic ranks in the French higher education system. Most academic institutions are state-run and most academics with perm...

 

Yuri Zhdanov

Yury Andreevich ZhdanovLahir(1919-08-20)20 Agustus 1919TverMeninggal19 Desember 2006(2006-12-19) (umur 87)Rostov-on-DonTempat tinggalUni SovietRusiaKarier ilmiahBidangKimia, Filsafat Yuri Andreyevich Zhdanov (bahasa Rusia: Ю́рий Андре́евич Жда́нов; 20 Agustus 1919 – 19 Desember 2006) adalah seorang profesor kimia Rusia dan rektor Universitas Rostov. Ia adalah putra dari politikus Uni Soviet Andrei Zhdanov dan mantan suami putri Joseph Stalin, Sv...

Military district

Regional military unit size designation This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: Military district – news · newspapers · books · scholar · JSTOR (November 2007) (Learn how and when to remove this message) Military organization Typical units Typical numbers Typical commander fireteam 2–4 lance corpor...

 

Revised Version

Late 19th-century British revision of the King James Version For other uses of King James Version, see King James Version (disambiguation). Revised VersionOuter cover of Revised Version of the Bible, bound in leather with a full yapp. Published by Oxford in 1885.Full nameEnglish Revised VersionAbbreviationRV[a]OT published1885NT published1881Complete Biblepublished1894Online asRevised Version at Wikisource Derived from1881 Westcott and Hort New Testament Greek Crit...

 

Little Manila

Community with a large Filipino immigrant and descendant population Little ManilaLittle Manila in Woodside, Queens, New York CityFilipino nameTagalogMunting MaynilaMaliit na Maynila A Little Manila (Filipino: Munting Maynila or Maliit na Maynila), also known as a Manilatown (Filipino: Bayang Maynila) or Filipinotown (Filipino: Bayang Pilipino), is a community with a large Filipino immigrant and descendant population. Little Manilas are enclaves of Overseas Filipinos consisting of people of Fi...

كريستينا بيرغر

هذه المقالة يتيمة إذ تصل إليها مقالات أخرى قليلة جدًا. فضلًا، ساعد بإضافة وصلة إليها في مقالات متعلقة بها. (أبريل 2019) كريستينا بيرغر معلومات شخصية الميلاد 20 يونيو 1988 (36 سنة)  ألمانيا  مواطنة ألمانيا  الحياة العملية المهنة نبَّالة  اللغات الألمانية  الرياضة نبالة...

 

West Coast Eagles

Australian rules football club West Coast EaglesNamesFull nameWest Coast Eagles Football Club[1]Nickname(s)Eagles Indigenous rounds: Waalitj Marawar2023 seasonHome-and-away seasonAFL: 18th AFLW: 17th WAFL: 10thLeading goalkickerAFL: Oscar Allen (53 goals)AFLW: Grace Kelly (7 goals)Club detailsFounded20 October 1986ColoursRoyal blue, gold    CompetitionAFL: Senior men AFLW: Senior women WAFL: Reserves menOwnersWest Australian Football Commission (WAFC)ChairmanPaul Fitzpatrick...

 

可卡因

建議将古柯碱併入此條目或章節。（討論） 维基百科中的醫學内容仅供参考，並不能視作專業意見。如需獲取醫療幫助或意見，请咨询专业人士。詳見醫學聲明。 可卡因臨床資料其他名稱benzoylmethylecgonine (苯甲酰甲基芽子碱), benzoylecgonine methyl ester (苯甲酰芽子碱甲酯)AHFS/Drugs.comMicromedex详细消费者药物信息依賴性生理: 高[1][2]心理: 高[2]成癮性高[3]给药...

Pentamine

Chemical compound PentamineIdentifiers IUPAC name Ethyl-[2-[2-(ethyl-dimethyl-ammonio)ethyl-methyl-amino]ethyl]-dimethyl-ammonium CAS Number60-30-0PubChem CID9383ChemSpider9014UNII43XK6AW58DCompTox Dashboard (EPA)DTXSID30861863 Chemical and physical dataFormulaC13H33N3Molar mass231.428 g·mol−13D model (JSmol)Interactive image SMILES CC[N+](C)(C)CCN(C)CC[N+](C)(C)CC InChI InChI=1S/C13H33N3/c1-8-15(4,5)12-10-14(3)11-13-16(6,7)9-2/h8-13H2,1-7H3/q+2Key:NHWGPUVJQFTOQX-UHFFFAOYSA-N Pentamin...

 

Chief minister of France

Not to be confused with Prime Minister of France.Medieval position akin to a head of government The chief minister of France or, closer to the French term, chief minister of state (French: principal ministre d'État), or prime minister of France[1] were and are informal titles given to various personages who received various degrees of power to rule the Kingdom of France on behalf of the monarch during the Ancien Régime ('Old Regime').[2] The titles were however informal and ...