Video browsing

Video browsing, also known as exploratory video search, is the interactive process of skimming through video content in order to satisfy some information need or to interactively check if the video content is relevant. While originally proposed to help users inspecting a single video through visual thumbnails,[1] modern video browsing tools enable users to quickly find desired information in a video archive by iterative human–computer interaction through an exploratory search approach.[2][3] Many of these tools presume a smart user that wants features to interactively inspect video content, as well as automatic content filtering features. For that purpose, several video interaction features[4] are usually provided, such as sophisticated navigation in video or search by a content-based query. Video browsing tools often build on lower-level video content analysis, such as shot transition detection, keyframe extraction, semantic concept detection, and create a structured content overview of the video file or video archive. Furthermore, they usually provide sophisticated navigation features, such as advanced timelines,[5] visual seeker bars or a list of selected thumbnails, as well as means for content querying. Examples of content queries are shot filtering through visual concepts (e.g., only shots showing cars), through some specific characteristics (e.g., color or motion filtering), through user-provided sketches (e.g., a visually drawn sketch), or through content-based similarity search.

History

Video browsing was originally proposed by Iranian engineer Farshid Arman, Taiwanese computer scientist Arding Hsu, and computer scientist Ming-Yee Chiu, while working at Siemens, and it was presented at the ACM International Conference in August 1993.[1][6] They described a shot detection algorithm for compressed video that was originally encoded with discrete cosine transform (DCT) video coding standards such as JPEG, MPEG and H.26x.[7] The basic idea was that, since the DCT coefficients are mathematically related to the spatial domain and represent the content of each frame, they can be used to detect the differences between video frames. In the algorithm, a subset of blocks in a frame and a subset of DCT coefficients for each block are used as motion vector representation for the frame. By operating on compressed DCT representations, the algorithm significantly reduces the computational requirements for decompression and enables effective video browsing.[8] The algorithm represents separate shots of a video sequence by an r-frame, a thumbnail of the shot framed by a motion tracking region. A variation of this concept was later adopted for QBIC video content mosaics, where each r-frame is a salient still from the shot it represents.[9]

Video Notebook

Modern video browsing solutions include Video Notebook, a Menlo Park startup founded in 2021 by Mike Lanza, which uses computer vision to extract slides and optical character recognition and speech recognition to facilitate video search. The software can be either used on the client side (using a browser extension), where the slides and text are extracted while the video is watched (e.g. on a video platform like YouTube or Udemy),[10][11] or on the server side. Processed videos, which can be viewed in the Video Notebook web app, feature a video browsing user interface with extracted timestamped slides, a search bar for querying the video (or a collection of videos), and text chapters. Video Notebook customers include organisations like Ernst & Young.[12]

Video Browser Showdown

The Video Browser Showdown (VBS)[13] is an annual live evaluation competition for exploratory video search tools, where international researchers use video browsing tools to solve ad-hoc video search tasks on a moderately large data set as fast as possible. The main goal of the VBS, which started in 2012 at the International Conference on MultiMedia Modeling (MMM), is to advance the performance of video browsing tools. Since 2016, the VBS also collaborates with TRECVID.[14] The aim of the VBS is to evaluate video browsing tools for efficiency at known-item search (KIS) tasks with a well-defined data set in direct comparison to other tools.[15]

References

  1. ^ a b Arman, Farshid; Depommier, Remi; Hsu, Arding; Chiu, Ming-Yee (October 1994). "Content-based browsing of video sequences". Proceedings of the second ACM international conference on Multimedia - MULTIMEDIA '94. Association for Computing Machinery. pp. 97–103. doi:10.1145/192593.192630. ISBN 0897916867. S2CID 1360834.
  2. ^ Supporting video library exploratory search: when storyboards are not enough. M. G. Christel. 2008.
  3. ^ The Video Explorer - a tool for navigation and searching within a single video based on fast content analysis. K. Schoeffmann, M. Taschwer, and L. Boeszoermenyi. 2010.
  4. ^ Video Interaction Tools: A Survey of Recent Work. K. Schoeffmann, M. A. Hudelist, and J. Huber. 2015.
  5. ^ Interfaces for timeline-based mobile video browsing. W. Hürst and K. Meier. 2008.
  6. ^ Arman, Farshid; Hsu, Arding; Chiu, Ming-Yee (August 1993). "Image processing on compressed data for large video databases". Proceedings of the first ACM international conference on Multimedia - MULTIMEDIA '93. Association for Computing Machinery. pp. 267–272. doi:10.1145/166266.166297. ISBN 0897915968. S2CID 10392157.
  7. ^ Skodras, Athanassios (2009-01-01). "Real time data hiding by exploiting the IPCM macroblocks in H. 264/AVC streams". Journal of Real-Time Image Processing.
  8. ^ Zhang, HongJiang (1998). "Content-Based Video Browsing And Retrieval". In Furht, Borko (ed.). Handbook of Internet and Multimedia Systems and Applications. CRC Press. pp. 83–108 (89). ISBN 9780849318580.
  9. ^ Steele, Michael; Hearst, Marti A.; Lawrence, A. Rowe (1998). "The Video Workbench: a direct manipulation interface for digital media editing by amateur videographers" (PDF): 1-19 (14). S2CID 18212394. Archived from the original (PDF) on 2019-02-26. Retrieved 18 October 2019. {{cite journal}}: Cite journal requires |journal= (help)
  10. ^ "Video Notebook - Notes on all video platforms". chrome.google.com. Retrieved 2022-06-03.
  11. ^ "Video Screenshots and Notes - YouTube & more". www.videonotebook.com. Retrieved 2022-06-03.
  12. ^ "Videos made Browsable & Searchable - Video Notebook". www.videonotebook.com. Retrieved 2022-06-03.
  13. ^ Video Browser Showdown
  14. ^ TRECVID, Academic benchmark initiative by NIST
  15. ^ Schöffmann, Klaus; Bailer, Werner (2012-07-24). "Video browser showdown". ACM SIGMultimedia Records. 4 (2): 1–2. doi:10.1145/2350204.2350205. S2CID 46224263.

Read other articles:

Premier ministre d'Arménie

Premier ministre de la république d'Arménie(hy) Հայաստանի Հանրապետության վարչապետ Hayastani Hanrapetut’yan varch’apet Armoiries de l'Arménie Titulaire actuelNikol Pachiniandepuis le 8 mai 2018 Création 30 juin 1918 Mandant Assemblée nationale Durée du mandat Variable Premier titulaire Hovhannès Katchaznouni Résidence officielle Palais du gouvernement (Erevan) Site internet Site officiel Liste des Premiers ministres d'Arménie modifier  Le Premi...

 

Thomas Digges

English mathematician and astronomer Thomas DiggesBornc. 1546Wootton, Kent, EnglandDied(1595-08-24)24 August 1595London, EnglandNationalityEnglishKnown forProposing that the universe is infinite in extentScientific careerFieldsAstronomer and mathematicianAcademic advisorsJohn Dee NotesSon of Leonard Digges, and father of Dudley Digges and Leonard Digges (II) Thomas Digges (/dɪɡz/; c. 1546 – 24 August 1595) was an English mathematician and astronomer. He was the first to expound the C...

 

Scarring hair loss

This article needs more reliable medical references for verification or relies too heavily on primary sources. Please review the contents of the article and add the appropriate references if you can. Unsourced or poorly sourced material may be challenged and removed. Find sources: Scarring hair loss – news · newspapers · books · scholar · JSTOR (September 2019) Medical conditionScarring hair lossOther namesscarring alopeciaSpecialtyDermatology  Sc...

Newport

Newport kotakota besar Newport (en) Tempat Negara berdaulatInggrisNegara konstituen di Britania RayaWalesDistrict of Wales (en)Newport (en) Ibu kota dariNewport (en) NegaraInggris PendudukTotal159.600  (2021 )GeografiBagian dariMonmouthshire Luas wilayah73,35 sqmi [convert: unit tak dikenal]Dekat dengan perairanUsk (en) dan Ebbw River (en) Informasi tambahanKode posNP Zona waktuWaktu Greenwich Kode telepon01633 Lain-lainKota kembarKutaisiAnnapolisGuangxiHeidenheim an der Brenz Situs...

 

Sepak bola Australia

Sepak bola AustraliaSuasana sebuah pertandingan AFL antara Brisbane Lions dengan Collingwood.Induk organisasiAFL CommissionNama lainFootball, footy, Aussie rulesPertama dimainkanMei 1859 di Melbourne, Victoria, AustraliaPemain terdaftar1.404.176 (2016)[1]Jumlah tim25.770 (2016)[1]KarakteristikKontak fisikPenuhAnggota tim22 (18 di lapangan, 4 cadangan)Gender campuranHingga usia 14KategoriLuar ruanganPeralatanBola sepakKeberadaanOlimpiadeOlahraga uji, Olimpiade Melbourne 1956 Se...

 

Синелобый амазон

Синелобый амазон Научная классификация Домен:ЭукариотыЦарство:ЖивотныеПодцарство:ЭуметазоиБез ранга:Двусторонне-симметричныеБез ранга:ВторичноротыеТип:ХордовыеПодтип:ПозвоночныеИнфратип:ЧелюстноротыеНадкласс:ЧетвероногиеКлада:АмниотыКлада:ЗавропсидыКласс:Пт�...

Yulyanikasih

YulyanikasihLahirYulyanikasih Doaussholiha29 Juli 1988 (umur 35)Kalimantan Timur, IndonesiaNama lainYuli QueenPekerjaanPelawak tunggalTahun aktif2012—sekarangSuami/istriDandi Ibrahim (Suami) Yulyanikasih Doaussholiha (lahir 29 Juli 1988) adalah seorang pelawak tunggal berkebangsaan Indonesia. Perempuan bertubuh mungil berhijab ini adalah salah satu finalis kompetisi Stand Up Comedy Indonesia musim kedua pada tahun 2012 yang diadakan oleh Kompas TV. Yuli, sapaan akrabnya bers...

 

MAT Macedonian Airlines

For the Greek airline, subsidiary of Olympic Air, see Macedonian Airlines. MAT Macedonian Airlines IATA ICAO Callsign IN MAK MAKAVIO Founded1994Ceased operations1 September 2009Operating basesOhrid AirportSkopje AirportFleet size1Destinations7HeadquartersSkopje, North MacedoniaKey peopleZlatko Petrovski (President)Websitewww.mat.com.mk MAT Macedonian Airlines[1] (Macedonian: Македонски Авиотранспорт (МАТ), tr: Makedonski Aviotransport (MAT)) was the national ...

 

Realismo (arte)

Questa voce o sezione sugli argomenti arte e letteratura è ritenuta da controllare. Motivo: Confusione tra voci, categorie, e disambigue. La voce Realismo è una disambigua, l'omonima Categoria:Realismo non disambiguata sta dentro Categoria:Correnti letterarie e ha come voce principale Realismo (letteratura). Esistono anche Realismo (arte) (ma la letteratura non è arte?) e Categoria:Realismo (arte) che sta dentro Categoria:Movimenti pittorici. Servirebbe chiarezza sulle disambigue del...

2002 NBA All-Star Game

Exhibition basketball game This article includes a list of general references, but it lacks sufficient corresponding inline citations. Please help to improve this article by introducing more precise citations. (April 2016) (Learn how and when to remove this message) 2002 NBA All-Star Game 1234 Total West 32402835 135 East 24312243 120 DateFebruary 10, 2002ArenaFirst Union CenterCityPhiladelphiaMVPKobe BryantNational anthemPatti LaBelle (USA)Kathleen Edwards (Canada)Halftime showElton JohnAtte...

 

LBX1

LBX1 المعرفات الأسماء المستعارة LBX1, HPX-6, HPX6, H, homeobox, ladybird homeobox 1, CCHS3 معرفات خارجية الوراثة المندلية البشرية عبر الإنترنت 604255 MGI: MGI:104867 HomoloGene: 4784 GeneCards: 10660 علم الوجود الجيني الوظيفة الجزيئية • ‏GO:0001131، ‏GO:0001151، ‏GO:0001130، ‏GO:0001204 DNA-binding transcription factor activity• sequence-specific DNA binding• ربط دي إن �...

 

Handball américain

Pour les articles homonymes, voir handball (homonymie). Ne doit pas être confondu avec handball, handball frison ou handball gaélique. Cet article est une ébauche concernant le sport et les États-Unis. Vous pouvez partager vos connaissances en l’améliorant (comment ?) selon les recommandations du projet sport. Le handball américain (en anglais américain American handball ou court handball, souvent simplement handball) est un sport où les joueurs frappent une balle de caoutchou...

恩維爾·霍查

恩维尔·霍查Enver Hoxha霍查官方肖像照（摄于1980年代初）阿尔巴尼亚共产党中央委员会总书记任期1943年3月—1948年11月[1]前任無（首任）继任本人（劳动党中央委员会总书记）阿尔巴尼亚劳动党中央委员会总书记任期1948年11月—1954年7月[1]前任本人（共产党中央委员会总书记）继任本人（劳动党中央委员会第一书记）阿尔巴尼亚劳动党中央委员会第一书记任期1954�...

 

لوار أتلانتيك الكلاسيكي 2021

لوار أتلانتيك الكلاسيكي 2021 تفاصيل السباقسلسلة21. لوار أتلانتيك الكلاسيكيمنافسةطواف أوروبا للدراجات 2021 1.1‏التاريخ2 أكتوبر 2021المسافات182٫8 كمالبلد فرنسانقطة البدايةLa Haie-Fouassière [الإنجليزية]‏نقطة النهايةLa Haie-Fouassière [الإنجليزية]‏المنصةالفائز ألان ريو [الإنجليز...

 

1975 Australian constitutional crisis

Governor-General dismissal of PM Whitlam The Dismissal redirects here. For other uses, see The Dismissal (disambiguation). 1975 Australian constitutional crisisDateOctober – November 1975LocationCanberra, Australian Capital Territory (Government House, Canberra; Provisional Parliament House, Canberra; The Lodge, Canberra)ParticipantsSir John KerrGough WhitlamMalcolm FraserOutcomeWhitlam dismissed as prime minister by Kerr; Fraser commissioned as prime minister; 1975 Australian federal elect...

أجيس الثاني

أجيس الثاني (بالإغريقية: Άγις Β΄)‏  معلومات شخصية الميلاد القرن 5 ق.م  اسبرطة  الوفاة سنة 398 ق م   اسبرطة  مواطنة اسبرطة  الأب أرخيداموس الثاني  إخوة وأخوات أجيسيلاوس الثاني  الحياة العملية المهنة حاكم  [لغات أخرى]‏  اللغات الإغريقية  تعديل مص...

 

Gustave de Molinari

Gustave de Molinari Gustave de Molinari (Liegi, 3 marzo 1819 – Adinkerque, 28 gennaio 1912) è stato un economista belga e importante liberale del XIX secolo, associato con le idee economiche laissez-faire. Indice 1 Biografia 2 Il pensiero 3 Influenza 4 Opere 5 Voci correlate 6 Altri progetti 7 Collegamenti esterni Biografia Negli anni 1840 mentre viveva a Parigi frequentò il vivace ambiente liberale francese ed entrò a far parte della Ligue pour la Liberté des Échanges (Lega per la Lib...

 

Sachet

Small cloth scented bag filled with herbs For the single-use packaging, see Packet (container). For the water container, see water sachet. For the surname, see Sachet (surname). This article may require cleanup to meet Wikipedia's quality standards. The specific problem is: There are too many references. Relevant discussion may be found on the talk page. Please help improve this article if you can. (October 2023) (Learn how and when to remove this message) A handmade sachet containing lavende...

Nggalat

Nggalat (Rubus moluccanus), adalah spesies tumbuhan dari famili rosaceae. Tumbuhan ini sering dijumpai hidup di pegunungan pada ketinggian lebih dari 1.000 mdpl. Tumbuhan ini menghasilkan buah agregat berwarna merah yang dapat dimakan. Tumbuhan ini kadang dijumpai hidup bersama arbei gunung Nggalat Rubus moluccanus TaksonomiSuperkerajaanEukaryotaKerajaanPlantaeDivisiTracheophytaOrdoRosalesFamiliRosaceaeGenusRubusSpesiesRubus moluccanus Linnaeus, 1753 Tata namaSinonim taksonRubus wawrai Kuntze...

 

The Three-Arched Bridge

1978 novel by Ismail Kadare The Three Arched Bridge Arcade Publishing, 2005AuthorIsmail KadareOriginal titleUra Me Tri HarqeTranslatorJohn HodgsonLanguageAlbanianPublisherSkyhorse PublisherPublication date1978Publication placeAlbaniaPages176ISBN1611452791 The Three Arched Bridge (Albanian: Ura me tri harqe) is a 1978 novel by Albanian author Ismail Kadare. The story concerns a very old Albanian legend written in verses, the Legjenda e Rozafes. The book differs from the original legend, a...