Journal ranking

Journal ranking is widely used in academic circles in the evaluation of an academic journal's impact and quality. Journal rankings are intended to reflect the place of a journal within its field, the relative difficulty of being published in that journal, and the prestige associated with it. They have been introduced as official research evaluation tools in several countries.

Measures

Traditionally, journal ranking "measures" or evaluations have been provided simply through institutional lists established by academic leaders or through a committee vote. These approaches have been notoriously politicized and inaccurate reflections of actual prestige and quality, as they would often reflect the biases and personal career objectives of those involved in ranking the journals; also causing the problem of highly disparate evaluations across institutions.[1] Consequently, many institutions have required external sources of evaluation of journal quality. The traditional approach here has been through surveys of leading academics in a given field, but this approach too has potential for bias, though not as profound as that seen with institution-generated lists.[2] Consequently, governments, institutions, and leaders in scientometric research have turned to a litany of observed bibliometric measures on the journal level that can be used as surrogates for quality and thus eliminate the need for subjective assessment.[1]

Consequently, several journal-level metrics have been proposed, most citation-based:

  • Impact factor and CiteScore – reflecting the average number of citations to articles published in science and social science journals.
  • SCImago Journal Rank – a measure of scientific influence of scholarly journals that accounts for both the number of citations received by a journal and the importance or prestige of the journals where such citations come from.
  • h-index – usually used as a measure of scientific productivity and the scientific impact of an individual scientist, but can also be used to rank journals.
    • h5-index – this metric, calculated and released by Google Scholar, is based on the h-index of all articles published in a given journal in the last five years.[3]
  • Expert survey – a score reflecting the overall quality or contribution of a journal is based on the results of the survey of active field researchers, practitioners and students (i.e., actual journal contributors or readers), who rank each journal based on specific criteria.[4]
  • Top quartile citation count (TQCC) – reflecting the number of citations accrued by the paper that resides at the top quartile (the 75th percentile) of a journal's articles when sorted by citation counts; for example, when a journal published 100 papers, the 25th most-cited paper's citation count is the TQCC.[5]
  • Publication power approach (PPA) – the ranking position of each journal is based on the actual publishing behavior of leading tenured academics over an extended time period. As such, the journal's ranking position reflects the frequency at which these scholars published their articles in this journal.[6][7]
  • Altmetrics – rate journals based on scholarly references added to academic social media sites.[8]
  • diamScore – a measure of scientific influence of academic journals based on recursive citation weighting and the pairwise comparisons between journals.[9]
  • Source normalized impact per paper (SNIP) – a factor released in 2012 by Elsevier based on Scopus to estimate impact.[10] The measure is calculated as SNIP=RIP/(R/M), where RIP=raw impact per paper, R = citation potential and M = median database citation potential.[11]
  • Journal Tier – One of the few indicators based not on citations but objective user ratings and reviews.[12]
  • PageRank – in 1976 a recursive impact factor that gives citations from journals with high impact greater weight than citations from low-impact journals was proposed.[13] Such a recursive impact factor resembles Google's PageRank algorithm, though the original paper uses a "trade balance" approach in which journals score highest when they are often cited but rarely cite other journals; several scholars have proposed related approaches.[14][15][16][17]
    • Eigenfactor is another PageRank-type measure of journal influence,[18] with rankings freely available online.[19]

Discussion

Negative consequences of rankings are generally well-documented and relate to the performativity of using journal rankings for performance measurement purposes.[20][21] Studies of methodological quality and reliability have found that "reliability of published research works in several fields may be decreasing with increasing journal rank",[22] contrary to widespread expectations.[23]

For example, McKinnon (2017) has analyzed how the ABS-AJG ranking, which in spite of its methodological shortcomings is widely accepted in British business schools, has had negative consequences for the transportation and logistics management disciplines.[24] A study published in 2021 compared the Impact Factor, Eigenfactor Score, SCImago Journal & Country Rank and the Source Normalized Impact per Paper, in journals related to Pharmacy, Toxicology and Biochemistry. It discovered there was "a moderate to high and significant correlation" between them.[25]

Thousands of universities and research bodies issued official statements denouncing the idea that research quality can be measured based on the uni-dimensional scale of a journal ranking, most notably by signing the San Francisco Declaration on Research Assessment (DORA), which asked "not [to] use journal-based metrics ... as a surrogate measure of the quality of individual research articles, to assess an individual scientist's contributions, or in hiring, promotion, or funding decisions".[26] The Community for Responsible Research in Business Management (cRRBM) asks whether "even the academy is being served when faculty members are valued for the quantity and placement of their articles, not for the benefit their research can have for the world".[27] Some academic disciplines such as management exhibit a journal ranking lists paradox: on the one hand, researchers are aware of the numerous limitations of ranking lists and their deleterious impact on scientific progress; on the other hand, they generally find journal ranking lists to be useful and employ them, in particular, when the use of ranking lists is not mandated by their institutions.[28]

National rankings

Several national and international rankings of journals exist, e.g.:

They have been introduced as official research evaluation tools in several countries.[41]

See also

References

  1. ^ a b Lowry, Paul Benjamin; Gaskin, James; Humpherys, Sean L.; Moody, Gregory D.; Galletta, Dennis F.; Barlow, Jordan B.; Wilson, David W. (2013). "Evaluating Journal Quality and the Association for Information Systems Senior Scholars' Journal Basket Via Bibliometric Measures: Do Expert Journal Assessments Add Value?". Management Information Systems Quarterly. 37 (4): 993–1012. doi:10.25300/MISQ/2013/37.4.01. JSTOR 43825779. SSRN 2186798. Also, see YouTube video narrative of this paper at:  Yukon
  2. ^ Lowry, Paul Benjamin; Romans, Denton; Curtis, Aaron (2004). "Global Journal Prestige and Supporting Disciplines: A Scientometric Study of Information Systems Journals". Journal of the Association for Information Systems. 5 (2): 29–77. doi:10.17705/1jais.00045. SSRN 666145.
  3. ^ Minasny, Budiman; Hartemink, Alfred E.; McBratney, Alex; Jang, Ho-Jun (2013-10-22). "Citations and the h index of soil researchers and journals in the Web of Science, Scopus, and Google Scholar". PeerJ. 1: e183. doi:10.7717/peerj.183. ISSN 2167-8359. PMC 3807595. PMID 24167778.
  4. ^ Serenko, Alexander; Dohan, Michael (2011). "Comparing the expert survey and citation impact journal ranking methods: Example from the field of Artificial Intelligence" (PDF). Journal of Informetrics. 5 (4). Elsevier: 629–648. doi:10.1016/j.joi.2011.06.002.
  5. ^ "About OOIR: Journal-level data". Retrieved 2023-03-14.
  6. ^ Holsapple, Clyde W. (2008). "A publication power approach for identifying premier information systems journals". Journal of the Association for Information Science and Technology. 59 (2). Wiley Online Library: 166–185. doi:10.1002/asi.20679.
  7. ^ Serenko, Alexander; Jiao, Changquan (2012). "Investigating Information Systems Research in Canada" (PDF). Canadian Journal of Administrative Sciences. 29. Wiley Online Library: 3–24. doi:10.1002/CJAS.214.
  8. ^ Alhoori, Hamed; Furuta, Richard (2013). Can Social Reference Management Systems Predict a Ranking of Scholarly Venues?. Lecture Notes in Computer Science. Vol. 8092. Springer. pp. 138–143. CiteSeerX 10.1.1.648.3770. doi:10.1007/978-3-642-40501-3_14. ISBN 978-3-64240-500-6. {{cite book}}: |work= ignored (help)
  9. ^ Cornillier, Fabien; Charles, Vincent (2015). "Measuring the attractiveness of academic journals: A direct influence aggregation model" (PDF). Operations Research Letters. 43 (2): 172–176. doi:10.1016/j.orl.2015.01.007. S2CID 13310055.
  10. ^ "Elsevier Announces Enhanced Journal Metrics SNIP and SJR Now Available in Scopus" (Press release). Elsevier. Retrieved 2014-07-27.
  11. ^ Moed, Henk (2010). "Measuring contextual citation impact of scientific journals". Journal of Informetrics. 4 (3). Elsevier: 256–277. arXiv:0911.2632. doi:10.1016/j.joi.2010.01.002. S2CID 10644946.
  12. ^ "Journal Tier List". www.journaltierlist.com. Retrieved 2024-07-31.
  13. ^ Pinski, Gabriel; Narin, Francis (1976). "Citation influence for journal aggregates of scientific publications: Theory with application to literature of physics". Information Processing and Management. 12 (5): 297–312. doi:10.1016/0306-4573(76)90048-0.
  14. ^ Liebowitz, S. J.; Palmer, J. P. (1984). "Assessing the relative impacts of economics journals" (PDF). Journal of Economic Literature. 22 (1): 77–88. JSTOR 2725228.
  15. ^ Palacios-Huerta, Ignacio; Volij, Oscar (2004). "The Measurement of Intellectual Influence". Econometrica. 72 (3): 963–977. CiteSeerX 10.1.1.165.6602. doi:10.1111/j.1468-0262.2004.00519.x.
  16. ^ Kodrzycki, Yolanda K.; Yu, Pingkang (2006). "New Approaches to Ranking Economics Journals". Contributions to Economic Analysis & Policy. 5 (1). CiteSeerX 10.1.1.178.7834. doi:10.2202/1538-0645.1520.
  17. ^ Bollen, Johan; Rodriguez, Marko A.; Van De Sompel, Herbert (December 2006). "MESUR: Usage-based metrics of scholarly impact". Proceedings of the 7th ACM/IEEE-CS joint conference on Digital libraries. Vol. 69. pp. 669–687. arXiv:cs.GL/0601030. Bibcode:2006cs........1030B. doi:10.1145/1255175.1255273. ISBN 978-1-59593-644-8. S2CID 3115544. {{cite book}}: |journal= ignored (help)
  18. ^ Bergstrom, C. T. (May 2007). "Eigenfactor: Measuring the value and prestige of scholarly journals". College & Research Libraries News. 68 (5): 314–316. doi:10.5860/crln.68.5.7804.
  19. ^ West, Jevin Darwin. "Eigenfactor.org". Eigenfactor. Retrieved 2014-05-18.
  20. ^ Espeland, Wendy Nelson; Sauder, Michael (2007). "Rankings and Reactivity: How Public Measures Recreate Social Worlds". American Journal of Sociology. 113: 1–40. doi:10.1086/517897. hdl:1885/30995. S2CID 113406795.
  21. ^ Grant, David B.; Kovács, Gyöngyi; Spens, Karen (2018). "Questionable research practices in academia: Antecedents and consequences". European Business Review. 30 (2): 101–127. doi:10.1108/EBR-12-2016-0155.
  22. ^ Brembs, Björn (2018). "Prestigious Science Journals Struggle to Reach Even Average Reliability". Frontiers in Human Neuroscience. 12: 37. doi:10.3389/fnhum.2018.00037. PMC 5826185. PMID 29515380.
  23. ^ Triggle, Chris R; MacDonald, Ross; Triggle, David J.; Grierson, Donald (2022-04-03). "Requiem for impact factors and high publication charges". Accountability in Research. 29 (3): 133–164. doi:10.1080/08989621.2021.1909481. PMID 33787413. S2CID 232430287. One might expect, therefore, that a high JIF factor indicates a higher standard of interest, accuracy and reliability of papers published therein. This is sometimes true but unfortunately is certainly not always the case (Brembs 2018, 2019). Thus, Björn Brembs (2019) concluded: "There is a growing body of evidence against our subjective notion of more prestigious journals publishing 'better' science. In fact, the most prestigious journals may be publishing the least reliable science."
  24. ^ McKinnon, Alan C. (2017). "Starry-eyed II: The logistics journal ranking debate revisited". International Journal of Physical Distribution & Logistics Management. 47 (6): 431–446. doi:10.1108/IJPDLM-02-2017-0097.
  25. ^ Aquino-Canchari, Christian Renzo; Ospina-Meza, Richard Fredi; Guillen-Macedo, Karla (2020-07-30). "Las 100 revistas de mayor impacto sobre farmacología, toxicología y farmacia". Revista Cubana de Investigaciones Biomédicas. 39 (3). ISSN 1561-3011.
  26. ^ "Home". DORA.
  27. ^ Glick, William; Tsui, Anne; Davis, Gerald (2018-05-02). Cutler, Dave (ed.). "The Moral Dilemma to Business Research". BizEd Magazine. Archived from the original on 2018-05-07.
  28. ^ Serenko, Alexander; Bontis, Nick (2024). "Dancing with the Devil: The use and perceptions of academic journal ranking lists in the management field" (PDF). Journal of Documentation. 80 (4): 773–792. doi:10.1108/JD-10-2023-0217. S2CID 266921800.
  29. ^ "Australian Research Council ranking of journals worldwide". 2011-06-12. Archived from the original on 2011-06-12.
  30. ^ Li, Xiancheng; Rong, Wenge; Shi, Haoran; Tang, Jie; Xiong, Zhang (2018-05-11). "The impact of conference ranking systems in computer science: a comparative regression analysis". Scientometrics. 116 (2). Springer Science and Business Media LLC: 879–907. doi:10.1007/s11192-018-2763-1. ISSN 0138-9130. S2CID 255013801.
  31. ^ "CORE Rankings Portal". core.edu.au. Retrieved 2022-12-27.
  32. ^ "Uddannelses- og Forskningsministeriet".
  33. ^ "Julkaisufoorumi". December 2023.
  34. ^ "Search in Norwegian List | Norwegian Register".
  35. ^ "Rating of Scientific Journals – ANVUR – Agenzia Nazionale di Valutazione del Sistema Universitario e della Ricerca".
  36. ^ "Chartered Association of Business Schools – Academic Journal Guide".
  37. ^ "List of HEC Recognized Journals".
  38. ^ "NAAS Score of Science Journals" (PDF). National Academy of Agricultural Sciences. 2022-01-01. Archived (PDF) from the original on 2023-03-15.
  39. ^ "Polish Ministry of Higher Education and Science (2019)". www.bip.nauka.gov.pl. Retrieved 2019-10-12.
  40. ^ "Polish Ministry of Higher Education and Science (2021)". www.bip.nauka.gov.pl. Retrieved 2021-02-09.
  41. ^ Pontille, David; Torny, Didier (2010). "The controversial policies of journal ratings: Evaluating social sciences and humanities". Research Evaluation. 19 (5): 347–360. doi:10.3152/095820210X12809191250889. S2CID 53387400.

Read other articles:

Michel TelóInformasi latar belakangLahir21 Januari 1981 (umur 43)Medianeira, Paraná, BrasilGenreSertanejo, popPekerjaanPenyanyi, penulis laguTahun aktif1998–sekarangLabelUniversal Music Brazil Michel Teló (lahir 21 Januari 1981) adalah penulis lagu dan penyanyi sertanejo asal Brasil.[1][2] Sebelum aksi solonya, dia adalah penyanyi utama di berbagai grup musik, terutama Grupo Tradição. Hit-nya yang sukses secara nasional dan internasional adalah Bara Bara Bere Bere,...

 

 

Mustar Labolo Wakil Bupati Banggai Ke-4Masa jabatan8 Juni 2016 – 8 Juni 2021PresidenJoko WidodoGubernurLongki Djanggola PendahuluHerwin YatimPenggantiFurqanuddin Masulili Informasi pribadiLahir18 November 1962 (umur 61) Lobu, Sulawesi TengahKebangsaan IndonesiaPartai politikGerindraSunting kotak info • L • B H. Mustar Labolo (lahir 18 November 1962) adalah politisi asal Banggai. Dia menjabat sebagai Wakil Bupati Banggai periode 2016–2021.

 

 

Mitsubishi Fuso RosaInformasiProdusenMitsubishi Fuso Truck and Bus CorporationJuga disebutBahman Pegasus (Iran)[1]Masa produksi1960-sekarangBodi & rangkaKelasMinibusBentuk kerangkaMinibus (bodi pendek dan panjang)Mobil terkaitMitsubishi Fuso CanterPenyalur dayaMesinMitsubishiTransmisiMitsubishi (manual), Aisin (otomatis)Mitsubishi Rosa atau Mitsubishi Fuso Rosa (kana: 三菱ふそう・ローザ) adalah bus mini yang diproduksi oleh Mitsubishi Fuso Truck and Bus Corporat...

Jean de Tours Biographie Naissance XIe siècleTours Décès 1122 Évêque de l'Église catholique Ordination épiscopale Juillet 1088 par Lanfranc Évêque de Bath et Wells Gisa Godefroy Autres fonctions Fonction religieuse chapelain royal Fonction laïque médecin du roi (en) Notice sur www.catholic-hierarchy.org modifier  Jean de Tours (ou Jean de Villule) (né à Tours avant 1070, mort en 1122), médecin et chapelain de Guillaume le Conquérant, fut nommé évêque de Wells en Anglet...

 

 

Private primary and secondary school in Naranpura, Ahmedabad, Gujarat, IndiaSt. Xavier's High School,Loyola Hall, AhmedabadCoat of armsLocationNaranpura, Ahmedabad, Gujarat 380013IndiaCoordinatesLatitude: 23°2'52.35 Longitude: 72°32'56.72InformationTypePrivate primary and secondary schoolMottoLatin: A teneris impende laborem(Apply yourself to hard work from an early age)Religious affiliation(s)CatholicismDenominationJesuitsEstablished1956; 68 years ago (1956)PrincipalMrs. ...

 

 

Chinese traditional practice For other uses, see Feng shui (disambiguation). Feng shui analysis of a 癸山丁向 site[clarification needed], with an auspicious circle[1] Feng shuiChinese nameTraditional Chinese風水Simplified Chinese风水Literal meaningwind-waterTranscriptionsStandard MandarinHanyu PinyinfēngshuǐBopomofoㄈㄥ   ㄕㄨㄟˇWade–Gilesfêng1-shui3Tongyong PinyinfongshuěiYale RomanizationfēngshwěiIPA[fə́ŋ.ʂwèɪ]WuRomani...

This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: NSDAP Office of Foreign Affairs – news · newspapers · books · scholar · JSTOR (July 2018) (Learn how and when to remove this template message) You can help expand this article with text translated from the corresponding article in German. (February 2011) C...

 

 

Metro station in Shenzhen, China This article is about the Shenzhen Metro station. For Taoyuan station in Taiwan, see Taoyuan TRA station. This article does not cite any sources. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: Taoyuan station Shenzhen Metro – news · newspapers · books · scholar · JSTOR (February 2020) (Learn how and when to remove this message...

 

 

Medical conditionReed’s syndromeOther namesFamilial leiomyomatosis cutis et uteriMicrograph showing the characteristic hyalinized papillary cores found in some hereditary leiomyomatosis and renal cell carcinoma syndrome-associated renal cell carcinomas. H&E stain. Hereditary leiomyomatosis and renal cell carcinoma (HLRCC) or Reed's syndrome is rare autosomal dominant disorder associated with benign smooth muscle tumors and an increased risk of renal cell carcinoma. It is characterised b...

Shanghai ShenhuaNama lengkapShanghai Shenhua SVA SMEG FC 上海申花足球俱乐部Berdiri1993StadionStadion Hongkou, Shanghai, RRT(Kapasitas: 33,060)KetuaWang JiesenHead coachSergio BatistaLigaChinese Super League2021Super League, ke-9Situs webSitus web resmi klub Kostum kandang Kostum tandang Musim ini Shanghai Shenhua merupakan sebuah tim sepak bola Republik Rakyat Tiongkok yang bermarkas di Shanghai, RRT. Shanghai Shenhua didirikan pada tahun 1993. Prestasi Gelar Tahun Jia A 1995, 2...

 

 

الوشق الاسم اللاتيني Lynx اسم آخر The Tiger المطلع المستقيم 8 الميل +45 ربعية NQ2 المساحة 545 درجة مربعة. (28th) نجومباير/فلامستيد 42 نجوم مع كواكب 6 نجوم ألمع من 3.00 قدر 0 النجوم ضمن 10.00 فرسخ فلكي (32.62 سنة ضوئية) 1 ألمع نجم α Lyn (3.14قدر ظاهري) أجرام مسييه 0 زخّات الشهب ?????????? الكوكباتالحدودية ال...

 

 

Asian building for signal drums Drum tower in Wat Si Saket, a Buddhist temple in Vientiane, Laos Wikimedia Commons has media related to Drum towers. A drum tower (Chinese: 鼓楼; pinyin: gǔlóu) or gulou is a tower in the center of an old Asian city or village, mainly China, housing signal drums.[1] There was usually also a bell tower nearby.[citation needed] They were once found all over China in villages, marking the symbolic center of the settlement and used to ma...

Party official who oversees the whipping system in the party The Chief Whip of the Conservative Party oversees the whipping system in the party, which is responsible for ensuring that Conservative MPs or members of the House of Lords attend and vote in parliament in the desired way of the party leadership. Chief Whips, of which two are appointed in the party, a member of the House of Commons and a member of the House of Lords, also help to organise their party's contribution to parliamentary ...

 

 

Artikel atau sebagian dari artikel ini mungkin diterjemahkan dari Chocoholic di en.wikipedia.org. Isinya masih belum akurat, karena bagian yang diterjemahkan masih perlu diperhalus dan disempurnakan. Jika Anda menguasai bahasa aslinya, harap pertimbangkan untuk menelusuri referensinya dan menyempurnakan terjemahan ini. Anda juga dapat ikut bergotong royong pada ProyekWiki Perbaikan Terjemahan. (Pesan ini dapat dihapus jika terjemahan dirasa sudah cukup tepat. Lihat pula: panduan penerjemahan ...

 

 

Nama ini menggunakan cara penamaan Portugis. Nama keluarga pertama atau maternalnya adalah de Souza dan nama keluarga kedua atau paternalnya adalah Andrade. Diego Souza Souza bersama São Paulo pada 2018Informasi pribadiNama lengkap Diego de Souza AndradeTanggal lahir 17 Juni 1985 (umur 38)Tempat lahir Rio de Janeiro, BrasilTinggi 186 cm (6 ft 1 in)Posisi bermain Penyerang[1][2]Informasi klubKlub saat ini GrêmioNomor 29Karier junior2002–2003 Fluminen...

Breakaway from the Seventh-day Adventists The Official CSDA Logo The Creation Seventh Day (and) Adventist Church began as a small group that broke off from the Seventh-day Adventist Church in 1988, and organized its own church in 1991.[1][2] It has been involved in court cases with the General Conference of Seventh-day Adventists over trademarks and internet domain names.[3] History Part of a series on AdventismWilliam Miller BackgroundChristianityProtestantismAnabapti...

 

 

American ice cream parlor chain Handel's Enterprises LLCHandel's current logoTrade nameHandel's Homemade Ice CreamCompany typePrivateIndustryDessertGenreIce cream parlorFoundedJuly 15, 1945; 78 years ago (1945-07-15) in Youngstown, Ohio, U.S.FounderAlice HandelHeadquartersCanfield, Ohio, U.S.Number of locations120 as of May 23, 2023[update][1]Area served14 states in the U.S.ProductsIce cream • frozen treatsRevenueUS$30 million...

 

 

Municipality in Hidalgo, MexicoAtitalaquia MunicipalityMunicipalityAtitalaquia MunicipalityLocation in MexicoCoordinates: 20°03′30″N 99°13′15″W / 20.05833°N 99.22083°W / 20.05833; -99.22083Country MexicoStateHidalgoMunicipal seatAtitalaquíaArea • Municipality64.2 km2 (24.8 sq mi)Population (2010 census) • Municipality26,904 • MetroTula de Allende Atitalaquía is a town and one of the 84 municipal...

Japanese insurance company This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: Tokio Marine Nichido – news · newspapers · books · scholar · JSTOR (August 2019) (Learn how and when to remove this message) Tokio Marine & Nichido Fire Insurance Co., Ltd.東京海上日動火災保険株式会社Company typeSubs...

 

 

Proposed species of giraffe See Giraffe for details of how this proposed taxonomy fits with the currently accepted taxonomy of giraffes. Northern giraffe In Murchison Falls National Park Conservation status Vulnerable  (IUCN 3.1)[1] CITES Appendix II (CITES) Scientific classification Domain: Eukaryota Kingdom: Animalia Phylum: Chordata Class: Mammalia Order: Artiodactyla Family: Giraffidae Genus: Giraffa Species: G. camelopardalis Binomial name Giraffa camelopardalis(Li...