Author: Prof. Dr. Muddassar Farooq
What Is (JQRSTM) Journal Quality Ranking System
This site helps researchers and other relevant persons and/or
organizations to judge the quality of research work. This will also enable them to target quality venues for publishing their work. If you want to see the standing of a particular journal (according to JQRSTM), Click Here.
To adopt multi-metric quality criteria in order to determine the quality of a Journal. The JQRSTM overcomes the shortcomings, exploited by unethical publishers to mint money instead of quality publications, in the existing single Impact Factor (IF) metric based ranking of scientific journals. The new dependable quality criteria serve two purposes:
- To recognize within the Institute, those who publish at prestigious quality venues with a high degree of accuracy; and
- To proportionately reward these faculty members with honorariums to recognize their hard work. This will inculcate an atmosphere of “recognition and reward” within the Institute; as a result, the Institute will become a place from where quality research will emerge in due course in time.
JQRSTM is domain independent and applicable to scientific journals of fields of science, engineering & technology, management and medicine etc. JQRSTM helps decision makers in the top University management to reward quality researchers by allowing them reduced teaching load or to put a minimum quality bar on the publications considered for promotion or annual performance evaluation.
- In this Paper, for the sake of brevity, technical details of the measures will be omitted. The measures will be introduced at an intuitive level so that a reader can comprehend the motivation to use them. The measures are selected from a seminal paper by Bollen et al titled “A principle component analysis of 39 scientific impact measures” is available at arXiv Cornell publishing website (see Bollen J, Van de Sompel H, Hagberg A, Chute R, 2009 A Principal Component Analysis of 39 Scientific Impact Measures. PLoS ONE 4(6): e6022.doi:10.1371/journal.pone.0006022). The paper introduces 39 measures and we have selected only 5 from them that are the most influential ones and are publically available. We now introduce our Quality Journal Ranking System (JQRS)TM.
- Definition 1 [Eligible Journal]
A Journal is eligible to be considered for JQRSTM if and only if it:
This would ensure that we meet the minimum criteria used by HEC to include a Journal in the ranking of a University. We will take 2 measures from the seminal Eigenfactor™ Project that is a non-commercial academic research project sponsored by the Bergstrom Lab at the University of Washington [see http://www.eigenfactor.org].
- is indexed by Thomson Web of Science or an index recognized by HEC for ranking a University; and
- has been assigned an Impact Factor.
- Definition 2 [ArticleInfluence™]
The ArticleInfluence™ Score (AIF) for each journal is a measure of the per-article citation influence of the journal. This tells us (in percentile) that how much the articles of a journal have influenced the knowledge in a given subject area. We will assign a weight of 100 marks to AIF. The percentile rank will be the mark obtained out of 100.
- Definition 3 [EigenFactor™]
The Eigenfactor™ [EFT] score of a journal is an estimate of the percentage of time that library users spend with that journal. This factor measures the prestige of a Journal because with a prestigious journal, faculty members will spend more time. We will assign of a weight of 100 marks to EFT. The percentile rank will be the mark obtained out of 100.
To cater for diversity, we are taking three factors from Scimago website. SCImago is a research group from the Consejo Superior de Investigaciones Científicas (CSIC), Institute of Granada, Extremadura, Carlos III (Madrid) and Alcalá de Henares, dedicated to information analysis, representation and retrieval by means of visualization techniques [http://www.scimagojr.com].
- Definition 4 [Scimago Journal Rank (SJR)]
The SJR indicator measures the scientific influence of the average article in a journal; it expresses how central to the global scientific discussion an average article of the journal is and adapts Google Page Rank to measure it. It will have a weight of 100 points. The marks will be assigned as per Table I.
- Definition 5 [H-index]
The H-index is a prestigious measure to determine the quality and quantity of research produced by a faculty member, Journal and an institute. If H articles of a Journal are cited at least H times each and the remaining articles are not cited more than H times, then H will be the H-index of a Journal. It will have a weight of 100 points. The marks will be assigned as per Table I.
- Definition 6 [Cites per Doc (CD)]
Cites per Doc in last 2 years measures the scientific impact of an average article published in the journal, it is computed using the same formula that journal impact factor ™ (Thomson Reuters). It will have a weight of 100 points. The marks will be assigned as per Table I.
The five measures described above are applicable to all fields of Knowledge and together it will have 500-points formula.
- Definition 7 [Publication Fee]
Most Journals charge a publication fee of $500 to $ 1500/- to cover the cost of publication in a Journal. Many universities fund the publication cost for Journals from their R & D Fund.
- Definition 8 [Free Journals]
Some publishers do not charge the publication fee from the authors and hence a faculty member can publish a paper in these Journals free of charge.
- Definition 9 [Journal Quality Ranking System]
On the basis of 500 points formula, 5 categories of Journals, recognized in JQRSTM, are:
- Gold Journal. An Eligible Journal is ranked as Gold if it has achieved 80% or above marks in the 500 points formula.
- Silver Journal. An Eligible Journal is ranked as Silver if it has achieved 70% or above marks and less than 80% marks in the 500-points formula.
- Bronze Journal. An Eligible Journal is ranked as Bronze if it has achieved 60% or above marks and less than 70% marks in the 500-points formula.
- Honorable Mention. An Eligible Journal is ranked as Honorable Mention if it has achieved 50% or above marks and less than 60% marks in the 500-points formula.
- Quality Compliant Journal. Any Journal that does not meet Gold, Silver, Bronze and Honorable Mention criteria but meets two conditions:
Table I: Table to Assign Marks for SJR, H-index & Cites/doc. A publication in year X should use the values for the year (X-2)
- Is an eligible Journal, and
- Is a Free Journal.
||0.7 ≤ CD < 1.5
||1.5 ≤ CD < 2.0
||2.0 ≤ CD < 3.0
||3.0 ≤ CD
||50 ≤ H < 65
||65 ≤ H < 80
||80 ≤ H < 100
||100 ≤ H
||0.5 ≤ SJR < 0.80
||0.80 ≤ SJR < 1.50
||1.50 ≤ SJR < 2.00
||2.00 ≤ SJR
We define normalized thresholds (Nthreshold) for CD, H-index, and SJR as 0.7, 50 and 0.5 respectively. If a Journal is unable to get 50 marks, then its score for a particular matrix will be included using the formula (Metric Value) / (Nthreshold for metric) * 50.
- Definition 10 [Microsoft Research Rank]
In case of CS/EE, Microsoft Research Journal Rank has matured and will be used [http://academic.research.microsoft.com].
- Definition 11 [CORE Journal Ranking]
Computing Research and Education Association of Australasia (CORE) is established by the Australian Government in which eminent Professors in ICT rank Journals as A*, A, B, and C. The ranking is relevant to ICT only but it is the only one – to the best knowledge of Paper author – that depends on the expert opinion of faculty members working in ICT. It does not use mathematical measures [http://www.core.edu.au].