Indicators of bibliometric quality
« previous  next»

The JBR offers two basic types of indicators: (a) indicators of impact and (b) indicators of bibliometric quality.

The indicators of bibliometric quality are divided into (i) basic and (ii) composite indicators.

(i) basic indicators

The basic indicator scores are primarily intended for editorial boards, to be used in shaping their editorial policies. They provide an insight into the degree of the journal's compliance with the criteria for indexing in international bibliographic databases, in particular the citation indexes WoS and Scopus.

The list and desctiption of the basic indicators are show in the following table:

code
name and description
LegArt
share (%) of legitimate papers, excluding reprinted articles, conference papers
Equip
equipment of papers, i.e. full author affiliations, summaries/abstracts in Serbian and a foreign language, keywords in Serbian and a foreign language and acknowledgments (including funding information)
IntLang
share (%) of papers published in world languages, i.e. the full text of papers available in a major international language
NRef
average number of references per paper, not including papers without cited references
1+ Ref
share (%) of papers with at least one cited reference, either in the list of references, footnotes or endnotes
JourRef
share (%) of journal references, including local annuals and not including magazines and newspapers
IntRef
share (%) of international references, i.e. those published abroad in a foreign language
AgeRef
average age of cited references, expressed as the mean/median age in years; the so-called citing half-life
indConc
author concentration index, i.e. the share (%) of papers by authors affiliated with different academic institutions in the total number of papers by authors with academic affiliations
indInt
author internationality index, i.e. the share (%) of papers by authors affiliated with international academic institutions in the total number of papers not including papers co-authored with local authors

The basic indicator scores are shown in the tables:

  • Bibliometric quality for all evaluated journals, with their rankings for individual years,
  • Bibliometric quality for the journals classified in a particular group, with their rankings for individual years, and
  • Bibliometric quality on the page Journal's bibliometric portrait, where the data are displayed longitudinally, for all years when the journal was covered by the evaluation.

The basic indicator scores relevant for the impact assessment (authors' concentration index, authors' internationality index, average age of references and self-citation rate) are shown in the table Impact on the page Journal's bibliometric portrait.

(ii) composite indicators

The composite indicator scores are primarily intended for editorial boards, to use them in designing their editorial policies. They are indirectly used to check whether, and to what extent, journals meet ethical standards. The internationality is used in a direct way, as a requirement when allocating journals into the highest tier at the national level (K24). The procedure is described in some details under Journal rating.

The list and the descriptions of the composite indicators and the underlying bibliographic data (variables) are provided in the following table:

code
name and description
MQ
1. Metadata quality: the completeness of article-level metadata in accordance with international standards
NA
article title in Serbian
TI
article title in English
SA
summary/abstract in Serbian
AB
summary/abstract in English
NO
summary/abstract in German, French or Russian
KR
keywords in Serbian
KW
keywords in English
DT
document type (the so-called editorial classification)
PR
funding information (the name and the code of the project which funded the paper and the name of the funding institution)
AF
author affiliation (full hierarchy, starting with the top, university, level)
AI
2. Academic integrity: compliance with publishing, ethical and reviewing standards and procedures
Plag
plagiarism detection (using services intended exclusively for plagiarism detection in scholarly papers)
Datum
submission and acceptance dates (as well as correction and revision dates, if relevant)
PopRec
publicly available list of reviewers (published at least once a year)
BrRec
number of reviewers (ratio to the number of articles)
InoRec
percentage of international reviewers
Izjava
authors' statement of authorship and originality
AutCit
journal self-citation rate (the percentage of self-citations in the total number of citations)
VA
3. Visibility and availability: ensuring that papers are easily located and downloaded
RefEnd
bibliography or a list of references provided in a separate section at the end of the paper
DOI
DOI (Digital Object Identifier) assignment to all articles in the journal
KRkval
quality of keywords (standardized, based on recognized international thesauri)
ET
4. Transparency of editing: organizational efficiency and the transparency of editorial procedures
Online
online submission, peer review and tracking (using a journal management system)
Trans
transparency of procedures (online availability of acceptance/rejection rates and reviewers' decisions to the funding institution and the evaluator)
I
5. Internationality: the share of papers in English, references in international languages and papers by foreign authors
StraAut
share (%) of papers by international authors (not including articles co-authored with local authors)
KoAut
share (%) of papers co-authored between local authors and those affiliated with international institutions
StraRef
share (%) of international references, i.e. those published abroad in a foreign language
EngJez
share (%) of articles in the English language (full text in English only or both in English and Serbian)
PQ
6. Publishing quality: publishing and methodological rigour in applying international standards
Starost
average age of cited references, expressed as the mean/median age in years; the so-called citing half-life)
BrojRef
average number of references per article (not including articles without references)
RadStd
share (%) of legitimate articles (reprinted articles, conference papers and similar items are not considered legitimate)
CasRef
share (%) of journal references (including local annuals and not including magazines and newspapers)
1Ref
share (%) of articles with at least one reference (not including editorials and similar items)

The values of individual variables are calculated using a complex analytical procedure and the corresponding weighting formulas in order to determine journals' performance according to each of the six composite indicators. The maximum composite indicator score that a journal can have is:

code
composite indicators
score
MQ
Metadata quality: the completeness of article-level metadata in accordance with international standards
10
AI
Academic integrity: compliance with publishing, ethical and reviewing standards and procedures
25
VA
Visibility and availability: ensuring that papers are easily located and downloaded
15
ET
Transparency of editing: organizational efficiency and the transparency of editorial procedures
20
I
Internationality: the share of papers in English, references in international languages and papers by foreign authors
20
PQ
Publishing quality: publishing and methodological rigour in applying international standards
10

The composite indicator scores are displayed on the page Journal's Bibliometric Portrait in Table B. composite Indicators, where they are provided for all years in which the journal was evaluated.

Finally, the scores are converted to z-values in order to show the journal's relative performance according to individual composite indicators. The determined scores are displayed in the dynamic radar chart Relative performance, in the form of the journal's profile.

Composite indicators

The scores are also displayed in the national citation index (SCIndeks) on the page Bibliometric performance under Bibliometric quality.