Importance Of References And Bibliography In The Research

Citations are not used simply to avoid plagiarism; they have other important roles too.

Referencing allows you to acknowledge the contribution of other writers and researcher in your work. Any university assignments that draw on the ideas, words or research of other writers must contain citations.

Referencing is also a way to give credit to the writers from whom you have borrowed words and ideas. By citing the work of a particular scholar you acknowledge and respect the intellectual property rights of that researcher. As a student (or an academic) you can draw on any of the millions of ideas, insights and arguments published by other writers, many of whom have spent years researching and writing. All you need to do is acknowledge their contribution to your assignment.

Referencing is a way to provide evidence to support the assertions and claims in your own assignments. By citing experts in your field, you are showing your marker that you are aware of the field in which you are operating. Your citations map the space of your discipline, and allow you to navigate your way through your chosen field of study, in the same way that sailors steer by the stars.

References should always be accurate, allowing your readers to trace the sources of information you have used. The best way to make sure you reference accurately is to keep a record of all the sources you used when reading and researching for an assignment.

Citations also make your writing more persuasive. 

Exercise: Look at the two paragraphs below: which one seems more authoritative?

Paragraph one


The importance, or otherwise, of lyrics in popular music, and academic approaches to song lyrics, is subject to much debate. The supposed ‘poor’ standard or presumed meaninglessness of popular music lyrics, become a means to critique popular music. Conversely, it could be argued that too much attention is given to a song’s lyrics, to the point where the music itself is overlooked; it is also possible to overestimate the degree to which the music listener actually listens to the words, or perceives them to be the site of meaning in a song. Nonetheless, Simon Frith suggests that lyrics do allow songs to be ‘used in particular ways’: lyrics facilitate certain ‘creative articulations’. In the case of protest music, the lyrics allow a song to be made to speak to political issues.

Paragraph two


The importance, or otherwise, of lyrics in popular music, and academic approaches to song lyrics, is subject to much debate (Frith, 1998; Shepherd, 1999; Fornas, 2003). The supposed ‘poor’ standard or presumed meaninglessness of popular music lyrics, become a means to critique popular music. Conversely, it could be argued that too much attention is given to a song’s lyrics, to the point where the music itself is overlooked; it is also possible to overestimate the degree to which the music listener actually listens to the words, or perceives them to be the site of meaning in a song (Shepherd, 1999:172). Nonetheless, Simon Frith suggests that lyrics do allow songs to be ‘used in particular ways’ (cited in Martin, 1995:273): lyrics facilitate certain ‘creative articulations’ (Johnson, 2000). In the case of protest music, the lyrics allow a song to be made to speak to political issues.

The paragraphs are identical, except for the absence of citations from paragraph 1.

The first paragraph may be just as interesting as the second, but within an academic context, a context that requires you to show from where you have taken ideas, the second has far more authority, it is more persuasive. It shows that the ideas you are discussing are matters that are important to your particular academic community.

What kind of information do I need to reference?

Printed books are not the only sources that require acknowledgement. ANY words, ideas or information taken from ANY source requires a reference.

Reference when you are using words or ideas from:

  • books and journal articles;
  • newspapers and magazines;
  • pamphlets or brochures;
  • films, documentaries, television programs or advertisements;
  • websites or electronic resources;
  • letters, emails, online discussion forums;
  • personal interviews;
  • lecturers or tutors (not always necessary, but check with your lecturer or tutor about their preferences before you draw on their ideas).
  • Reference when you reprint any diagrams, illustrations, charts or pictures.

No need to reference:

  • when you are writing your own observations or experiment results (for example, a report on a field trip);
  • when you are writing about your own experiences (for example, a reflective journal);
  • when you are writing your own thoughts, comments or conclusions in an assignment;
  • when you are evaluating or offering your own analysis;
  • when you are using 'common knowledge' (facts that can be found in numerous places and are likely to be known by a lot of people) or folklore;
  • when you are using generally accepted facts or information (this will vary in different disciplines of study. If in doubt, ask your tutor).


In scientific circles, the reference is the information that is necessary to the reader in identifying and finding used sources. The basic rule when listing the sources used is that references must be accurate, complete and should be consistently applied. On the other hand, quoting implies verbatim written or verbal repetition of parts of the text or words written by others that can be checked in original. Authors of every new scientific article need to explain how their study or research fits with previous one in the same or similar fields. A typical article in the health sciences refers to approximately 20-30 other articles published in peer reviewed journals, cite once or hundreds times. Citations typically appear in two formats: a) as in-text citations where the sources of information are briefly identified in the text; or b) in the reference list at the end of the publication (book chapter, manuscript, article, etc.) that provides full bibliographic information for each source.

Group of publishers met in Vancouver in 1978 and decided to prescribe uniform technical propositions for publication. Adopted in the 1979 by the National Library of Medicine in Bethesda, then the International Committee of Medical Journals Editors (ICMJE), whose review in 1982 entered the official application by 300 international biomedical journals. Authors writing articles for publication in biomedical publications used predominantly citation styles: Vancouver style, Harward style, PubMed style, ICMJE, APA, etc. The paper gives examples of all of these styles of citation to the authors in order to facilitate their applications. Also in this paper is given the review about the problem of plagiarism which becomes more common in the writing of scientific and technical articles in biomedicine.

Key words: citing and quoting references, scientometrics, plagiarism.


We live in an era of scientific and technical information explosion that are collected in the inexhaustible knowledge bases through millions of biomedical and other journals into on-line databases (1, 2, 3, 4, 5). Science has made enormous achievements for our understanding of the world and for everyday life. We are witnessing extraordinary advancement of technology, knowledge and applied skills in our everyday life (1). Medicine, as one of the fundamental scientific branches during the last 50 years has experienced a boom in all its spheres. We can certainly say that this growth and progress is based on the number of results in the scientific research of researchers around the world and their mutual exchange. In the late twentieth and early twentyfirst century, to the general population became available information and communication technologies (ICT), primarily in the form of the Internet, which significantly simplify the exchange of information, knowledge and skills (6, 7, 8, 9, 10). Due to the flourishing of ICT use which occurred during 90s of the twentieth century, when the scientific research in Bosnia and Herzegovina (B&H) was significantly depressed by aggression and recovery from war and postwar development, the question is where are the B&H scientists within global scientific scene?


In order that a person devote itself to science and research, it is necessary to possess the following qualities: intelligence, skills of analysis and synthesis, the power of observation, perseverance, creativity, ethics and responsibility (2). After the selection of research topics, selecting mentors, associates in the project which is being implemented and the implementation of the research, follows the writing the article, using the definition of the methodological postulates. The concept of scientific research is based on the use of scientifically based principles by passing through the appropriate and necessary steps and division of certain sections of the final written presentation of the results of the study. Each paper is intended for publication in one of the indexed biomedical journal should contain title, abstract, introduction, methods, results, discussion, conclusion and list of references used by appropriate citation (7, 8, 9).

Author Kathrin H. Jacobsen in her book: “Health Research Methods: a Practical Guide” (2102) (7) described 5 steps in process of health research – from idea to realization:

  • Identifying a Study Question,

  • Selecting a Study Approach,

  • Designing the Study and Collecting Data,

  • Analyzing Data,

  • Reporting Findings.

Writing a paper is a tedious job, however, following the established rules that work not only becomes much simpler, but also more accessible, which often results in the birth of the desire of researchers to write an article (11, 12). Knowledge of the principles established by the process of scientific research demystifies the process. Decomposition process research into simpler trying to animate all those who can contribute to the advancement of medical science. Emphasizes the importance of pursuing the following five steps: identification of the main research questions, the selection of a scientific approach, study design and data collection, data analysis and presentation of the work (7). The first step in the process is exploring a variety of themes as the focus of research. The first step has multiple segments, such as: choice of the major topics of research, literature review, focusing on the question of research, drafting support team. The second step in the research is to select the main access study. Access can be: review or meta-analysis, correlation (ecological) studies, case series, crosssectional studies, case control studies, cohort studies, experimental studies or qualitative studies. The third step of the process of scientific research is the development and implementation of a detailed study plan. It is necessary to know how to create a protocol for primary, secondary and tertiary studies. Overview of developing proposals and flow. Primary studies require: a sample of the population, determination of the sample size, the development of questionnaires, surveys and interviews, additional assessment, ethical issues, ethical review and authorization. Secondary studies include existing data sets, and tertiary studies include a systematic review and meta-analysis. The fourth step in the research is the collection and analysis of data collected in the third step. Most researches require descriptive or comparative statistics. This step includes: management of data, descriptive statistics, comparative statistics and advanced biostatistics. The fifth and final step in the process is writing a research report and preparation for presentation and publication. In this step is described the structure of the article, quote, writing strategies, critical review, posters and presentations, choosing journals for publication, the process of teaching, examination and publication of the work and why publish? In order to discover something new, it should be: the average intelligence, the ability to analyze and synthesis, power of perception, desire, determination, creativity, ethics, responsibility and, most importantly, a pure intention to achieve a desired goal (7).

Author Bjorn Gustavii (2008) in his book “How to Write and Illustrate Scientific Papers” described three basic rules of writing (6):

  1. Brevity – elementary rule of writing, not only to save publication space, but also because verbose writing obscures meaning and wastes the reader’s time and patients;

  2. Logic and clarity – what you want to say should be o arranged that reader can follow your argumentation step by step;

  3. Clean typing – make sure your manuscript looks carefully prepared; it may influence editors and referees in your favor.


Scientific articles in almost all cases have the follow structure: abstract, introduction, methods, results and discussion. For didactic reasons is formed the acronym IMRAD (8, 9, 10): I–Introduction, M–Methods (or Methods and Materials), R–Results, A–and D–Discussion and Conclusion.

3.1. Title

Title of the paper should be as short as possible, as well as concise as possible in describing the content of the article. We can say that the title is a summary of an abstract (2). A good title should be: a) short, b) correct, c) a clear, d) complete, e) informing, d) attractive.

3.2. Name(s) of the authors and their institutions

It is necessary to specify the names and surnames (full texts) of the authors and co-authors who participated in editing of the article, and also their affiliations. Must be respected the instructions that journals require in which the article will be published (Instructions for authors).

3.3. Abstract

Abstract/Summary and Title can be written in two forms: Reference and Information. It can be written in author’s native language and English. The structure of the summary should look like this: introduction, goal, materials and methods, the location of the study, measuring the outcomes of the study, the results and conclusions.

3.4. Introduction

Introduction is part of the article with a list of already known facts, presented in order to inform readers on the topic and research issues. It also provides the reader with a basis on which the discussion later in the article was carried out. Writing an introduction has its own rules: a clear definition of the problem and why exactly this issue was explored. There is no need to explain what can be found in the textbooks, nor the terms of the title.

3.5. Materials and methods

Materials and methods describe how the study was conducted and what are the characteristics of the sample (experimental group, controls and their properties). It is necessary to explain what is researched, asked, tested as follows: sampling (random, consecutive, and representative), the sample size (patient gender, age), the control group, and the criteria for exclusion from the study, the control group–if any. It should be described how the research was done: type of study (prospective, retrospective or combined), data collection (surveys, inventory or check-up), the technique of measuring results (operative treatment, laboratory tests).

3.6. Results

The research results are usually most carefully read and should provide a detailed plan, well-documented and at the optimal dose. Results are the most important part of scientific research. Consequently it is essential that graphic and textual part of the article is clearly shown. Results can be displayed in tables or figures. The author(s) will decide on display mode, but never both tabular and chart form. It is essential that the relevant facts are highlighted and clearly displayed.

3.7. Discussion

Discussion is a critical review of the data described in the results. The results should be compared with other findings and discuss the theoretical and practical research outcome.

3.8. Conclusion

The conclusion seems logical sequence of the previous two sections, it does not recount results, but combines them in a clear and understandable context. Conclusion should be short, clear and precise. It is necessary to: make the final statement of what logically follows from the results of the work.


In scientific circles, the reference is the information that is necessary to the reader in identifying and finding used sources. The basic rule when listing the sources used is that references must be accurate, complete and should be consistently applied. On the other hand the quoting implies verbatim written or verbal repetition of parts of the text or words written by others that can be checked in the original text (4). There are several systems of citation and referencing, while the most commonly used systems are “author-date” (such as the Harvard system, APA, etc.) and numerical systems (such as CSA, IEEE, Vancouver style and others). Often, the preferred system of citation is depended on the scientific discipline in which the author writes. Thus the ways the references are written in an article about mathematics differ from the references in the article about biomedicine. Also, the authors are sometimes faced with the need to respect pre-set requirements for quoting sources from the institution, journal or publisher (1, 2, 6, 8, 13). For example, different requirements will be from higher education institutions in the use of reference in the thesis or doctoral dissertation, from the publisher requirements (e.g. journal) that is indexed in the databases (e.g., Web of Knowledge, Medline, Scopus, etc.). Each system includes a precisely defined set of rules for attribution in the text of scientific or professional work and a way of referring to them. The aim is to make it recognizable what, in the text, belongs to the author and what is taken from other authors/sources. Once adopted, one way of reference must be applied consistently throughout the text.

4.1. Harvard system of citing

Harvard system of references citation represents the most common method of citation in the natural and social sciences. This system is often referred to as the “author-date” system. The same category include the APA guidance system of references, which from the Harvard system essentially differs in how to use punctuation and conjunctions. Characteristic of Harvard system is listing only the basic information in the text (the author’s name, year of publication), while the complete data on the work is cited at the end in the chapter References/Literature. In medical science it can be customary to list references only from papers that are directly used (cited) in the text). During writing the author can read and study many articles, however, these sources are not mentioned in the literature, unless they are directly used (8, 13).

4.2. Other standards for citing references in the text

Author during the preparation for the writing of specific article encounters with different types of secondary data. For example, the publication may be written by one, by several authors, and sometimes the authors are not listed but only the organization by which the work was published. With that in mind, when citing sources, to the publication is variously referred to in the text. During the writing operation, publishers may refer to different sources. In this review, article lists various examples of proper citation which is most commonly used when writing scientific and professional publications (8, 13).

Citing references in the text we will discuss on the example that is recommended by ScopeMed– (Figure ​1):

Figure 1.

Abstract: Masic I. How to Search, Write, Prepare and Publish the Scientific Papers in the Biomedical Journals. Published in the journal Acta Inform Med, displayed at

Masic I. How to Search, Write, Prepare and Publish the Scientific Papers in the Biomedical Journals. Acta Inform Med. 2011 Jun; [cited January 25, 2013]; 19(2): 68-79. doi:10.5455/aim.2011.19.68-79.

If we want to quote this article in article that we publish in an indexed journal that is covered by DBMS ScopeMed there are several recognized ways of quoting the text. The instructions on ScopeMed list of a few ways in which you can quote this text, in all styles, is seen in Figure ​2.

First manner of citation is Pubmed Style:

Masic I. How to Search, Write, Prepare and Publish the Scientific Papers in the Biomedical Journals. Acta Inform Med. 2012 Jun; 19(2): 68-79. doi:10.5455/aim.2011.19.68-79.

National Library of Medicine (NLM) recommends using standard ANSI/NISO Z39.29-2005 (R2010). Bibliographic References standard is the basic format for Pubmed/MEDLINE citation. The last item in the above quotation is the unique identification number in the PubMed database and status citations indexed in MEDLINE. NLM has changed a way of citation - that first is cited the author and title of the work (in November 2008).

Another way of quoting is using Web Style:

Masic I. How to Search, Write, Prepare and Publish the Scientific Papers in the Biomedical Journals. [Access: January 25, 2013]. doi:10.5455/aim.2011.19.68-79.

This method of citation is different from others in that after the basic information about the author and the work includes a web address. Commonly used at online portals, web sites, etc.

Third way of citation: AMA (American Medical Association) Style:

Masic I. How to Search, Write, Prepare and Publish the Scientific Papers in the Biomedical Journals. Acta Inform Med. 2011; 19(2): 68-79. doi:10.5455/aim.2012.19.68-79.

AMA citation rules recommend the use of full names of the first six authors and co-authors, if there are more than 6, we write the first three and add “et al”.

Most commonly it is recommended to use Vancouver/ICMJE Style:

Masic I. How to Search, Write, Prepare and Publish the Scientific Papers in the Biomedical Journals. Acta Inform Med. (2011), [cited January 27, 2013]; 19(2): 68-79. doi:10.5455/aim.2012.19.68-79.

4.3. Citing references in other biomedical scientific publications

Basic bibliographic elements are: author/s, title, journal title, numerical data on the journal, city of publisher and year of publication, data on the quoted unit (references). References could be cited one time in the text and second time as the list of references at the end of the article. Reference in the text by Arabic numerals starting with 1 and a list of references entered in the order of appearance in the text. Certain types of data separated with the original punctuation symbols that are standard profiled, design references highlighted in red. From this structure we use bibliographic elements that appear in described publication, and all the others are omitted. When omitting an element of bibliographic description do not use punctuation symbol that precedes it (2, 8). For example, if the publication has no subtitle we will not use the semicolon character that preceded the subtitle of the work, but after the title place the point that marks the end of each group of data.

4.4. Basic structure of the reference

As a space character is used as an underscore (_).

Printed an article from a journal

First author,_Second author,_... Sixth author_et_al._Title:_Subtitle._journal name._year; volume (issue or number_Pt_number)_Suppl _number:pages from—to.

Example 1

Masic I. Plagiarism in Scientific Publishing. Acta Inform Med. 2012 Dec; [cited May 17, 2013]; 20(4): 208-213. doi:10.5455/aim.2012.20.208-213.

More than six authors

Example 2

Stipetić J, Čelebić A, Baučić I, Lazić B, Komar D, Bratolić V, et al. Analysis of occlusal contacts in different types of prosthodontics appliance: Eichner classification: presence RCP-ICP slide and the type of occlusion. Coll Antropol. 2001; 25: 311-6.

Printed book

First author,_Second author,_... Sixth author_et_al._Book title:_Subtitle. _volume._City:_First publisher,_Second publisher;_year.

Example 3

Rang HP, Dale MM, Ritter JM, Moore PK. Pharmacology. 5th ed. Edinburgh: Churchill Livingstone; 2001.

Electronic materials – Compact Disc

Authors/editors._Article title:_Article subtitle._volume._[CDROM]._City: _Publisher;_year.

Example 4

Ash MM, Nelson SJ. Wheeler’s dental anatomy, physiology and occlusion [CD-ROM]. 8th ed. Philadelphia: Saunders; 2003.

Electronic materials – article

Authors._Article title:_Article subtitle._journal name_[serial on the Internet]._year_motnh_ [cited_year_month_day]; volume (issue): [about x p.]._Available from:_web adress.

Example 5

Masic I. How to Search, Write, Prepare and Publish the Scientific Papers in the Biomedical Journals. [Access: January 25, 2013]. doi:10.5455/aim.2012.19.68-79.

Electronic materials – book

Authors/editors._Article title:_Article subtitle._volume_[monograph on the Internet]._City:_publisher;_year_[cited_year_month_day]. _ Available from:_web address.

Example 6

Lukač J. Klinička imunologija: nastavno pomagalo za studente Stomatološkog fakulteta Sveučulišta u Zagrebu [monograph on the Internet]. Zagreb: Stomatološki fakultet; 2004 [cited 2005 Jun 20]. Available from:

4.5. Citing books, monographs, textbooks, dissertations

Author/s: Up to six authors are listed and all the others are listed as et al. First is listed the last name, followed by initial(s) of the first name. More initials of the same person name are written without spaces.

Editor/s: listed in the identical manner authors and adds a tag editor(s). Title and subtitle of the article: transcribed from the original and each separated by the colon. Only the first word of the title and names (personal, geographic, etc.) should be written with a capital letter.

Journal title: By the official acronym of the Index Medicus that is available online through PubMed interface at In the Search field select Journals database and then enter in the field the full name of the journal. Abbreviation will be listed in field Title Abbreviation. Last word of journal titles ending with point.

Numerical data of the journal: by Arabic numerals enter data in the following order: year, volume, issue, part, supplement, pages. Number of individual issue is entered in parentheses and is obligated to enroll if pagination (numbering) of each individual issue starting from 1. To mark a part of individual issue is used abbreviation Pt. in parentheses. To list supplement use the abbreviation Suppl. and add a number or other designation if any. Pages of the article are written from first to last and without repeating the common parts.

All numerical data are mutually separated by punctuation symbols without spaces except the mark Pt. and Suppl.

Edition of the book (except the first): written by English spelling for item numbers and adds ed. If there is additional information about the volume, the words are transferred from the template. Ordinal number of the volumes of the book (if it is published in several volumes) by an expression vol.

City of publishing: Enter the first city listed in the original and for the other is added etc...

Publisher/s: are transcribed from the original. If the institution is listed as the publisher and its organizational part, the data is separated by a comma. Date of publishing: is transcribed from the title page and if publication year is not specified written is a year copyright. Book Pages: listed only when we quote part of the book, preceded by the label.

Dissertation: to dissertation is referred to as the angular brackets, and put the title (or subtitle) of the work. Pages refer to the total number of pages of the dissertation.


The biggest problem which participants in the academic process encountered is plagiarism (9, 10, 11). This is one of the most common ways of compromising the academic integrity of the author and cause of constant conflict in scientific-research sphere of interest. Copy, use or otherwise exploitation of other people’s ideas, words or creations, without citing sources in an appropriate form is prohibited. It is not enough to change a few words in a phrase from the source material into “own words”. Change the order of words in a sentence is also not acceptable, as well as the use of synonyms, such as changes from the “air” to “atmosphere”.

When writing papers it is possible to use other people’s words and ideas, but with mandatory labeling and reference to the source from which these words and ideas are taken. People who read can even in the very sentences recognize whether something is written in original work or just taken as a piece from another text. The references, as an indispensable part of any scientific and professional work, contribute to the quality of work, speaks of the sources used and thus the depth of information on the subject by which the work is dedicated. The process of preparation of each work should begin by consultations with existing resources, potential research and then writing the work giving it a personal stamp.

There are many different definitions of plagiarism. Plagiarism (Latin plagium-kidnapping) is a transcription of other people’s works and illegal appropriation of another’s spiritual property (13). Plagiarist (Latin Plagiarius - thief, kidnapper) is illegal trespassing spiritual property that and uses other people’s ideas, opinions or theories, either literally, or paraphrased, which does not mention the author and source of information. Such a “copy-paste” act constitutes theft of authorship, which is completely unacceptable in scientific, technical articles or in books, monographs, specialist or graduate student papers. In the wider academic community, plagiarism is a serious breach of ethical standards and a disciplinary liability and sanctions of various types and weights (8). There is a dilemma: who, on what basis (criteria, standards, rules), when and how should someone be declared as plagiarist or which someone’s scientific work or part of that work to declare as plagiarism. Then, which institutions or which scientific body committee at the national or international level, when plagiarism is proven, can sanction someone and what are the sanctions. It is necessary to work on improvement of the mechanisms for early and sophisticated plagiarism detection through software applications, which in the foreseeable future must become compulsory for every editor of an indexed journal to use. A transparent database in which disclosed plagiarism (“black list of plagiators”) could be found should be made at the international level. This would impact on the prevention of plagiarism (“principle of fear from possible sanctions”). Here will be mentioned one of examples published by CEON ( (17):

“For practical and economic reasons, plagiarism was checked only in the papers of Serbian authors. For the same reasons, in DRUNPP journals this was done for authors who published more than five papers in analyzed period. This criterion ensured a sufficient number of papers for determining the incidence of plagiarism but, due to the selection of authors publishing in DRUNPP journals, the results obtained for these two and control journals (Table ​1) should not be understood as mutually strictly comparable (17)”.

Table 1

Plagiarized papers of Serbian authors (Šipka P. 2012, p.25). Explanation of abbrevation : OK = Plagiarism-free paper; N/A = Unavailable articles; A = Mild self-plagiarism; A+ = Crudeself-plagiarism; P = Mild plagiarism; P+ = Crude plagiarism (...

“However, even if this restriction is taken into account, it is obvious that plagiarism is more frequent in DRUNPP journals. Cases of crude plagiarism and self-plagiarism (A+ and P+) were found practically only in HealthMed and TTEM. For an orientation, by using the same criteria in 2010 we found about the same level of plagiarism in Serbian non-WoS journals (15, 16), but meanwhile, thanks to CEON/CEES activities, this was reduced to much lower levels. All in all, the results strongly suggest that two DRUNPP journals and a group of authors from a few Serbian academic institutions are organized into an arrangement that has to be labeled as “joint unethical enterprise”. Its rationale seems to be quite simple. Some authors are allowed to publish limitlessly without regular reviewing in journals of formally high international prestige. This brings them quite tangible benefits (so called points) important for their careers and incomes. In return, the editors collect from them a substantial amount of money for fictitious editing job and, on top of this, as a sort of tip, some fictitious citations to help their journals maintaining the status of highly esteemed publications. What this enterprise makes extraordinary and unprecedented, are clear signs of forced collections of this non-monetary fee: if authors in their citing role are not sufficiently generous, editors simply snatch their “deserved” tip forcefully, by adding themselves some impact inflating self-citations to the paper reference lists. Being practical people, in order to protect themselves from crossing the self-citation rate limits, they occasionally put citations onto other DRUNPP journal account (17).”

“The economic dimensions of the phenomenon are equally impressive. In just a few years DRUNPP journals grew from anonymous to the most popular international journals in neighboring Serbia, attracting a fastgrowing number of papers, and collecting even faster-growing publication charges. The spending of Serbian authors on publishing in the two journals in 2012 only was predicted to exceed €200.000 (18), an amount that has to be regarded a serious burden for the national R&D budget in crisis and a fortune for the family of editors. There are many signs that the family business is on the right track. The same publisher created recently two additional medical journals (19, 20), with the same editor on board, and with unveiled intention to bring them to the same official (WoS/JCR) status and price level. Also, the international online “round-a-clock” conference is already here (21, 22) to round up the “production line”.”


In B&H there are series of biomedical journals which are indexed in international databases. Table ​2 shows a series of indexed biomedical journals published in Bosnia and Herzegovina (14, 15). It is assumed that the most cited scholars and experts in the academic community, who have published their research results in one of the journals indexed in the reference world recognized online databases, whose articles are available for scientific validity. This all through their representation in the form of abstracts or full article on the website of these on-line databases. For example, the current reference and quality of scientific B&H medical science we will take in the current analysis involved 10 academics from Academy of Sciences and Arts of B&H from the Department of Medical Sciences, for which we should say that are “most scientific” part of our academic community in the field of biomedicine. Used are sources from the current 4 most cited world-renowned databases: ISI Web of Knowledge, SCOPUS, EMBASE and PubMed (3, 22). Analyzed is the number of published papers on the basis of two criteria: a) tested scientist as first author and co-author in published papers in indexed those journals; b) scientist examined with citations of their articles as author and co-author by other authors of published papers in indexed journals in mentioned databases (Table ​3).

Table 2

Biomedical journals printing in Bosnia and Herzegovina indexed in on-line databases in 2013

Table 3

Number of published papers in indexed journals and number of citations in on-line databases of academicians of Department of Medical Sciences of Acadamy of Sciences and Arts of Bosnia and Herzegovina in ISIWoK, SCOPUS, EMBASE and PubMed (accessed on May...


Scientometrics is the science of measuring and analyzing science. In practice, Scientometrics often uses bibliometric methods for measuring the impact of scientific publications. Modern Scientometrics is based largely on the work of Derek J. de Solla Price and Eugene Garfield. Garfield founded ISI – Institute for Scientific Information and is considered to be the father of scientometrics and methods of evaluation of scientific publications. Research Methods of scientifically important publications include qualitative and quantitative methods and computer analysis approach (6, 8, 13). Garfield has been striving to mathematical representation, so he developed several factors that allow the assessment value and importance of scientific publications, including the most important impact factor (IF) and the H-index. Each article has its impact factor. Impact factor shows how much scientific paper, published in a magazine is quoted. Title of the scientific paper contains a brief description of the content. Impact Factor (IF) in the academic journal is a measure that reflects the average number of citations of articles published in the journal. Impact factor is used to compare different journals in a particular area. In a given year, the impact factor (IF) of the journal is the average number of citations received per paper published in that journal during the previous two years. For example, if a journal IF = 3 in 2008, then the articles published in 2006 and the 2007 had three citations on average in 2008. (Figure ​3 and Table ​5)

Figure 3.

h-index from a plot of decreasing citations for numbered paper.

Table 5

The table explains where’s the position of B&H in the world today in all areas that are represented in scientific research work since the 1996-2011 years

IF for the 2008 of an journal will be calculated as follows: A = number of cited articles published in 2006 and 2007 in indexed journals during the 2008 B = the total number of articles published by the journal in 2006 and 2007. 2008 IF = A/B.

H-index is an index that attempts to measure the productivity and impact of published work of scientists. The index is based on the basis of the most cited papers and the number of citations that papers received in other publications. Th is index can also be applied to the productivity and impact of a group of scientists, such as department or faculty, as well as journal. H-index proposed by Jorge E. Hirsch, a physicist at UCSD, as a tool for determining the relative quality (7, 22). The index is based on the distribution of citations received by a given researcher’s publications. Hirsch writes: A scientist has index h if h of his/her Np papers have at least h citations each, and the other (Np – h) papers have no more than h-citations each. In other words, a scholar with an index of h has published h papers each of which has been cited in other papers at least h times. Thus, the h-index reflects both the number of publications and the number of citations per publication. The index is designed to improve upon simpler measures such as the total number of citations or publications (22).

The index works properly only for comparing scientists working in the same field; citation conventions differ widely among different fields.

From Table ​4. It is clear that the h-index of the oldest biomedical journal Medical Archives is significantly higher with h-index of 10, which means that the scientist who in this magazine published 10 papers have at least 10 citations for each work in other journals.

Table 4

Presentation of biomedical journals in B&H ordered by the h-index values in 2012

Conflict of interest

None declared.


1. Arslanagic M, Kadic-Maglajlic S. (urednice). Prirucnik za navodjenje izvora u naucnim i strucnim radovima. Sarajevo: Ekonomski fakultet Univerziteta u Sarajevu; 2001. pp. 5–36.

2. Masic I, Ridjanovic Z, Pandza H, Masic Z. Medical Informatics. Sarajevo: Avicena; 2010. pp. 279–334.

3. Masic I, Milinovic K. On-line Biomedical Databases - the Best Source for Quick Search of the Scientifi c Information in the Biomedicine. Acta Inform Med. 2012;20(2):72–84. doi:10.5455/aim.2012.20.72-84. [PMC free article][PubMed]

4. . [May 15th, 2013].

5. . [May 15th, 2013].

6. Gustavii B. How to Write and Illustrate Scientific Papers. 2nd ed. Cambridge-New York: Cambridge University Press; 2008. pp. 1–2.

7. Jacobsen HK. Health Research Methods: a Practical Guide. Ontario: Jones & Barlett Learning, LLC; 2012. pp. 9–237.

8. Masic I. How to Search, Write, Prepare and Publish the Scientific Papers in the Biomedical Journals. Acta Inform Med. 2011;19(2):68–79. doi: 10.5455/aim.2011.19.68-79. [PMC free article][PubMed]

9. Masic I. Plagiarism in Scientifi c Publishing. Acta Inform Med. 2012;20(4):208–213. doi: 10.5455/aim.2012.20.208-213. [PMC free article][PubMed]

10. Roig M. Avoiding unethical writing practice. Food and Chemical Toxicology. 2012;50:3385–3387.[PubMed]

11. Amstrong JD. Plagiarism – what is it, whoom does it off end and how does one deal with it? Am J of Roentgenology. 1993;161:479–484.[PubMed]

12. Luscher FT. The codex of science: honesty, precision, and truth – and its violations. European Heart Journal. 2013;34:1018–1023. doi: 10.1093/eurheartj/eht063. [PubMed]

13. Masic I. Ethical Aspects and Dilemmas of Preparing, Writing and Publishing of the Scientific Papers in the Biomedical Journals. Acta Inform Med. 2012;20(3):141–148. doi: 10.5455/aim.2012.20.141-148. [PMC free article][PubMed]

14. Masic I. Bosnian and Herzegovinian Medical Scientists in PubMed Database. Med Arh. 2013 Apr;67(2):147–150. doi: 10.5455/medarh.2013.67.147-150. [PubMed]

15. Masic I, Kundzic E. Scientific and research work and academic periodicals. Albanian Medical Journal. 2013 Jun;49(2):84–105.

16. Šipka P, et al. Measures against plagiarism and related phenomena: A proposal, CEES Working Papers, ERD 20-01/03-11. . [December 20th, 2012].

17. Šipka P. Legitimacy of citations in predatory publishing: The case of proliferation of papers by Serbian authors in two Bosnian WoS indexed journals. CEES Occasional Paper Series. 2012. [June 15th, 2013]. pp. 25–26. .

18. Šipka P, Jankov MR, Radojkovic M, Jevtovic Z, Dekic-Vuckovic Lj. Open letter to the Minister of Education, Science, and Technological Development: Please provide normative and ethical integrity of the system of evaluation of researchers. Belgrade: CEON/CEES (in Serbian); 2012. [December 20th, 2012]. .

19. International Journal of Collaborative Research on Internal Medicine & Public Health (IJCRIMPH) [June 15th, 2013].

20. International Journal of Pharmacy Teaching & Practices (IJPTP) [June 15th, 2013]. .

21. Masic I. Plagiarism and Scientific Publishing. World Medical Journal. 2013 Jun;59(2):110–112.

22. Masic I, Kujundzic E. Science editing of academic periodicals in biomedical and social sciences. Sarajevo: Avicena; 2013. pp. 7–120.

Articles from Acta Informatica Medica are provided here courtesy of Academy of Medical Sciences of Bosnia and Herzegovina, Sarajevo, Bosnia and Herzegovina


Leave a Reply

Your email address will not be published. Required fields are marked *