An assessment of quality, trustworthiness and usability of Indonesian agricultural science journals: stated preference versus revealed preference study
- 362 Downloads
Scientific journals published in non-English languages may be less accessible to researchers worldwide. Most of them are not covered in international indexing and abstracting databases such as the Web of Science and Scopus, which can influence their impact. Scientific journals published by the Indonesian Agency for Agricultural Research and Development are a case in point, and their impact cannot be ascertained due to the non-existence of a tool that can assist in assessing the performance of the journals. To address this concern, this study aims to (a) assess the quality of Indonesian agricultural science journals; (b) determine how Indonesia-based agricultural science researchers assign and calibrate trust to the journals they use; (c) determine how Indonesia-based agricultural science researchers assess the usability of the journals they read; and (d) produce an internal ranking of Indonesian agricultural journals. The study has been designed as a combination of two approaches, namely revealed preference and stated preference study. The revealed preference study involves citation analysis of the nine journals sampled. The stated preference study gauges the trustworthiness and usability of these journals from the perspectives of the researchers who use them. The revealed preference provides the Journal Quality Index whereas the stated preference study provides the Journal Trust and Journal Usability Index. The study also provides internal ranking and comparison between indicators resulted from the revealed preference and stated preference study. It is also observed that Quality and Trust indices are well correlated and indicate a good model fit with the Overall Index. On the other hand, Usability Index is negatively correlated and shows very less model fit with the Overall Index.
KeywordsJournal quality Trustworthiness Usability Revealed preference study Stated preference study Agricultural science journals Indonesia
The work of A.Abrizah and Muzammil Tahira was funded by the Ministry of Higher Education Malaysia (HIR-MOHE) UM.C/HIR/MOHE/FCSIT/11.
- Abrizah, A., Badawi, F., Zoohorian-Fooladi, N., Nicholas, D., Jamali, H., & Norliya, A. K. (2015). Trust and authority in the periphery of world scholarly communication: A Malaysian focus group study. Malaysian Journal of Library & Information Science, 20(2), 67–83.Google Scholar
- Auburn University Libraries. (2012). Assessing journal quality. Retrieved from http://libguides.auburn.edu/content.php?pid=236566.
- Ezema, I. J., & Eze, A. B. (2012). Analysis of cited information sources in Nigerian agricultural research with emphasis on animal health and production. International Journal of Library and Information Science, 4(1), 1–9.Google Scholar
- Garfield, E. (1998). The diverse role of citation indexes in scientific research. Revista de Investigacion Clinica, 50(6), 497–504.Google Scholar
- Indonesian Agency for Agricultural Research and Development. (2009). Five years of agricultural research and development 2002–2006: Contribution to the national economy and farmers’ welfare. Jakarta: IAARD.Google Scholar
- International Standards Organization (ISO). (1994). Ergonomic requirement for office work with visual display terminals. Part 11: Guidance on usability (ISO DIS 9241-11). London: International Standards Organization.Google Scholar
- Kumar, S., & Kumar, S. (2011). Citation analysis of Journal of Oilseed Research. The 8th International CALIBER (pp. 511–527). Goa University: Goa, India. 2-4 March 2011.Google Scholar
- Lembaga Ilmu Pengetahuan Indonesia. (2012). Pedoman Akreditasi Majalah Ilmiah: Peraturan Kepala Lembaga Ilmu Pengetahuan Indonesia Nomor 04/E/2011. Jakarta: IAARD.Google Scholar
- Lokker, L., Haynes, R. B., Rong, C., McKibbon, K. A., Wilczynski, N. L., & Walter, S. D. (2012). How well are journal and clinical article characteristics associated with the journal impact factor? A retrospective cohort study. Journal of the Medical Library Association, 100(1), 28–33.CrossRefGoogle Scholar
- Nielsen, J. (2012). Usability 101: Introduction to usability. http://www.nngroup.com/articles/usability-101-introduction-to-usability/.
- Sari, R. F., & Kurniawan, A. (2010). Implementation of Indonesian electronic citation system based on web extraction techniques. In 3rd international conference on knowledge discovery and data mining (pp. 494–497), 9–10 January, Phuket, Thailand.Google Scholar
- Shahbodaghi, A., & Sajjadi, S. (2010). A scientometric investigation of the publication trends of Iranian medical informatics articles based on ISI Citation Databases. Journal of Paramedical Science., 1(4), 2–11.Google Scholar
- Sombatsompop, N., Chancheewa, S., Markpin, T., Premkamolnetr, N., Ittiritmeechai, S., Wongkaew, C., et al. (2012). Thai-journal Citation Index (TCI) Centre of Thailand: Experiences, lessons learned, and ongoing development. In Proceeding: international conference on journal citation systems in Asia Pacific countries (pp. 17–23), 22 May 2012, Pan Pacific KLIA, Malaysia. Malaysian Citation Centre, Putrajaya.Google Scholar
- Sutardji. (2011). Kajian Artikel Tanaman Pangan Pada Jurnal Penelitian Pertanian Tanaman Pangan. Jurnal Perpustakaan Pertanian, 20(1), 1–9.Google Scholar
- Tahai, A., & Meyer, M. J. (1999). A revealed preference study of management journals’ direct influence. Strategic Management Journal, 20(3):279–296.version]. Hydrobiologia, 653, 7–13.Google Scholar
- Thomson Reuters. (2012a). How to calculate a five-year impact factor. Retrieved from http://admin-apps.webofknowledge.com/JCR/help/h_fiveyr_if.htm#five_year_if.
- Thomson Reuters. (2012b). The Thomson Reuters impact factor. Retrieved from http://thomsonreuters.com/products_services/science/free/essays/impact_factor/.