New evaluation indexes for articles and authors’ academic achievements based on Open Access Resources
In Open Access (OA) environment where article-based or author-based evaluation is important, a new evaluation system is needed to accommodate characteristics of Open Access Resources (OAR) and to overcome limitations of pre-existing evaluation systems such as journal-based evaluation.
Primary and secondary evaluation factors were selected. Primary factors include hits and citations that constitutes composite index. Several secondary factors each for article and author evaluation were selected for normalization of the indexes.
To validate superiority of newly developed normalized composite index systems compared to the monovariable index system, time-driven bias and power of discrimination were adopted.
The results led to the conclusion that composite index proved to be a more stable index offsetting the negative effects from one element to another and normalization makes the composite index even more stable by controlling the bias from external elements.
Unable to display preview. Download preview PDF.
- Antelman, K. (2004), Do open access articles have a greater research impact? College & Research Libraries, 65 (5): 372–382.Google Scholar
- Brody, T., Stamerjohanns, H., Harnad, S., Gingras, Y., Vallieres, F., Oppenheim, C. (2004), The effect of Open Access on Citation Impact. Presented at: National Policies on Open Access (OA) Provision for University Research Output: an International meeting. Southampton University, Southampton UK. 19 February 2004. Retrieved May 17, 2005, from http://www.ecs.soton.ac.uk/%7Eharnad/Temp/OA-TAadvantage.pdf
- Brody, T., Harnad, S. (2005), Earlier Web Usage Statistics as Predictors of Later Citation Impact, DOI: cs.IR/0503020, arXiv.Google Scholar
- Darmoni, S. J. (2002), Reading factor: a new bibliometric criterion for managing digital libraries, J Med Libr Assoc, 90 (3): 323–327.Google Scholar
- Harnad, S., Brody, T. (2004), Comparing the impact of Open Access(OA) vs. non-OA articles in the same journals, D-Lib Magazine [serial on the Internet] 10 (6). Retrieved May 30, 2005, from http://www.dlib.org/dlib/june04/harnad/06harnad.html
- Hitchcock, S., Bergmark, D., Brody, T., Gutteridge, C., Carr, L., Hall, W., Lagoze, C., Harnad S. (2002), Open Citation linking: the way forward, D-Lib Magazine [serial on the Internet] 8 (10). Retrieved April 15, 2005, from http://www.dlib.org/dlib/october02/hitchcock/10hitchcock.html
- Institute of Higher Education. (2004), Ranking methodology. In: Academic Ranking of World Universities. Retrieved April 30, 2005, from http://ed.sjtu.edu.cn/rank/2004/Methodology.htm
- ISI (2004), The Impact of Open Access Journals: A Citation Study from Thomson ISI. Retrieved April 10, 2005, from http://www.isinet.com/media/presentrep/acropdf/impact-oa-journals.pdf
- Seglen, P. O. (1997), Why the impact factor of journals should not be used for evaluating research, BMJ, 314 (7079): 497. Retrieved May 10, 2005, from http://bmj.bmjjournals.com/cgi/content/full/314/7079/497 Google Scholar