شاخص های نوین برای سنجش تأثیر اجتماعی انتشارات علمی : مروری بر مزایا و کاستی ها

نوع مقاله: مقاله ترویجی

نویسنده

. عضو هیئت علمی پژوهشگاه علوم و فناوری اطلاعات ایران (ایرانداک)

چکیده

امروزه چگونگی سنجش تأثیر اجتماعی پژوهش در مقایسه با تأثیر علمی آن، چندان روشن نیست. هرچند بررسی های
دقیق و کتاب سنجی ها روشهای استانداردی برای سنجش تأثیر علمی به شمار می روند، لیکن هنوز ساختار قابل
قبولی برای سنجش تأثیر اجتماعی وجود ندارد. سنجه های جایگزین (آلتمتریکس) گزینه های مناسبی برای سنجش
تأثیر اجتماعی پژوهش محسوب می شوند. آلتمتریکس سنجه های مبتنی بر وب را برای تأثیر مقالات و سایر مدارک
علمی با استفاده از داده های رسانه های اجتماعی (همچون توییتر یا مندلی) توصیف می کند.
با این دیدگاه هدف از انجام این مطالعه بررسی توانایی های آلتمتریکس در سنجش تأثیر اجتماعی است. برای
پاسخگویی به این سوال پژوهش که "آلتمتریکس" تا چه حد می تواند برخلاف معیارهای سنتی، تأثیر گسترده تر
پژوهش را اندازه گیری کند؟ با استفاده از روش توصیفی، تعاریف و رده بندی "آلتمتریکس" و نیز مزایا و کاستی های آن
برای سنجش تأثیر، مورد بررسی قرار گرفت. نتایج حاصل نشان داد که در حقیقت سنجه های جایگزین (آلتمتریکس)
می توانند به عنوان مکملی در کنار شاخص های علم سنجی برای بررسی عملکرد پژوهش و اثرگذاری تولیدات علمی
مورد استفاده قرار گیرند.

کلیدواژه‌ها


Adie, E. (2014). The grey literature from an altmetrics perspective - opportunity
and challenges. Research Trends(37), 23-25.
Adie, E., & Roe, W. (2013). Altmetric: enriching scholarly content with article-
level discussion and metrics. Learned Publishing, 26(1), 11-17. doi:
10.1087/20130103.
Bornmann, L. (2011). Scientific peer review. Annual Review of Information
Science and Technology, 45, 199-245.
Bornmann, L. (2012). Measuring the societal impact of research. EMBO Reports,
13(8), 673-676.
Bornmann, L. (2013). What is societal impact of research and how can it be
assessed? A literature survey. Journal of the American Society of Information
Science and Technology, 64(2), 217-233.
Bornmann, L., Leydesdorff, L., & Mutz, R. (2013). The use of percentiles and
percentile rank classes in the analysis of bibliometric data: opportunities and
limits. Journal of Informetrics, 7(1), 158-165.
Bornmann, L., & Williams, R. (2013). How to calculate the practical significance
of citation impact differences? An empirical example from evaluative
institutional bibliometrics using adjusted predictions and marginal effects.
Journal of Informetrics, 7(2), 562-574. doi: 10.1016/j.joi.2013.02.005.
Chamberlain, S. (2013). Consuming article-level metrics: observations and
lessons. Information Standards Quarterly, 25(2), 4-13.
Darling, E. S., Shiffman, D., Côté, I. M., & Drew, J. A. (2013). The role
of Twitter in the life cycle of a scientific publication. PeerJ PrePrints, 1,
e16v11. doi: 10.7287/peerj.preprints.16v1.
Delgado López-Cózar, E., Robinson-García, N., & Torres-Salinas, D. (2014).
The Google scholar experiment: How to index false papers and manipulate
bibliometric indicators .Journal of the Association for Information Science
and Technology, 65(3), 446-454. doi: 10.1002/asi.23056.
Eysenbach, G. (2011). Can tweets predict citations? Metrics of social impact
based on Twitter and correlation with traditional metrics of scientific impact.
J Med Internet Res, 13(4), e123.
Fausto, S., Machado, F. A., Bento, L. F. J., Iamarino, A., Nahas, T. R., &Munger, D. S. (2012). Research Blogging: Indexing and Registering the
Change in Science 2.0. PLoS ONE, 7(12), e50109. doi: 10.1371/journal.
pone.0050109.
Fenner, M. (2013a). Letter from the guest content editor: altmetrics have come
of age. Information Standards Quarterly, 25(2), 3.
Fenner, M. (2013b). What Can Article-Level Metrics Do for You? PLoS Biol,
11(10), e1001687. doi: 10.1371/journal.pbio.1001687.
Frank, C., & Nason, E. (2009). Health research: measuring the social, health
and economic benefits. Canadian Medical Association Journal, 180(5),
528-534. doi: Doi 10.1503/Cmaj.090016.
Galloway, L. M., Pease, J. L., & Rauh, A. E. (2013). Introduction to Altmetrics
for Science, Technology, Engineering, and Mathematics (STEM)
Librarians. Science & Technology Libraries, 32(4), 335-345. doi:
10.1080/0194262X.2013.829762.
Greenhow, C., & Gleason, B. (2014). Social scholarship: Reconsidering
scholarly practices in the age of social media. British Journal of Educational
Technology, 45(3), 392-402. doi: 10.1111/bjet.12150.
Gunn, W. (2013). Social Signals Reflect Academic Impact: What it Means
When a Scholar Adds a Paper to Mendeley. Information Standards Quarterly,
25(2), 33-39.
Hammarfelt, B. (2014). Using altmetrics for assessing research impact in the
humanities. Scientometrics, 1-12. doi: 10.1007/s11192-014-1261-3.
Haustein, S. (2014). Readership metrics. In B. Cronin & C. R. Sugimoto
(Eds.), Beyond bibliometrics: harnessing multi-dimensional indicators of
performance (pp. 327-344). Cambridge, MA, USA: MIT Press.
Haustein, S., Peters, I., Bar-Ilan, J., Priem, J., Shema, H., & Terliesner, J.
(2014). Coverage and adoption of altmetrics sources in the bibliometric
community. Scientometrics, 1-19. doi: 10.1007/s11192-013-1221-3.
Haustein, S., Peters, I., Sugimoto, C. R., Thelwall, M., & Larivière, V. (2014).
Tweeting biomedicine: An analysis of tweets and citations in the biomedical
literature. Journal of the Association for Information Science and Technology,
65(4), 656-669. doi: 10.1002/asi.23101.
Holmberg, K., & Thelwall, M. (2014). Disciplinary differences in Twitter
scholarly communication. Scientometrics, 1-16. doi: 10.1007/s11192-014-
1229-3.
72
سال هفتم • شماره نهم • پاییز و زمستان 1394
Kousha, K., & Thelwall, M. (2007). Google Scholar citations and Google
Web/URL citations: a multi-discipline exploratory analysis. Journal of the
American Society for Information Science and Technology, 58(7), 1055-
1065.
Kurtz, M. J., & Bollen, J. (2010). Usage Bibliometrics. Annual Review of Information
Science and Technology, 44, 3-64.
Li, X., Thelwall, M., & Giustini, D. (2012). Validating online reference managers
for scholarly impact measurement. Scientometrics, 91(2), 461-471.
doi: 10.1007/s11192-011-0580-x.
Lin, J., & Fenner, M. (2013). Altmetrics in Evolution: Defining and Redefining
the Ontology of Article-Level Metrics”,, Vol. 25, No. 2, pp. 20, Available
at: 10.3789/isqv25no2.2013.04. Information Standards Quarterly,
25(2), 20-26.
Liu, J., & Adie, E. (2013). Five challenges in altmetrics: A toolmaker’s perspective.
Bulletin of the American Society for Information Science and Technology,
39(4), 31-34. doi: 10.1002/bult.2013.1720390410.
Mohammadi, E., & Thelwall, M. (2014). Mendeley readership altmetrics for
the social sciences and humanities: Research evaluation and knowledge
flows. Journal of the Association for Information Science and Technology,
n/a-n/a. doi: 10.1002/asi.23071.
Neylon, C., Willmers, M., & King, T. (2014). Rethinking Impact: Applying
Altmetrics to Southern African Research. Ottawa, Canada: International Development
Research Centre.
Neylon, C., & Wu, S. (2009). Article-level metrics and the evolution of
scientific impact. Plos Biology, 7(11). doi: e100024210.1371/journal.
pbio.1000242.
Peters, I., Beutelspacher, L., Maghferat, P., & Terliesner, J. (2012). Scientific
bloggers under the altmetric microscope. Proceedings of the American
Society for Information Science and Technology, 49(1), 1-4. doi: 10.1002/
meet.14504901305.
Piwowar, H. (2013). Altmetrics: Value all research products. Nature,
493(7431), 159-159.
Piwowar, H., & Priem, J. (2013). The power of altmetrics on a CV. Bulletin of
the American Society for Information Science and Technology, 39(4), 10-13.
doi: 10.1002/bult.2013.1720390405.
Priem, J. (2014). Altmetrics. In B. Cronin & C. R. Sugimoto (Eds.), Beyond
bibliometrics: harnessing multi-dimensional indicators of performance.
Cambridge, MA, USA: MIT Press.
Priem, J., & Hemminger, B. M. (2010). Scientometrics 2.0: toward new metrics
of scholarly impact on the social Web. First Monday, 15(7)
Priem, J., Piwowar, H., & Hemminger, B. (2012). Altmetrics in the wild: Using
social media to explore scholarly impact. Retrieved March 27, from
http://arxiv.org/html/1203.4745.
Rodgers, E. P., & Barbrow, S. (2013). A look at altmetrics and its growing
significance to research libraries. Ann Arbor, MI, USA: The University of
Michigan University Library.
Roemer, R. C., & Borchardt, R. (2013). Institutional altmetrics & academic
libraries. Information Standards Quarterly, 25(2), 14-19.
Rousseau, R., & Ye, F. Y. (2013). A multi-metric approach for research evaluation.
Chinese Science Bulletin, 58. doi: 10.1007/s11434-013-5939-3.
Shema, H., Bar-Ilan, J., & Thelwall, M. (2014). Do blog citations correlate
with a higher number of future citations? Research blogs as a potential
source for alternative metrics. Journal of the Association for Information
Science and Technology, 65(5), 1018-1027. doi: 10.1002/asi.23037.
Sud, P., & Thelwall, M. (2014). Evaluating altmetrics. Scientometrics, 98(2),
1131-1143. doi: 10.1007/s11192-013-1117-2.
Taylor, M. (2013a). Exploring the boundaries: how altmetrics can expand our
vision of scholarly communication and social impact. Information Standards
Quarterly, 25(2), 27-32.
Taylor, M. (2013b). Towards a common model of citation: some thoughts on
merging altmetrics and bibliometrics. Research Trends(35), 19-22.
Thelwall, M. (2014). A brief history of altmetrics. Research Trends.(37), 3-4.
Thelwall, M., Haustein, S., Lariviere, V., & Sugimoto, C. R. (2013). Do Altmetrics
Work? Twitter and Ten Other Social Web Services. Plos One, 8(5).
doi: 10.1371/journal.pone.0064841.
Torres-Salinas, D., Cabezas-Clavijo, A., & Jimenez-Contreras, E. (2013). Altmetrics:
new indicators for scientific communication in Web 2.0. Comunicar,
41, 53-60.
Vaughan, L., & Shaw, D. (2005). Web citation data for impact assessment: Acomparison of four science disciplines. Journal of the American Society for
Information Science and Technology, 56(10), 1075-1087. doi: Doi 10.1002/
Asi.20199.
Vaughan, L., & Shaw, D. (2008). A new look at evidence of scholarly citation
in citation indexes and from web sources. Scientometrics, 74(2), 317-330.
doi: DOI 10.1007/s11192-008-0220-2.
Vinkler, P. (2010). The evaluation of research by scientometric indicators.
Oxford, UK: Chandos Publishing.
Waltman, L., & Costas, R. (2014). F1000 Recommendations as a Potential
New Data Source for Research Evaluation: A Comparison With Citations.
Journal of the Association for Information Science and Technology, 65(3),
433-445. doi: 10.1002/asi.23040.
Weller, K., Dröge, E., & Puschmann, C. (2011). Citation analysis in Twitter:
approaches for defining and measuring information flows within Tweets
during scientific conferences. In M. Rowe, M. Stankovic, A.-S. Dadzie &
M. Hardey (Eds.), Making Sense of Microposts (MSM2011) (pp. 1-12).
Heraklion, Crete: CEUR workshop proceedings.
Weller, K., & Peters, I. (2012). Citations in Web 2.0. In A. Tokar, M. Beurskens,
S. Keuneke, M. Mahrt, I. Peters, C. Puschmann, T. van Treeck &
K. Weller (Eds.), Science and the Internet (pp. 209-222). Düsseldorf. Germany:
Düsseldorf University Press.
Wouters, P., & Costas, R. (2012). Users, narcissism and control – tracking the
impact of scholarly publications in the 21st century. Utrecht, The Netherlands:
SURFfoundation.
Zahedi, Z., Costas, R., & Wouters, P. (2014). How well developed are altmetrics?
A cross-disciplinary analysis of the presence of ‘alternative metrics’
in scientific publications. Scientometrics, 1-23. doi: 10.1007/s11192-014-
1264-0.