Webometrics ranking of web resources of Russian research institutes Designed by Irina Kosinets Scientometrics is the science of measuring and analyzing science. The main goals: to give an objective picture and perspectives of scientific trends; to estimate their applicability. Webometrics is one of new approaches to ranking. International ranking SCImago (www.scimagoir.com ) QS-THES (www.topuniversities.com ) ARWU (www.arwu.org ) Cybermetrics Lab (research.webometrics.info) Goals of ranking The objective is not to evaluate websites, their design or usability or the popularity of their contents according to the number of visits or visitors. Web indicators are considered as proxies in the correct, comprehensive, deep evaluation of the university global performance, taking into account its activities and outputs and their relevance and impact. http://www.webometrics.info/en/Methodology These goals are reasonable not only for universities but for research centers too. Russian Research Centers need their own ranking web and we are creating it. Why did we decide to create our own system for ranking? In our opinion, Cybermetrics Lab uses techniques for obtaining values of indicators which are not suitable for the ranking Web (Webometrics) of Russian research centers. What is not suitable for Russian Research centers? Remark 1. Investigations of Cybermetrics Lab are based on Google and other searching systems (search engines) which are widely used in Europe, the USA. The most popular searching system in Russia is Yandex. It is not taken into account by Cybermetrics Lab. Remark 2. Selection of units for evaluation According to Cybermetrics Lab methodology the domain names of official research centers sites are the units for assessment. This approach is frequently not suitable for the investigation of the Russian academic web space and the sites of research centers. In fact, the rules for choosing domain names in Russia and other countries are different. Remark 3. Ranking criterion The validity of such ranking criterion used by Cybermetrics Lab as weighting of webindicators is not obvious for us. Weighting of Indicators INDICATOR MEANING COVERAGE SOURCE WEIGHT IMPACT Number of back links Number of back domains Current 50% (Historical) Majestic SEO ahrefs PRESENCE Number of webpages(all) Current Google 20% OPENNESS Number of papers(pdf, doc, docx, ppt) 2007-2011 Google Scholar 15% EXCELLENCE Number of papers in the 10% top cited 2003-2010 Scimago 15% http://webometrics.info/en/Methodology Web ranking of Russian research centers The project is supported by Russian Foundation for Humanities. Carried out by IAMR of the Karelian Research Centre of the RAS with collaboration of the Petrozavodsk university. Scientific advisor – Pechnikov Andrey Main goal – creation of information system for Web ranking of Russian Research Centers. Site - http://webometrics-net.ru/ Methodology: 1. 2. 3. 4. 5. to create the target set of sites of Russian research centers; to form a set of units for analysis; to retrieve data from web sites which belong to the target set using Web scraping (web harvesting or web data extraction) - a computer software technique of extracting information from websites; to collect and evaluate web-indicators; to create the Ranking Web of Russian research centers. Definitions An initial set is a set of official sites which belong to Russian Research Centers. A target set is a set of investigated sites, identified by unique domain names, given by a direct enumeration. Group Total rank rank Russian Academy of sciences Research Center Indicators size SY visibility SG VY rich files VG RY RG RSc 1 2 Siberian Branch 2 4 2 2 5 13 11 2 5 Ural Branch 3 9 17 9 2 9 23 3 23 Far Eastern Branch 20 37 30 14 17 31 32 Indexes Y – Yandex G – Google Sc - Scholar More detailes Reliable ranking is only possible if the web presence is a real mirror of a research center. Project site http://webometrics-net.ru/ Questions and notes are welcome Pechnikov Andrey – Leading Research Associate in the Laboratory for Telecommunications Systems Institute of Applied Mathematical Research pechnikov@krc.karelia.ru Kosinets Irina – senior teacher in the Department of Software (Petrozavodsk University) ikos@psu.karelia.ru Thank you for attention!