{"id":355,"date":"2018-02-01T15:09:47","date_gmt":"2018-02-01T15:09:47","guid":{"rendered":"http:\/\/blogs.kent.ac.uk\/osc\/?p=355"},"modified":"2023-04-26T16:28:29","modified_gmt":"2023-04-26T15:28:29","slug":"the-time-has-come-the-osc-said-to-talk-of-metric-things","status":"publish","type":"post","link":"https:\/\/blogs.kent.ac.uk\/osc\/2018\/02\/01\/the-time-has-come-the-osc-said-to-talk-of-metric-things\/","title":{"rendered":"The time has come, the OSC said, to talk of metric things."},"content":{"rendered":"<p>Love them or loathe them, metrics are here&#8230; and like the fabled buses, come along in groups. Navigating the code language and acronym soup (<a href=\"http:\/\/jifactor.com\/\">JIF<\/a>? <a href=\"https:\/\/service.elsevier.com\/app\/answers\/detail\/a_id\/14884\/supporthub\/scopus\/\">SNIP<\/a>? <a href=\"https:\/\/www.doi.org\/\">DOI<\/a>? <a href=\"http:\/\/www.scimagojr.com\/journalrank.php\">SJR<\/a>?) can be off putting at best. How can we engage with them, to get the best use from metrics and use them appropriately?<\/p>\n<h3>\u201cResponsible Metrics\u201d?<\/h3>\n<p>Bibliometric indicators can be a helpful tool in monitoring dissemination and engagement with a research output, but we must also recognise their limitations, particularly in certain discipline areas.<\/p>\n<p>Responsible metrics have be defined by the <a href=\"http:\/\/www.universitiesuk.ac.uk\/policy-and-analysis\/Pages\/forum-for-responsible-research-metrics.aspx\">Forum for Responsible Research Metrics<\/a> as the following key principles:<\/p>\n<ul>\n<li>Robustness \u2013 basing metrics on the best possible data in terms of accuracy and scope<\/li>\n<li>Humility \u2013 recognising that quantitative evaluation should support, but not supplant, qualitative, expert assessment<\/li>\n<li>Transparency \u2013that those being evaluated can test and verify the results<\/li>\n<li>Diversity \u2013 accounting for variation by research field, and using a range of indicators to reflect and support a plurality of research and researcher career paths across the system<\/li>\n<li>Reflexivity \u2013 recognising and anticipating the systemic and potential effects of indicators, and updating them in response<\/li>\n<\/ul>\n<p>There are also principles\/frameworks outlined in the <a href=\"http:\/\/www.ascb.org\/dora\/\">San Francisco Declaration on Research Assessment (DORA),<\/a> the <a href=\"http:\/\/www.leidenmanifesto.org\/\">Leiden Manifesto<\/a> and <a href=\"http:\/\/www.hefce.ac.uk\/pubs\/rereports\/year\/2015\/metrictide\/\">The Metric Tide<\/a>, and some institutions (such as <a href=\"http:\/\/www.lboro.ac.uk\/research\/scholcomms\/assessment\/respmetrics\/\">Loughborough<\/a>) have developed their own statement<\/p>\n<h3><a href=\"https:\/\/www.kent.ac.uk\/library\/research\/impact\/works.html\">Recognise the limitations of metrics<\/a><\/h3>\n<ul>\n<li>Be careful with comparing across different disciplines because they have different publishing practices. Not all subjects publish research in journal articles, so citation counts and impact factors are less relevant. For example:\n<ul>\n<li>in Computer Science and Economics\u00a0some research is made available as conference papers<\/li>\n<li>in History and English\u00a0much research is published in books<\/li>\n<li>in the Social Sciences research is sometimes made available via discussion papers and report.<\/li>\n<\/ul>\n<\/li>\n<li>Bibliometrics are only as good as the databases they use \u2013 no database is complete or 100% accurate \u2013 providers make judgements when deciding what to include in their datasets.<\/li>\n<li>Don&#8217;t assume that the very best articles only appear in the high impact journals. High ranking journals contain low performing articles and vice versa.<\/li>\n<\/ul>\n<p>You can neutralise the worst of these limitations by:<\/p>\n<ul>\n<li>Presenting quantitative data in context \u2013 a \u20183\u2019 on its own is meaningless \u2013 a 3 in a field of 100 20\u2019s is a vastly different thing to a 3 in a field of 100 0.1\u2019s. By providing context, and, where possible, appropriately normalised scores, you can get a better picture of what the number reflects.<\/li>\n<li>Comparing like to like \u2013 this can be challenging with so many variables (publication year, career stage, language, discipline) but being open about the parameters you use gives a more accurate reflection of the bigger picture.<\/li>\n<li>Using a mixture of metrics and qualitative evidence \u2013 metrics are by no means yet at the stage where they can replace peer review or analysis of an output. Using the two in conjunction presents an accurate picture of your work.<\/li>\n<\/ul>\n<h3>Help is at hand!<\/h3>\n<p>Those of you who follow my twitter feed will have noticed that on Tuesday I was at the \u201cResponsible use of Bibliometrics in Practice\u201d event, and the next day, the very fabulous <a href=\"http:\/\/www.metrics-toolkit.org\/\">Metrics Toolkit<\/a>was launched. This is a brilliant resource (all available CC-BY). In their own words:<\/p>\n<blockquote><p>We developed the Metrics Toolkit to help scholars and evaluators understand and use citations, web metrics, and altmetrics responsibly in the evaluation of research.<\/p>\n<p>The Metrics Toolkit provides evidence-based information about research metrics across disciplines, including how each metric is calculated, where you can find it, and how each should (and should not) be applied. You\u2019ll also find examples of how to use metrics in grant applications, CVs, and promotion dossiers. (<a href=\"http:\/\/www.metrics-toolkit.org\/about\/\">http:\/\/www.metrics-toolkit.org\/about\/<\/a>)<\/p><\/blockquote>\n<p>The toolkit provides easy to access information on a very wide range of possible metrics, with the option of filtering these to discipline and output type.<\/p>\n<h3>At Kent?<\/h3>\n<p>For Researchers at Kent, we also have lots of information on \u2018<a href=\"https:\/\/www.kent.ac.uk\/library\/research\/impact\/index.html\">Impact and Sharing\u2019 <\/a>which includes introductions to the systems we use at Kent, ways of increasing <a href=\"https:\/\/www.kent.ac.uk\/library\/research\/impact\/you.html\">your dissemination and academic impact<\/a>. You might want to spend some time checking and <a href=\"http:\/\/blogs.kent.ac.uk\/isnews\/tidying-up-your-author-profile\/\">tidying your author profile<\/a> to make sure you are getting the most out of your citations, and if you would like to know more, please <a href=\"mailto:osc@kent.ac.uk\">get in touch<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Love them or loathe them, metrics are here&#8230; and like the fabled buses, come along in groups. Navigating the code language and acronym soup (JIF? &hellip; <a href=\"https:\/\/blogs.kent.ac.uk\/osc\/2018\/02\/01\/the-time-has-come-the-osc-said-to-talk-of-metric-things\/\">Read&nbsp;more<\/a><\/p>\n","protected":false},"author":211,"featured_media":358,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[99376,278468],"tags":[],"_links":{"self":[{"href":"https:\/\/blogs.kent.ac.uk\/osc\/wp-json\/wp\/v2\/posts\/355"}],"collection":[{"href":"https:\/\/blogs.kent.ac.uk\/osc\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.kent.ac.uk\/osc\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.kent.ac.uk\/osc\/wp-json\/wp\/v2\/users\/211"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.kent.ac.uk\/osc\/wp-json\/wp\/v2\/comments?post=355"}],"version-history":[{"count":6,"href":"https:\/\/blogs.kent.ac.uk\/osc\/wp-json\/wp\/v2\/posts\/355\/revisions"}],"predecessor-version":[{"id":366,"href":"https:\/\/blogs.kent.ac.uk\/osc\/wp-json\/wp\/v2\/posts\/355\/revisions\/366"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.kent.ac.uk\/osc\/wp-json\/wp\/v2\/media\/358"}],"wp:attachment":[{"href":"https:\/\/blogs.kent.ac.uk\/osc\/wp-json\/wp\/v2\/media?parent=355"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.kent.ac.uk\/osc\/wp-json\/wp\/v2\/categories?post=355"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.kent.ac.uk\/osc\/wp-json\/wp\/v2\/tags?post=355"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}