O'Really?

June 29, 2012

Impact Factor Boxing 2012

Rocky Balboa  Philadelphia, PA

Rocky Balboa, Philadelphia, PA. Creative Commons licensed picture by seng1011 (steve eng) on Flickr.

[This post is part of an ongoing series about impact factors]

In the world of abused performance metrics, the impact factor is the undisputed heavyweight champion of the (publishing) world.

It has been an eventful year in the boxing ring of scientific publishing since the last set of figures were published by Thomson-Reuters. A brand new journal called PeerJ launched with a radical publish ’til you perish business model [1]. There’s another new journal on the way too in the shape of eLifeSciences – with it’s own significant differences from current publishing models. Then there was the Finch report on Open Access. If that wasn’t enough fun, there’s been the Alternative metrics “Altmetrics” movement gathering pace [2], alongside suggestions that the impact factor may be losing its grip on the supposed “title” [3].

The impact factors below are the most recent, published June 28th 2012, covering data from 2011. Love them or loathe them, use them or abuse them, game them or shame them … here is a tiny selection of impact factors for the 10,675 journals that are tracked in Journal Citation Reports (JCR) ordered by increasing punch power.

WARNING: Abusing these figures can seriously damage your Science – you have been warned! Normal caveats apply, see nature.com/metrics.

Journal 2011 data from isiknowledge.com/JCR Eigenfactor™ Metrics
Total Cites Impact Factor 5-Year Impact Factor Immediacy Index Articles Cited Half-life Eigenfactor™ Score Article Influence™ Score
Russian Journal of Cardiology* 3 0.005 0.000 75 0.00000
BMC Bioinformatics 14268 2.751 3.493 0.293 557 4.2 0.07757 1.314
PLoS ONE 75544 4.092 4.537 0.437 13781 2.4 0.50216 1.797
Briefings in Bioinformatics 2859 5.202 7.749 0.692 65 4.3 0.01129 2.857
PLoS Computational Biology 8924 5.215 5.844 0.710 407 3.1 0.06968 2.722
OUP Bioinformatics 43380 5.468 6.051 0.666 707 6.2 0.15922 2.606
Nucleic Acids Research 106520 8.026 7.417 2.016 1230 7.4 0.30497 3.003
Genome Biology 15556 9.036 7.896 1.550 151 5.2 0.08221 4.124
PLoS Biology 20579 11.452 13.630 2.461 180 4.6 0.14975 7.830
Science 480836 31.201 32.452 6.075 871 9.4 1.41282 17.508
Nature 526505 36.280 36.235 9.690 841 9.4 1.65658 20.353
New England Journal of Medicine 232068 53.298 50.075 11.484 349 7.8 0.66466 21.293
CA – A Cancer Journal for Clinicians** 10976 101.780 67.410 21.263 19 3.8 0.04502 24.502

* The Russian Journal of Cardiology is included here for reference as it has the lowest non-zero impact factor of any science journal. A rather dubious honour…

** The Cancer Journal for Clinicians is the highest ranked journal in science, it is included here for reference. Could it be the first journal to have an impact factor of more than 100?

References

  1. Richard Van Noorden (2012). Journal offers flat fee for ‘all you can publish’, Nature, 486 (7402) 166. DOI: 10.1038/486166a
  2. Jason Priem, Heather Piwowar and Bradley Hemminger (2012).  Altmetrics in the wild: Using social media to explore scholarly impact arxiv.org/abs/1203.4745
  3. George Lozano, Vincent Lariviere and Yves Gingras (2012). The weakening relationship between the Impact Factor and papers’ citations in the digital age arxiv.org/abs/1205.4328

May 11, 2012

Journal Fire: Bonfire of the Vanity Journals?

Fire by John Curley on Flickr

Fire by John Curley, available via Creative Commons license.

When I first heard about Journal Fire, I thought, Great! someone is going to take all the closed-access scientific journals and make a big bonfire of them! At the top of this bonfire would be the burning effigy of a wicker man, representing the very worst of the vanity journals [1,2].

Unfortunately Journal Fire aren’t burning anything just yet, but what they are doing is something just as interesting. Their web based application allows you to manage and share your journal club online. I thought I’d give it a whirl because a friend of mine asked me what I thought about a paper on ontologies in biodiversity [3]. Rather than post a brief review here, I’ve posted it over at Journal Fire. Here’s some initial thoughts on a quick test drive of their application:

Pros

On the up side Journal Fire:

  • Is a neutral-ish third party space where anyone can discuss scientific papers.
  • Understands common identifiers (DOI and PMID) to tackle the identity crisis.
  • Allows you to post simple anchor links in reviews, but not much else, see below.
  • Does not require you to use cumbersome syntax used in ResearchBlogging [4], ScienceSeeker and elsewhere
  • Is integrated with citeulike, for those that use it
  • It can potentially provide many different reviews of a given paper in one place
  • Is web-based, so you don’t have to download and install any software, unlike alternative desktop systems Mendeley and Utopia docs

Cons

On the down side Journal Fire:

  • Is yet another piece social software for scientists. Do we really need more, when we’ve had far too many already?
  • Requires you to sign up for an account without  re-using your existing digital identity with Google, Facebook, Twitter etc.
  • Does not seem to have many people on it (yet) despite the fact it has been going since at least since 2007.
  • Looks a bit stale, the last blog post was published in 2010. Although the software still works fine, it is not clear if it is being actively maintained and developed.
  • Does not allow much formatting in reviews besides simple links, something like markdown would be good.
  • Does not understand or import arXiv identifiers, at the moment.
  • As far as I can see, Journal Fire is a small startup based in Pasadena, California. Like all startups, they might go bust. If this happens, they’ll take your journal club, and all its reviews down with them.

I think the pros mostly outweigh the cons, so if you like the idea of a third-party hosting your journal club, Journal Fire is worth a trial run.

References

  1. Juan Carlos Lopez (2009) We want your paper! The similarity between high-end restaurants and scientific journals Spoonful of Medicine, a blog from Nature Medicine
  2. NOTE: Vanity journals should not to be confused with the The Vanity Press.
  3. Andrew R. Deans, Matthew J. Yoder & James P. Balhoff (2012). Time to change how we describe biodiversity, Trends in Ecology & Evolution, 27 (2) 84. DOI: 10.1016/j.tree.2011.11.007
  4. Shema, H., Bar-Ilan, J., & Thelwall, M. (2012). Research Blogs and the Discussion of Scholarly Information PLoS ONE, 7 (5) DOI: 10.1371/journal.pone.0035869

June 2, 2009

Michael Ley on Digital Bibliographies

Michael Ley

Michael Ley is visiting Manchester this week, he will be doing a seminar on Wednesday 3rd June, here are some details for anyone who is interested in attending:

Date: 3rd Jun 2009

Title: DBLP: How the data get in

Speaker: Dr Michael Ley. University of Trier, Germany

Time & Location: 14:15, Lecture Theatre 1.4, Kilburn Building

Abstract: The DBLP (Digital Bibliography & Library Project) Computer Science Bibliography now includes more than 1.2 million bibliographic records. For Computer Science researchers the DBLP web site now is a popular tool to trace the work of colleagues and to retrieve bibliographic details when composing the lists of references for new papers. Ranking and profiling of persons, institutions, journals, or conferences is another usage of DBLP. Many scientists are aware of this and want their publications being listed as complete as possible.

The talk focuses on the data acquisition workflow for DBLP. To get ‘clean’ basic bibliographic information for scientific publications remains a chaotic puzzle.

Large publishers are either not interested to cooperate with open services like DBLP, or their policy is very inconsistent. In most cases they are not able or not willing to deliver basic data required for DBLP in a direct way, but they encourage us to crawl their Web sites. This indirection has two main problems:

  1. The organisation and appearance of Web sites changes from time to time, this forces a reimplementation of information extraction scripts. [1]
  2. In many cases manual steps are necessary to get ‘complete’ bibliographic information.

For many small information sources it is not worthwhile to develop information extraction scripts. Data acquisition is done manually. There is an amazing variety of small but interesting journals, conferences and workshops in Computer Science which are not under the umbrella of ACM, IEEE, Springer, Elsevier etc. How they get it often is decided very pragmatically.

The goal of the talk and my visit to Manchester is to start a discussion process: The EasyChair conference management system developed by Andrei Voronkov and DBLP are parts of scientific publication workflow. They should be connected for mutual benefit?

References

  1. Lincoln Stein (2002). Creating a bioinformatics nation: screen scraping is torture Nature, 417 (6885), 119-120 DOI: 10.1038/417119a

October 31, 2008

Defrosting the Digital Library

Bibliographic Tools for the Next Generation Web

Sunset Ice Sculptures by Mark K.We started writing this paper [1] over a year ago, so it’s great to see it finally published today. Here is the abstract:

“Many scientists now manage the bulk of their bibliographic information electronically, thereby organizing their publications and citation material from digital libraries. However, a library has been described as “thought in cold storage,” and unfortunately many digital libraries can be cold, impersonal, isolated, and inaccessible places. In this Review, we discuss the current chilly state of digital libraries for the computational biologist, including PubMed, IEEE Xplore, the ACM digital library, ISI Web of Knowledge, Scopus, Citeseer, arXiv, DBLP, and Google Scholar. We illustrate the current process of using these libraries with a typical workflow, and highlight problems with managing data and metadata using URIs. We then examine a range of new applications such as Zotero, Mendeley, Mekentosj Papers, MyNCBI, CiteULike, Connotea, and HubMed that exploit the Web to make these digital libraries more personal, sociable, integrated, and accessible places. We conclude with how these applications may begin to help achieve a digital defrost, and discuss some of the issues that will help or hinder this in terms of making libraries on the Web warmer places in the future, becoming resources that are considerably more useful to both humans and machines.”

Biotechnology and Biological Sciences Research CouncilThanks to Kevin Emamy, Richard Cameron, Martin Flack, and Ian Mulvany for answering questions on the CiteULike and Connotea mailing lists; and Greg Tyrelle for ongoing discussion about metadata and the semantic Web nodalpoint.org. Also thanks to Timo Hannay and Tim O’Reilly for an invitation to scifoo, where some of the issues described in this publication were discussed. Last but not least, thanks to Douglas Kell and Steve Pettifer for helping me write it and the BBSRC for funding it (grant code BB/E004431/1 REFINE project). We hope it is a useful review, and that you enjoy reading it as much as we enjoyed writing it.

References

  1. Duncan Hull, Steve Pettifer and Douglas B. Kell (2008). Defrosting the digital library: Bibliographic tools for the next generation web. PLoS Computational Biology, 4(10):e1000204+. DOI:10.1371/journal.pcbi.1000204, pmid:18974831, pmcid:2568856, citeulike:3467077
  2. Also mentioned (in no particular order) by NCESS, Wowter, Twine, Stephen Abram, Rod Page, Digital Koans, Twitter, Bora Zivkovic, Digg, reddit, Library Intelligencer, OpenHelix, Delicious, friendfeed, Dr. Shock, GribbleLab, Nature Blogs, Ben Good, Rafael Sidi, Scholarship 2.0, Subio, up2date, SecondBrain, Hubmed, BusinessExchange, CiteGeist, Connotea and Google

[Sunrise Ice Sculptures picture from Mark K.]

August 22, 2008

If Science was an Olympic Sport…

Olympic Rings by JL08A fictional scene from the future: The Olympic games, London 2012. A new candidate sport is on trial, joining skateboarding, rugby and golf at their debut Olympic games. It is challenging discipline called Science, a sport more ancient than Olympia itself. The crowd awaits eagerly in the all new Boris Johnson Olympic stadium. It has taken more than 2000 years just to convince the International Olympic Committee that Science is worthy of being an Olympic sport. The big day has finally arrived but the judges are still arguing about how to award the medals to scientists. Despite all the metrics involved, it’s all very very subjective. The games go ahead anyway, and there are lots of exciting new events: (more…)

April 4, 2008

myScience: “social software” for scientists

myExperimentWith apologies to Jonathan Swift:

“Great sites have little sites upon their back to bite ’em
And little sites have lesser sites, and so ad infinitum…”

So what happened was, Carole Goble asked on the myExperiment mailing list, “is there a list of scientist social networking sites”? Here is first attempt at such a list (not comprehensive), you’ll have to decide for yourself which are the great, greater, little and lesser sites.
(more…)

Blog at WordPress.com.