O'Really?

May 16, 2012

Blue Moon hypothesis tested in Large Football Collider (LFC)

The Manchester Derby 2007. What a difference five years makes

“This is how it feels to be City, this is how it feels to be small, this is how it feels when your team wins nothing at all.”  [1,3]

If you are not interested in Football Science, look away now. Normal service will be resumed shortly.

There is a controversial idea in football that money buys trophies, also known as Mancini’s Blue Moon hypothesis.

Two rival Universities have led the way in testing this idea, The University of Old Trafford and the The University of Eastlands, both in Manchester. One institute is led by a Scot, Professor Ferguson the other by an Italian, Professor Mancini. Both Universities have assembled teams of elite researchers including Doctor Vidic (PhD, University of Spartak Moscow) and Doctor Kompany (PhD, University of Hamburger) in their respective labs to carry out the necessary experiments.

Professor Mancini’s research laboratory have recently produced some intriguing experimental results by winning the 2012 Premier League title with generous funding from the Mansour Research Council (MRC) [2] (not to be confused with the Medical Research Council). The MRC has invested significantly more funding than rival bodies like the Glazer Research Council (GRC) not be be confused with the Global Research Council, which has opened up exciting new research opportunities in applied football science.

Some leading football scientists say Mancini’s Blue Moon hypothesis has been proven beyond all doubt; money does buy you trophies. Other scientists say that is it too early to tell, these results are inconclusive and more research is needed. Professor Ferguson insists that other factors besides money are significant in winning trophies.

Experimentalists will resume their research when the Large Football Collider (LFC) is switched back on in August 2012 after its annual summer shutdown. Is Mancini’s hypothesis proven or not? Tune in next season …

References

  1. Inspiral Carpets (1990) This Is How It Feels to be Lonely, This Is How It Feels to be Small Mute records
  2. The Premier League Research Council (PLRC) funds research into basic and applied football science in collaboration with the Mansour Research Council and many others. These football science councils have a larger fund than all the other traditional scientific research councils combined (EPSRC, BBSRC, NERCMRC, STFC and PPARC etc).

May 11, 2012

Journal Fire: Bonfire of the Vanity Journals?

Fire by John Curley on Flickr

Fire by John Curley, available via Creative Commons license.

When I first heard about Journal Fire, I thought, Great! someone is going to take all the closed-access scientific journals and make a big bonfire of them! At the top of this bonfire would be the burning effigy of a wicker man, representing the very worst of the vanity journals [1,2].

Unfortunately Journal Fire aren’t burning anything just yet, but what they are doing is something just as interesting. Their web based application allows you to manage and share your journal club online. I thought I’d give it a whirl because a friend of mine asked me what I thought about a paper on ontologies in biodiversity [3]. Rather than post a brief review here, I’ve posted it over at Journal Fire. Here’s some initial thoughts on a quick test drive of their application:

Pros

On the up side Journal Fire:

  • Is a neutral-ish third party space where anyone can discuss scientific papers.
  • Understands common identifiers (DOI and PMID) to tackle the identity crisis.
  • Allows you to post simple anchor links in reviews, but not much else, see below.
  • Does not require you to use cumbersome syntax used in ResearchBlogging [4], ScienceSeeker and elsewhere
  • Is integrated with citeulike, for those that use it
  • It can potentially provide many different reviews of a given paper in one place
  • Is web-based, so you don’t have to download and install any software, unlike alternative desktop systems Mendeley and Utopia docs

Cons

On the down side Journal Fire:

  • Is yet another piece social software for scientists. Do we really need more, when we’ve had far too many already?
  • Requires you to sign up for an account without  re-using your existing digital identity with Google, Facebook, Twitter etc.
  • Does not seem to have many people on it (yet) despite the fact it has been going since at least since 2007.
  • Looks a bit stale, the last blog post was published in 2010. Although the software still works fine, it is not clear if it is being actively maintained and developed.
  • Does not allow much formatting in reviews besides simple links, something like markdown would be good.
  • Does not understand or import arXiv identifiers, at the moment.
  • As far as I can see, Journal Fire is a small startup based in Pasadena, California. Like all startups, they might go bust. If this happens, they’ll take your journal club, and all its reviews down with them.

I think the pros mostly outweigh the cons, so if you like the idea of a third-party hosting your journal club, Journal Fire is worth a trial run.

References

  1. Juan Carlos Lopez (2009) We want your paper! The similarity between high-end restaurants and scientific journals Spoonful of Medicine, a blog from Nature Medicine
  2. NOTE: Vanity journals should not to be confused with the The Vanity Press.
  3. Andrew R. Deans, Matthew J. Yoder & James P. Balhoff (2012). Time to change how we describe biodiversity, Trends in Ecology & Evolution, 27 (2) 84. DOI: 10.1016/j.tree.2011.11.007
  4. Shema, H., Bar-Ilan, J., & Thelwall, M. (2012). Research Blogs and the Discussion of Scholarly Information PLoS ONE, 7 (5) DOI: 10.1371/journal.pone.0035869

May 10, 2012

The Lovelock Laboratory: A fantasy workplace in the West Country

έροτας : love, as described by an implicit heart curve (x²  + y²  − 1)³ − x² y³ = 0

An equation of love (x² + y² − 1)³ − x² y³ = 0

Former Mancunian James Lovelock runs the kind of a laboratory most scientists can only fantasise about working in as they grind through the humdrum bureaucracy of peer-review and never-ending grant applications. Lovelock is fortunate enough to run a completely independent, self-funded lab located in the beautiful West Country. There’s a fascinating interview with him on The Life Scientific with Jim Al-Khalili where he says lots of interesting things about elocution lessons, nuclear power, climate change and his grand theory of planet earth, Gaia [1,2,3]. When asked, he also made this interesting comment about being an indepedendent scientist [4]:

“It’s the most wonderful thing to do [being independent]. I keep on saying that scientists are just like artists if they are creative. If you were an artist, would you want to spend your life in an institute for fine art, quibbling with other academics about the different styles of painting? You’d rather be in your garage doing your masterpiece and selling a lot of art to some tourists to pay the way. That’s been my life as a scientist. ”

The audio file of the broadcast is available for download or just click on the play icon below:

So to become a truly independent scientist, you either need to win the lottery, nobel prize or possibly invent the modern equivalent of electron capture detection to bankroll running a lab from the bottom of your garden.

Well if nothing else, it’s an entertaining fantasy to while away dull moments in the real world…

References

  1. James Lovelock (2009). The Vanishing Face of Gaia: A Final Warning ISBN:1846141850, Penguin
  2. Andrew Watson (2009). Final warning from a sceptical prophet: James Lovelock fears that humanity faces widespread death and mass migration as Earth’s systems become further unbalanced by climate change Nature, 458 (7241), 970-971 DOI: 10.1038/458970a
  3. John Gribbin and Mary Gribbin (2009) He Knew He Was Right: The Irrepressible Life of James Lovelock and Gaia, ISBN:1846140161, Allen Lane
  4. Matthew Reisz (2012) Free-range thinkers: Independent scholars can confound, complement and challenge the work of their campus counterparts. Times Higher Education

April 2, 2012

Open Data Manchester: Twenty Four Hour Data People

Sean Ryder at the Hacienda by Tangerine Dream on flickr

Sean Ryder, the original twenty-four hour Manchester party person of the Happy Mondays, spins the discs at the Wickerman festival in 2008. Creative commons licensed image via Tangerine Dream on flickr.com

According to Francis Maude, Open Data is the raw material for “next industrial revolution”. Now you should obviously take everything politicians say with a large pinch of salt (especially Maude) but despite the political hyperbole, when it comes to data he is onto something.

According to wikipedia, which is considerably more reliable than politicians, Open Data is:

“the idea that certain data should be freely available to everyone to use and republish as they wish, without restrictions from copyright, patents or other mechanisms of control.”

Open Data is slowly having an impact in the world of science [1] and also in wider society. Initiatives like data.gov in the U.S. and data.gov.uk in England, also known as e-government or government 2.0, have put huge amounts of data in the public domain and there is plenty more data in the pipeline. All of this data makes novel applications possible, like cycling injury maps showing accident black spots, and many others just like it.

To discuss the current status of Open Data in Greater Manchester there were two events last week:

  1. The Open Data Manchester meetup “24 hour data people” [2] at the the Manchester Digital Laboratory (“madlab”), which recently made BBC headlines with the DIY bio project
  2. The Discover Open Data event at the Cornerhouse cinema
Here is a brief and incomplete summary of what went on at these events:

(more…)

March 15, 2012

Be nice to nerds … you may end up working for them

Thought for the day: be nice to nerds because you might end of up working for them.

This sound advice comes from DARPA defector and newly appointed Googler Regina Dugan (see picture below).

Regina Dugan by Steve Jurvetson

What’s that you say? You’re not sure exactly what a nerd is? There are many definitions but the graphic below sums it up better than the Oxford English Dictionary ever could.

Are you a nerd, geek, dork or dweeb?

But beware! Many self-confessed nerds may actually be dorks, dweebs or geeks. It’s a grey area out there in the Venn of Nerdery, not quite as clear cut as the diagram above. To be sure of treating nerds right, you’ll need to be nice to dorks, dweebs and geeks too! See video for details…

[Creative Commons licensed picture of Regina Dugan at TED via Steve Jurvetson]

February 15, 2012

The Open Access Irony Awards: Naming and shaming them

Ask me about open access by mollyaliOpen Access (OA) publishing aims to make the results of scientific research available to the widest possible audience. Scientific papers that are published in Open Access journals are freely available for crucial data mining and for anyone or anything to read, wherever they may be.

In the last ten years, the Open Access movement has made huge progress in allowing:

“any users to read, download, copy, distribute, print, search, or link to the full texts of these articles, crawl them for indexing, pass them as data to software, or use them for any other lawful purpose, without financial, legal, or technical barriers.”

But there is still a long way to go yet, as much of the world’s scientific knowledge remains locked up behind publisher’s paywalls, unavailable for re-use by text-mining software and inaccessible to the public, who often funded the research through taxation.

Openly ironic?

ironicIronically, some of the papers that are inaccessible discuss or even champion the very Open Access movement itself. Sometimes the lack of access is deliberate, other times accidental – but the consequences are serious. Whether deliberate or accidental, restricted access to public scientific knowledge is slowing scientific progress [1]. Sometimes the best way to make a serious point is to have a laugh and joke about it. This is what the Open Access Irony Awards do, by gathering all the offenders in one place, we can laugh and make a serious point at the same time by naming and shaming the papers in question.

To get the ball rolling, here is are some examples:

  • The Lancet owned by Evilseviersorry I mean Elsevier, recently  published a paper on “the case for open data” [2] (please login to access article). Login?! Not very open…
  • Serial offender and über-journal Science has an article by Elias Zerhouni on the NIH public access policy [3] (Subscribe/Join AAAS to View Full Text), another on “making data maximally available” [4] (Subscribe/Join AAAS to View Full Text) and another on a high profile advocate of open science [5] (Buy Access to This Article to View Full Text) Irony of ironies.
  • From Nature Publishing Group comes a fascinating paper about harnessing the wisdom of the crowds to predict protein structures [6]. Not only have members of the tax-paying public funded this work, they actually did some of the work too! But unfortunately they have to pay to see the paper describing their results. Ironic? Also, another published in Nature Medicine proclaims the “delay in sharing research data is costing lives” [1] (instant access only $32!)
  • From the British Medical Journal (BMJ) comes the worrying news of dodgy American laws that will lock up valuable scientific data behind paywalls [7] (please subscribe or pay below). Ironic? *
  • The “green” road to Open Access publishing involves authors uploading their manuscript to self-archive the data in some kind of  public repository. But there are many social, political and technical barriers to this, and they have been well documented [8]. You could find out about them in this paper [8], but it appears that the author hasn’t self-archived the paper or taken the “gold” road and pulished in an Open Access journal. Ironic?
  • Last, but not least, it would be interesting to know what commercial publishers make of all this text-mining magic in Science [9], but we would have to pay $24 to find out. Ironic?

These are just a small selection from amongst many. If you would like to nominate a paper for an Open Access Irony Award, simply post it to the group on Citeulike or group on Mendeley. Please feel free to start your own group elsewhere if you’re not on Citeulike or Mendeley. The name of this award probably originated from an idea Jonathan Eisen, picked up by Joe Dunckley and Matthew Cockerill at BioMed Central (see tweet below). So thanks to them for the inspiration.

For added ironic amusement, take a screenshot of the offending article and post it to the Flickr group. Sometimes the shame is too much, and articles are retrospectively made open access so a screenshot will preserve the irony.

Join us in poking fun at the crazy business of academic publishing, while making a serious point about the lack of Open Access to scientific data.

References

  1. Sommer, Josh (2010). The delay in sharing research data is costing lives Nature Medicine, 16 (7), 744-744 DOI: 10.1038/nm0710-744
  2. Boulton, G., Rawlins, M., Vallance, P., & Walport, M. (2011). Science as a public enterprise: the case for open data The Lancet, 377 (9778), 1633-1635 DOI: 10.1016/S0140-6736(11)60647-8
  3. Zerhouni, Elias (2004). Information Access: NIH Public Access Policy Science, 306 (5703), 1895-1895 DOI: 10.1126/science.1106929
  4. Hanson, B., Sugden, A., & Alberts, B. (2011). Making Data Maximally Available Science, 331 (6018), 649-649 DOI: 10.1126/science.1203354
  5. Kaiser, Jocelyn (2012). Profile of Stephen Friend at Sage Bionetworks: The Visionary Science, 335 (6069), 651-653 DOI: 10.1126/science.335.6069.651
  6. Cooper, S., Khatib, F., Treuille, A., Barbero, J., Lee, J., Beenen, M., Leaver-Fay, A., Baker, D., Popović, Z., & players, F. (2010). Predicting protein structures with a multiplayer online game Nature, 466 (7307), 756-760 DOI: 10.1038/nature09304
  7. Epstein, Keith (2012). Scientists are urged to oppose new US legislation that will put studies behind a pay wall BMJ, 344 (jan17 3) DOI: 10.1136/bmj.e452
  8. Kim, Jihyun (2010). Faculty self-archiving: Motivations and barriers Journal of the American Society for Information Science and Technology DOI: 10.1002/asi.21336
  9. Smit, Eefke, & Van Der Graaf, M. (2012). Journal article mining: the scholarly publishers’ perspective Learned Publishing, 25 (1), 35-46 DOI: 10.1087/20120106

[CC licensed picture “ask me about open access” by mollyali.]

* Please note, some research articles in BMJ are available by Open Access, but news articles like [7] are not. Thanks to Trish Groves at BMJ for bringing this to my attention after this blog post was published. Also, some “articles” here are in a grey area for open access, particularly “journalistic” stuff like news, editorials and correspondence, as pointed out by Becky Furlong. See tweets below…

December 20, 2011

Happy Christmas Lectures 2011: Meet your Brain with Bruce Hood

Filed under: Science — Duncan Hull @ 5:25 pm
Tags: , , , , ,
Bruce Hood

An animated Bruce Hood. Creative Commons licensed picture by Dave Fayram

The holiday season is upon us which means it’s time for the Royal Institution Christmas lectures. This year the lectures are on the meaty subject of how our brains work and are delivered by psychologist Professor Bruce Hood from the University of Bristol [1,2]. Broadcast over three episodes at 8pm on BBC4  (27th, 28th and 29th December) the talks will also be freely available online afterwards, see trailer.  Here’s the blurb on the first episode: What’s in your head?

Why does your brain look like a giant walnut, how does it fit in enough wiring to stretch four times around the equator and why can a magnet on your head stop you in mid-sentence? In the first of this year’s Christmas Lectures, Professor Bruce Hood gets inside your head to explore how your brain works. He measures the brain’s nerve cells in action, reads someone’s mind from 100 miles away and reveals how the brain ultimately creates its own version of reality.

The second episode is titled Who’s in charge here?

Your brain is constantly being bombarded with information, so how does it decide what to trust and what to ignore, without you even being aware? Professor Bruce Hood leads us through the second of this year’s Christmas Lectures – testing the limits of our memory, finding out how we learn, how our brain takes shortcuts and why multi-tasking can be dangerous. Bruce will make you say the wrong thing and fail to see what’s right in front of you. Can you really believe your eyes? Possibly not.

The final episode is Are You Thinking What I’m Thinking?

Have you ever seen a face in a piece of burnt toast, or given your car a name? Why do you feel pain when someone else is hurt? Why are people so obsessed with other people? In the last of this year’s Christmas Lectures, Professor Bruce Hood investigates how our brains are built to read other people’s minds. With a little help from a baby, a robot and a magician, Bruce uncovers what makes us truly human.

This year the Royal Institution have relaunched their website at richannel.org and made some of the previous lectures available at richannel.org/christmas-lectures. Hopefully Santa will eventually get around to adding many more lectures from this fantastic series to the archive soon.

This will (probably) be the last post of the year at O’Really, so if you’ve visited, thanks for reading during 2011. It’s been an eventful twelve months, with not much time for blogging, maybe that will change next year…

Wherever you are, whatever you’re up to, have a happy holidays and a prosperous 2012.

References

  1. Hood, B., Willen, J., & Driver, J. (1998). Adult’s Eyes Trigger Shifts of Visual Attention in Human Infants Psychological Science, 9 (2), 131-134 DOI: 10.1111/1467-9280.00024
  2. Hood, B. (2009) Supersense: From Superstition to Religion – The Brain Science of Belief. ISBN:1849010307

September 22, 2011

I Can’t Get No Job Satisfaction

I can't get no satisfaction

Rock and Roll: The ultimate in job satisfaction?

Job satisfaction is like a complex mathematical equation that needs to be balanced. There are many factors that contribute to the mix, both good and bad. Hopefully the good things about a job will outweigh the bad. But what are the good things that contribute to the elusive but crucial job satisfaction?

Daniel Pink, argues that motivation is key to job satisfaction. If you provide the right motivations to people in an organisation, not always large financial ones [1], then their job satisfaction is more likely. According to Pink, the three key motivations are:

  1. Autonomy: The desire to be self-directed.
  2. Mastery: The urge to get better at doing things and be recognised for it
  3. Purpose: The sense that your work makes a difference and maybe even makes the world a better place somehow.

Pink explains how these factors work in another one of those beautifully animated RSA videos below:

So if like Mick and Keith, you can’t get no (job) satisfaction [2], it’s probably worth aiming for more autonomy, mastery and purpose in your work.

References

  1. Ariely, D., Gneezy, U., Loewenstein, G., & Mazar, N. (2009). Large Stakes and Big Mistakes Review of Economic Studies, 76 (2), 451-469 DOI: 10.1111/j.1467-937X.2009.00534.x
  2. Jagger, M. & Richards, K. (1965) (I Can’t Get No) Satisfaction Decca Records

August 15, 2011

Wikipedia: I Fought the Lore and the Lore Won

"The age of nations is past. It remains for us now, if we do not wish to perish, to set aside the ancient prejudices and build wikipedia..."Fighting the lore of wikipedia is an increasingly futile battle but there are people who resist using and improving the online encyclopedia. The remarkable thing is that some of this resistance comes from the scientific and academic communities, two groups of people who are supposedly concerned with the dissemination of knowledge.

Wikipedia is the lore

With around 300 million visitors each month, wikipedia is firmly in the top ten of most trafficked websites in the world. But you don’t get 300 million visits without attracting some critics, many of whom object to wikipedia’s inaccuracies and the anonymity of some its contributors. What many critics object to is that wikipedia is the lore. That is not the law, but the lore, as in folklore. Like folklore, wikipedian knowledge often comes handed down by word of mouth, copy-and-paste and other questionable practices. The trouble with lore is, it can sometimes be unreliable, based on hearsay, gossip and urban myths rather than hard facts and knowledge favoured by scientists and academics. To some people, wikipedia is a lore which should be fought in every way possible.

Fighting the lore of wikipedia

Professor Neil Waters is one of many examples of an academic who has fought the lore of wikipedia. Water’s students were infamously told that they can’t cite wikipedia in their work [1]. They are still free to use it, but are forbidden to cite it, because of the lack of academic rigour. Wikipedia, the argument goes,  is a “tertiary source” rather than a primary one and therefore not suitable for serious research.

But people like Patricia Dooley have pointed out that academics fighting the use of wikipedia is hypocritical. In a small study published [2], she found that some university faculty members (the “two-faced professoriate” [2]) depend on Wikipedia in their teaching and published research despite the fact that they often discourage their students from using it. Are critics of wikipedia in the academy hypocrites fighting a losing battle?

Has the lore of wikipedia won?

As with many keywords, if you Google just about any scientific term, wikipedia will be in the first page of results. Here are some examples, taken from by Darren Logan’s why wikipedia is important in science:

At the time of writing, 90% of the search terms above have a wikipedia page as their very first Google hit. So, when it comes to accessibility and visibility, the lore of wikipedia is winning.

Improving the lore of wikipedia: Don’t fight it, edit it

So wikipedia is winning but many articles with scientific content are incomplete, inaccurate or just plain wrong. What should scientists do about it?  Rather than discouraging students to use it, wouldn’t it be better if academics and scientists encouraged their students to correct it? Fusing the lore of wikipedia with the law of science in this way is perhaps, the “greatest ever opportunity for public engagement”.  Ornithologist Alexander Bond is the latest in a long line of scientists arguing exactly this case [3]. Where wikipedia is wrong, he suggests that scientists have a duty to make sure that it is accurate and up to date:

“Regardless of the academy’s views on Wikipedia, it will remain a resource used by students, researchers and the public for the near future. Academics should appropriate Wikipedia as a teaching and outreach tool, resulting in higher quality information, more engaged students and a better-informed public.”

So if you’re a scientist or any other kind of academic, there is plenty of help and advice on hand [4] and many different wikiprojects to get involved in. Don’t fight the lore, edit it.

References

  1. Neil L. Waters (2007). Why you can’t cite Wikipedia in my class Communications of the ACM, 9, 15-17 DOI: 10.1145/1284621.1284635
  2. Patricia L. Dooley (2010). Wikipedia and the two-faced professoriate WikiSym ’10 Proceedings of the 6th International Symposium on Wikis and Open Collaboration DOI: 10.1145/1832772.1832803
  3. Alexander L. Bond (2011). Why ornithologists should embrace and contribute to Wikipedia Ibis, 153 (3), 640-641 DOI: 10.1111/j.1474-919X.2011.01135.x
  4. Darren Logan, Massimo Sandal, Paul Gardner, Magnus Manske, & Alex Bateman (2010). Ten simple rules for editing Wikipedia. PLoS computational biology, 6 (9) PMID: 20941386
  5. Sonny Curtis et al (1959) I Fought The Law (and the Law Won) as covered by The Clash:

[Acknowledgement: thanks to wikipedian Paul Gardner for posting the Bond paper on the journal picks. Image above via wikipedia.]

July 1, 2011

Anything that calls itself a Science, probably isn’t…

Way Cool Science Stuff by Mark A. Hicks www.markix.netScience, is a big word that gets used and abused with reckless abandon. Virtually any discipline can award itself extra kudos by adding the magic S word at the end. For example, which sounds weightier, sports studies or sports science?

This phenomenon has been noticed many times before, for example, the philosopher John Searle once remarked that:

Science has become something of an honorific term, and all sorts of disciplines that are quite unlike physics or chemistry are eager to call themselves ‘sciences‘.

A good rule of thumb to keep in mind is that anything that calls itself a science probably isn’t.” –see [1,2]

So let’s make a list. Starting with things that probably aren’t a Science because they call themselves one:

We could carry on for ages with this list and eventually include:

So are maths, physics, chemistry, biology etc real sciences™ too? Using Searle’s definition, it’s difficult to say. To avoid confusion, it might be a good idea to use a subjects non-scientific original name (“biology” rather than “life science”) that way, we know (paradoxically) they are real sciences. Probably.

References

  1. John R. Searle (1986). Minds, Brains and Science (1984 Reith Lectures) Harvard University Press ISBN:0674576330 (see also audio from the BBC Reith lecture archive) not  Speech Acts: An Essay in the Philosophy of Language. Cambridge University Press. ISBN:052109626X (as originally stated in the first version of this post)
  2. Fuller quotation: “Science has become something of an honorific term, and all sorts of disciplines that are quite unlike physics and chemistry are eager to call themselves ‘sciences’. A good rule of thumb to keep in mind is that anything that calls itself ‘science’ probably isn’t — for example, Christian science, or military science, and possibly even cognitive science or social science. The word ‘science’ tends to suggest a lot of researchers in white coats waving test tubes and peering at instruments. To many minds it suggests an arcane infallibility. The rival picture I want to suggest is this: what we are all aiming at in intellectual disciplines is knowledge and understanding. There is only knowledge and understanding, whether we have it in mathematics, literary criticism, history, physics, or philosophy. Some disciplines are more systematic than others, and we might want to reserve the word ‘science’ for them.”
  3. Peter J. Denning (2005). Is computer science science? Communications of the ACM, 48 (4) DOI: 10.1145/1053291.1053309
« Previous PageNext Page »

Blog at WordPress.com.