Home | About
| News | Partners
and people | Papers and presentations
This page last updated
Thursday, 10-Apr-2003 17:39:54 BST
The Open Citation Project performed open, publicly announced evaluations of two principal demonstrators of reference linking and citation indexing services. A new service, Citebase, featured in the second evaluation, and on the basis of the results is a now a featured service of the arXiv eprint archives. The report on the evaluation of Citebase is the first detailed user evaluation of an open access Web citation indexing service.
V. 2.1 Citation Analysis and Reference Linking demonstrator: Citebase (March 2002)
(Almost) the whole arXiv - linked! With reference links and citation analysis. The Opcit project links
each of the 150,000+ papers in the arXiv physics archives to every other
paper in the archives that it cites. Also - this is the clever part - discover what other papers cite a chosen paper.
Due to changes in the management of the underlying databases, V. 2.1 is a more robust and reliable version of the V. 2.0 Citation and Reference Linking demo, originally announced in August 2001.
- Evaluation forms (announced June 2002)
- Form 1: Using Citebase, including sections about the evaluators, a practical exercise using Citebase, and user views of Citebase
- Form 2: User Satisfaction Questionnaire, based on the well-known Software Usability Measurement Inventory (SUMI) form of questionnaire for measuring software quality from the end user's point of view
- Major results (first reported December 2002)
- As exemplified by Citebase, Web-based citation indexing of open access eprint archives is closer to a state of readiness for serious use than had previously been realised
- Within the scope of its primary components, the search interface and services available from its rich bibliographic records, Citebase can be used simply and reliably for the purpose intended
- Citebase ompares favourably with other bibliographic services
- Tasks can be accomplished efficiently with Citebase regardless of the background of the user
- Better explanations and guidance are required for first-time users
- Coverage is seen as a limiting factor, even though Citebase indexes over 200,000 papers from arXiv: non-physicists were frustrated at the lack of papers from other sciences.
- Full evaluation report on Citebase
V. 1.0 Reference Linking demonstrator (May 2000)
Superseded and no longer fully operational, but still illustrates the principles of the original approach to reference linking used by the project.
Papers from arXiv are converted to PDF for this demonstrator? Find out how and why.
Background to OpCit demonstrators
The Open Citation project is a research and development project began
in October 1999 and completed in December 2002. In terms of features the V. 2.1 demonstrator exceeds the plan outlined in the original project proposal. It presents reference links and citation analysis of over 200,000 papers from the arXiv physics archives.
Evaluation of demonstrators produced by the project was based on a three-year evaluation plan produced in August 2000. Not all the demonstrators envisaged within the original plan were produced, due to problems accessing content from other data providers at the time. Instead the project concentrated on extending the citation indexing services provided by Citebase.
An earlier demonstration
of reference linking, evaluated by the Open Journal Project and reported in this paper, also involved a number of partners from OpCit.
We are grateful to our
colleagues at arXiv.org, and the maintainers of the arXiv
mirror at Southampton University, for permission to use their services
in this project.
The OpCit Project
maintained by the Open Citation project. Contact