Steve Hitchcock, Les Carr, Zhuoan Jiao, Donna Bergmark*, Wendy Hall, Carl Lagoze* and Stevan Harnad
Multimedia Research Group, Department of Electronics and Computer Science,
University of Southampton, SO17 1BJ, United Kingdom
* Digital Library Research Group, Department of Computer Science, Cornell
University, Ithaca, NY 14853-7501, USA
Contact for correspondence: Steve Hitchcock sh94r@ecs.soton.ac.uk
This paper is produced by the Open Citation project, funded by the Joint NSF - JISC International Digital Libraries Research Programme
Version history of this paper
Abstract
The rapid growth of scholarly information resources available in electronic form and their organisation by digital libraries is providing fertile ground for the development of sophisticated new services, of which citation linking will be one indispensable example. Many new projects, partnerships and commercial agreements have been announced to build citation linking applications. This paper describes the Open Citation (OpCit) project, which will focus on linking papers held in freely accessible eprint archives such as the Los Alamos physics archives and the other distributed archives, and which will build on the work of the Open Archives initiative to make the data held in such archives available to authorised services. The paper emphasises the work of the project in the context of emerging digital library information environments, explores how a range of new linking tools might be combined and identifies ways in which different linking applications might converge. Some early results of linked pages from the OpCit project are reported.
Keywords: electronic publishing, digital library information
architectures, reference linking, distributed collections, eprint archives,
open archives
Introduction
The process of scholarly communication, in particular the aggregation of formal academic papers in journals, is probably about to enter its fastest period of change since 1994-6. The immediate platform for this change was the emergence of the World Wide Web as a popular medium in 1994 and the subsequent conversion of most established journals to electronic facsimiles delivered over the Web, a process which began to build momentum in 1996 (Hitchcock et al. 1996). While growth in the number of e-journals continues to accelerate towards an estimated 10,000 (Maclennan 1999, Hunter 1999), it is prior developments, such as the establishment of free electronic archives, or eprint archives, that are beginning to influence wider changes.
Launched in 1991, the importance of the Los Alamos physics eprint archive, the first and preeminent archive of its kind (Ginsparg 1994), is widely recognised, but its practical ramifications have so far been largely confined to its home community in physics. Many have questioned, because of cultural differences between different academic disciplines (Kling and McKim 1999), whether the eprint model will be accepted beyond physics. That contention will be challenged by the most significant new eprint archives to have emerged since 1991: PubMed Central, launched at the beginning of this year and sponsored by the National Institutes of Health, covering all fields in biomedical and life sciences (Varmus 1999); and the Computing Research Repository (CoRR), sponsored by the ACM and the British Computer Society (Halpern and Lagoze 1998). An immediate effect of PubMedCentral has been the announcement by some biomedical publishers, notably the British Medical Journal (Delamothe and Smith 1999) and the Current Science Group (Anon. 1999), of freely accessible archives of electronic copies of current and past papers, both pre- and post-publication. As well as discipline-based archives, institutionally based initiatives such as Scholars Forum are planned. (Buck et al. 1999)
The essential feature of the Los Alamos eprint archive model is author self-archiving based on a free-to-archive, free-to-access service. Compared with journals, eprint archives provide an almost wholly automated and highly efficient organisational framework and distribution mechanism based on the Internet, but without many of the additional services that journals provide, such as peer review, and other services that mostly require human intervention. As more archives attract more papers the test for journals is how they respond to the effective loss of exclusivity that most depend on, and how they cope with the new economics of journal publishing in which every facet of traditional value-adding is re-evaluated against the for-free services.
There is another dimension to consider too: globalisation. With no geographical or financial barriers the next inevitable step is, if not universalisation where archives all adopt the same technical infrastructure, then integration of the archives based on new services. As part of this agenda archives are not only freely accessible to users but are becoming open to independent, third-party computational processes, for example Web crawler techniques used for indexing, on which these services will be built. This approach has been formalised by the Open Archives initiative, a group that includes archive managers, potential service developers and academic librarians (Van de Sompel and Lagoze 2000).
The publishing industry anticipates that links on citations within scholarly papers will be one of the primary new services driving integration between scholarly sources (Needleman et al. 1999). Linking services cannot be implemented piecemeal on such a scale. A large group of journal publishers have announced a collaboration (Reuters 1999) to use the Digital Object Identifier (DOI) system (Davidson and Douglas 1998) to form citation links (Lyons and Ratner 1999) between their, separately maintained, journal contents. Most traditional journals service providers - aggregators, subscription agents and secondary publishers (e.g. Brunelle and Johnson 1999) - as well as new producers highlight the important role of citation links in their services.
This paper considers the implications of the new wave of eprint archives
and the development of open archives. Its main focus is an example of an
open archive service being developed by the Open Citation (OpCit) project,
funded by the joint NSF-JISC international digital libraries programme,
that will initially build citation links uniting large, high-profile and
distributed archives but which is planned to be extensible to other services
that provide access to scholarly papers.
Open archives: separating content from services
Eprint archives are noticeably entering a new phase. Not only have significant new archives launched, but new services are being developed to complement the traditional content management functions of the archives. The key feature is that many of these new services will be independent of the underlying archive contents. There are a number of reasons for this. Growth in the number of archives and greater use create opportunities for third-party developers, and such developments thus do not add to the low-cost base of most archives and can be developed either commercially or non-commercially.
More importantly, as the use of archives crosses new boundaries between disciplines, the role of new services will be to enable the user to view an integrated, complete set, or selected subset, of all archives, with user customisation features to set the scope of a service likely to become increasingly common. For the archives predicated on free and open access it is recognised that capitalising on this feature means not constraining users within the boundaries of a single discipline or archive but supporting cross-disciplinary navigation. The aim is that navigation support such as indexing, searching and linking should provide a consistent interface and seamless service regardless of which archives are accessed by the user, who need have no knowledge of the structure of an archive or, apart from perhaps noting the archive source and publisher identities, from where a viewed document originated.
Integration of free eprint archives through independent services is currently the preferred view of the Open Archive initiative (Van de Sompel and Lagoze 2000) of the way in which such archives may pave the way for a unified global scholarly literature, encompassing not just the archives but journals and other contributing literatures.
The way in which this level of service will be achieved will be by supporting interoperability between the archives, for example the protocols through which services can communicate with the archives, and metadata forms that will expose the data structures and the contents of archives. Methods will be open and published to encourage widespread adoption, but also to ensure conformity of safe and trusted practices that do not compromise the integrity of the archives.
A well established protocol for data communication in digital library
applications is Dienst, developed at Cornell University (Dienst 1999).
An implementation of part of the Dienst protocol has been adopted by the
Open Archives initiative for data harvesting. The OpCit project, in which
the Dienst research group is one of the principal partners, is similarly
building on this core technology for its linking applications.
Linking the open archives: the OpCit project
Linking is an apparently simple concept, especially the model implemented by the Web in which a unidirectional point-and-click event presents the user with the page from the location pointed at by a locator, the URL, that is authored into the linking page. This simplified form of hypertext linking, it has long been argued in the hypertext community of researchers, is inadequate to support robust services required for large-scale information environments, such as might be represented by the contents of scholarly communications and organised via digital libraries.
In terms of citation linking services, an early pioneer and predecessor of the OpCit project was the Open Journal project (Hitchcock et al. 1998a). The information environment envisaged in that project centred on published journal contents but was essentially unbounded, allowing links to take users to other types of materials, such as abstracting and indexing services, dictionaries and biological databases. In practice different implementations of Open Journals had to be bounded, principally to manage the user interface more effectively.
Originally supported by four publishers, by its close 12 publishers were involved. It is safe to assume that many more scholarly publishers now recognise the importance and power of links in electronic documents, especially links which implement the long-established, non-electronic form of linking inherent to the scholarly or scientific paper, the reference.
With this wider participation has come the recognition that linking may not be as simple (Caplan and Arms 1999) as originally envisaged. There are a number of reasons for this. Expectations are high, of links from almost every reference in every electronically-accessible paper, both backwards in time as provided by a typical reference list in a paper, and forwards in time in a manner made familiar by the Science Citation Indexes (Hitchcock et al. 1998b). Constraining these expectations are accuracy, reliability and availability of the necessary contents in electronic form (Hitchcock et al. 1998c). There may be multiple, but not identical, versions of the same document at multiple locations (Caplan and Flecker 1999). Finally, there are the financial and authorisation barriers imposed by commercial journals and services. Access requirements can differ for each user, for each access location, for each document and for each document location. Competing publishers may be becoming allies to support cross-publisher reference linking, but although there are various possible solutions to the problem of linking across distributed collections, there is as yet no convincing demonstration or detail of how this might be achieved in this exclusively commercial environment (Atkins 1999).
In this context linking is more than just a technical process but must be viewed as part of the social and business phenomena that are shaping the new information environments. This is recognised in the scope and partnerships that form the OpCit project. Ironically, in the first environments the project will explore, selected open archives, such is the accessibility of so much content that the project could almost reduce the problem to its technical issues, but the longer-term commitment is to collaborating with others in the wider environments discussed below.
Three principal objectives elaborated by the OpCit project (see original proposal; Harnad et al. 1999) concern scale-compatibility-universality:
When the Open Journal project began in 1995 the linking tools used then were all developed at Southampton University. Now there are a range of tools created to suit different linking requirements:
Linking services and information environments
Information environments organised via digital libraries continue to be part of the Web but are distinguished by services that apply to contents that are deemed to be within them, determined not by physical location but by the nature and selection of those contents. Examples of these environments might include the contents of libraries as in the UK eLib-funded Distributed National Electronic Reserve (DNER), single-publisher collections such as the ACM Digital Library, larger collections of published journal papers accessed via DOI-based services, or distributed archives such as the Networked Computer Science Technical Report Library, NCSTRL. In essence, in these environments the Web is transformed from a document delivery service into a dynamic, computational framework. The information environments being explored for citation linking by the OpCit project are outlined in Figure 1.
Figure 1. Information environments and link services: a range of possible scenarios and tools for OpCit and beyond
The scope of the project and that shown in Figure 1 is intentionally wide, although of immediate concern is the area bounded by the left-hand vertical arrows and the information environments denoted by 'Southampton' and 'Cornell'. The first results reported below specifically relate to Southampton's work with the Los Alamos physics archive.
These scenarios are highly flexible and may be viewed in other ways by different applications. For example, the connecting arrows are all possible scenarios, although such applications may not have been implemented yet. An SFX application linking various resources - notably a number of abstracting and indexing (A&I) services, some publishers' full-text content as well as the Los Alamos archives - via an SFX database for library environments was described by Van de Sompel and Hochstenbach (1999b). It could be envisaged that the multi-publisher linking initiative described above might likely route through the DOI resolver to a library or aggregated journal environment. ISI has announced a number of agreements with publishers to link between Web of Science and full-texts. Each of these applications can be identified in some form in Figure 1.
In addition, the roles imputed to the linking tools in Figure 1 may not reflect their wider capabilities. Citeseer and SFX variously contain information retrieval, database and linking functions. This is not shown for Citeseer. Demonstrator services based on these tools have created user interfaces. In this respect the tools could legitimately be indicated as part of the information environments at the top of the diagram, but are not in this view. Apart from Citeseer, methods for data extraction from the archives - mini-Dienst and new metadata conventions - that will be used to create citation databases are ongoing developments of the Open Archive initiative.
Thus it can be seen how interchangeable these components are, and it
is anticipated that this flexibility will be a driver for significant innovation
in citation linking. For now, Figure 1 should be considered a perspective
on environments for citation linking held by the OpCit project but not
necessarily by others.
OpCit: early implementations and results
The process of adding citation links dynamically to documents retrieved from an archive involves parsing the document during download to identify and read citations. The data are compared with a precompiled link or citation database, and a link to the cited work added where an exact match is found. For more details, one method for doing this was described by Hitchcock et al. (1997).
A similar method has been adopted for OpCit, but in this case the application demands that a larger, richer citation database is compiled. Broadly the stages involved in the compilation of this database are:
The importance of stage 3 is that richer citation databases can provide users with useful information, apart from linking, effectively a highly automated version of Garfield's famous citation analyses:
Figure 2. Reference section of article hep-th/9907001 with added links indicated by coloured boxes. For a colour key see Figure 5
Figure 3. Activating the link for reference [5] in Figure 2 returns an SFX page offering the user a choice of sources
a
b
c
Figure 4. Selecting the first three options from Figure 3: a,
abstract of cited paper; b, PDF version enhanced with reference
links; c, the same, original full-text from the archive (the dashed
link is created by the archive on explicitly cited identifiers). For a
colour key see Figure 5
Citation link analysis
Working initially just within the Los Alamos physics eprint archive, citations were analysed from a subset of papers submitted during 1999 to the end of October from one section of the archive, hep-th (theoretical high-energy physics), a total of 2170 papers. These papers contained over 65 000 citations.
Citations in physics are notoriously terse. In papers in the archive typically they include author names, and then either an archive identifier number or a standard abbreviation for the journal title followed by some undifferentiated numbers, usually volume number, start page number and the year of publication (see Figure 2). Sometimes both the archive ID and journal data are included.
For our subset of documents the relative success in automatically recognising and resolving to the corresponding document in the bibliographic database compiled from the archive can be gauged from Figure 5. The colours in this chart correspond to the link colours in Figure 2. Some links were simply derived from explicitly cited IDs for the archive documents, others were derived purely from the bibliographic data in the citation. Where archive IDs are not included directly, they can alternatively be derived from bibliographic data in the archive journal-ref metadata or from other more intensively-maintained, overlapping bibliographic databases in physics such as SPIRES. (SPIRES is maintained by the Stanford Linear Accelerator Center (SLAC), an associate partner in the OpCit project.)
Figure 5. Resolving and linking citations in a subset of hep-th papers: what proportion could be linked, what could not and why. For an example of a single reference list showing this range of results see Figure 2
Where resolution of reference data against the database, and therefore linking, was unsuccessful there could a number of reasons, and the relative occurrence of these problems is also shown in Figure 5. In some cases a citation was correctly recognised, but the reference is too old to feature in the archive, or a citation was recognised but not found in the database (the cited paper is not in the archive). The remaining citations could not be resolved, possibly due to poor formatting, incorrect data, etc. It can be seen that just over half of the references were successfully linked within the archive. The number of successful links could be increased significantly if the archives were supplemented with other, older sources, online archival journals say. About 16 per cent of citations from this subset may never be resolvable (again, consistent with the experience reported by Electronic Press).
These percentages might be generalisable across the physics archive
but not necessarily to other archives or applications, although it is interesting
to compare broad measures of success in citation linking such as this example
(52 per cent of citations linked within the archive) with that reported
by Electronic Press for Medline linking in which "on average only about
60% of references in a typical medical paper are contained in the Medline
data". Of these Medline citations only 85% were reliably resolved by the
linking software (Hitchcock et al. 1998c). Factors that control
these figures include the size and accessibility of the archive and other
document sources, and the accuracy, quality and completeness of the reference
data.
OpCit design and evaluation
There is another way tackle potentially unresolvable citations for new and future submissions to the archive: at source, when the papers are deposited by authors. As well as developing linking services, important and interesting tasks for the project are citation analysis, interface design, and user testing and evaluation. Designing user interfaces for the linked archives concerns not just navigation but author deposit too. It is argued that a barrier to wider participation in eprint archives beyond physics is the need for more user-friendly procedures for authors. Given that original submissions to the archives. i.e. the preprints rather than the later refereed reprints, are unedited and unmoderated, the responsibility for the quality and accuracy of such submissions lies wholly with its authors, so the challenge is to make the deposit process both easier and more intuitive but with a greater degree of responsiveness and immediate feedback to encourage high standards of correctness and completeness.
Citation linking obviously depends strongly on the accuracy of data provided by authors and so improving correctness in this area is of particular interest to the project. One idea is is to provide dynamic checking for references in newly submitted papers using the same process as used to produce citation links and inviting the author to respond. In this case correct, linkable citations would appear as standard links, but other citations could be highlighted by different link colours, say, indicating possible problems with a citation, suggesting a reason for the problem and highlighting which ones the author could usefully amend. Such a scheme might look like that shown in Figure 2 with link types as defined in Figure 5 (although the model implementation was not designed for this purpose).
While each of the components developed by the project will be subjected to user evaluation by standard means, in citation analysis there is an inherent means of evaluating common practice and usage of the archive by its most important constituency: its authors.
Since the project is experimenting with stored data from the archive
rather than real live data there are other effects that can be used to
monitor user behaviour. The stored data is a snapshot of the archive contents
at that time and using simple difference computation can be compared with
later datasets to reveal the extent of changes, minor or major. Of particular
interest is the proportion of pre-publication papers in the archive that
are replaced by the final published version. Only the authors of a paper
can change or update it in the archive, so there is no standard procedure
for replacing pre- with post-publication copies, but analysis is revealing
some common patterns.
Conclusion
The Internet is regarded by some as introducing a paradigm shift in communication (Valauskas 1997). With major new free-to-use eprint archives joining the well established Los Alamos archives, and with progress towards integration and globalisation of these archives motivated by the Open Archives initiative, the new paradigm beckons for scholarly communication. For scholarly communication these developments bring closer the critical and long heralded (Dyson 1994) transition promised by the Internet in which primary value accrues to services rather than just to content. For any such transition the main issue is access. The archives provide access to content and projects such as OpCit and others are demonstrating how that can be exploited and value added through new services. (Harnad 1998)
For commercial scholarly publishing, which by its nature imposes financial barriers to access, the picture is less clear. It is ironic that as some major publishers agree to explore possible mechanisms for managing links between their journals, they are failing to respond to the issue of improving access. For example, users can access primary journal papers via abstracting, indexing and aggregation services now transformed into electronic forms and sporting new brand names but mostly supported by familiar corporate interests. A possible scenario was sketched by Morrow (1999):
"Sites who have signed up for the ScienceDirect trial through BIDS now have access through four different routes ...Individually these are perfectly good services that are legitimately exploring new solutions at a critical moment of change. The question it raises, however, is does this help users? This is not a paradigm shift, but a muddle that is the result of self-preservation driven by service providers rather than users. It arises because it fails to recognise the shift in value from content to services. Some publishers that maintain close links with the research community, typically professional societies, have been required to pay close attention to the development of the archives. They understand the distinction and have acted (e.g. the BMJ and the Current Science Group), or are prepared to act (Doyle 1999), to free their electronic archives and to free authors to self-archive.
* Selecting the Elsevier option for the BIDS route to ScienceDirect does NOT preclude access to ScienceDirect via Web of Science through MIMAS. Even after July 2000, Web of Science users (with the appropriate linking licence) at sites who have selected the Elsevier licensing option will continue to be able to access ScienceDirect material (in exactly the same way as those who sign a NESLI/Swets agreement)."
This paper has highlighted the real paradigm shift taking place in scholarly
communication, towards more open and accessible information. This benefits
linking services, but many other digital library services can benefit too.
A new phase of convergence in digital library services is beginning and
is being driven by embracing pragmatic, widely shared interests throughout
the scholarly community.
References
Hitchcock, Steve, Carr, Leslie and Hall, Wendy (1996) A Survey of STM
Online Journals 1990-95: the Calm Before the Storm. Directory of Electronic
Journals Newsletters and Academic Discussion Lists, edited by D. Mogge,
sixth edition (Washington, D.C.: Association of Research Libraries), pp.
7-32
http://journals.ecs.soton.ac.uk/survey/survey.html
Maclennan, Birdie (1999) Presentation and Access Issues for Electronic
Journals in a Medium-Sized Academic Institution. Journal of Electronic
Publishing, Vol. 5, No. 1, September
http://www.press.umich.edu/jep/05-01/maclennan.html
Hunter, Karen (1999) Journals Online: PubMed Central and Beyond, page
4. HMS Beagle: The BioMedNet Magazine, No. 61, September 3rd
http://www.biomednet.com/hmsbeagle/61/viewpts/page4
(free registration required)
Ginsparg, Paul (1994) First Steps Towards Electronic Research Communication.
Computers in Physics, Vol. 8, No. 4, Jul/Aug
http://xxx.lanl.gov/blurb/blurb.ps.Z
Kling, Rob and McKim, Geoffrey (1999) Not Just a Matter of Time: Field
Differences in the Shaping of Electronic Media in Supporting Scientific
Communication. Journal of the American Society for Information Science
http://xxx.lanl.gov/ftp/cs/papers/9909/9909008.pdf
Varmus, Harold (1999) Journals Online: PubMed Central and Beyond, page
1. HMS Beagle: The BioMedNet Magazine, No. 61, September 3rd
http://www.biomednet.com/hmsbeagle/61/viewpts/page1
(free registration required)
Halpern, Joseph Y. and Lagoze, Carl (1998) The Computing Research
Repository: Promoting the Rapid Dissemination and Archiving of Computer
Science Research. CoRR eprint, cs.DL/9812020, December
http://xxx.lan.gov/abs/cs/9812020
Delamothe, Tony and Smith, Richard (1999) Moving beyond journals: the
future arrives with a crash: New ways to disseminate research from NIH
and the BMJ. British Medical Journal, Vol. 318, 19 June, 1637-1639
http://www.bmj.com/cgi/content/full/318/7199/1637
Anon. (1999) Science publishing - beginning of a revolution. Current
Science Group, press release, 26 April
http://www.genomebiology.com/pressrelease26apr99.asp
Buck, Anne M., Flagan, Richard C. and Coles, Betsy (1999) Scholar’s
Forum: A New Model For Scholarly Communication. March
http://library.caltech.edu/publications/ScholarsForum
Van de Sompel, Herbert and Lagoze, Carl (2000) The Santa Fe Convention
of the Open Archives Initiative. D-Lib Magazine, Vol. 6, No. 2, February
http://www.dlib.org/dlib/february00/vandesompel-oai/02vandesompel-oai.html
Needleman, Mark (1999) Meeting Report of the NISO Linking Workshop.
Washington, D.C., February
http://www.niso.org/linkrpt.html
Davidson, Lloyd and Douglas, Kimberly (1998) Digital Object identifiers:
Promise and Problems for Scholarly Publishing. Journal of Electronic Publishing,
Vol. 4, No. 2, December
http://www.press.umich.edu/jep/04-02/davidson.html
Lyons, Catherine and Ratner, Howard (1999) DOIs Used for Reference Linking:
DOI-X (version 1.0). October
http://dx.doi.org/10.1000/6382-1
Reuters (1999) Scientific Minds Meet on the Net. Wired News, 17 November
http://www.wired.com/news/reuters/0,1349,32592,00.html
Brunelle, Bette and Johnson, Dana (1999) Connecting the Docs:
New Models and New Tools to Link Bibliographic Databases and Full Text
Journals. CNI Fall 1999 Task Force Meeting: Project Briefings
http://www.cni.org/tfms/1999b.fall/PBrief99Ftf.html
Dienst (1999) Dienst Overview and Introduction, December
http://www.cs.cornell.edu/cdlrg/dienst/DienstOverview.htm
Hitchcock, Steve, Carr, Leslie, Harris, Steve, Hall, Wendy, Probets,
Steve, Evans, David and Brailsford, David (1998a) Linking Electronic Journals:
Lessons from the Open Journal Project. D-Lib Magazine, December
http://www.dlib.org/dlib/december98/12hitchcock.html
Caplan, Priscilla and Arms, William Y. (1999) Reference Linking for
Journal Articles. D-Lib Magazine, Vol. 5, No. 7/8, July/August
http://www.dlib.org/dlib/july99/caplan/07caplan.html
Hitchcock, Steve, Kimberley, Robert, Harris, Steve, Carr, Leslie and
Hall, Wendy (1998b) Webs of Research: Putting the User in Control. Internet
Research and Information for Social Scientists (IRISS) conference,
Bristol, March
http://sosig.ac.uk/iriss/papers/paper42.htm
Hitchcock, Steve, Quek, Freddie, Carr, Leslie, Hall, Wendy, Witbrock,
Andrew, Tarr, Ian (1998c) Towards Universal Linking for Electronic Journals.
Serials Review, Vol. 24, No. 1, Spring, 21-33
http://journals.ecs.soton.ac.uk/IFIP-SerRev98.html
Caplan, Priscilla and Flecker, Dale (1999) Choosing the Appropriate
Copy. Draft version circulated to Ref-Links listserv <ref-links@doi.org>,
14 October
http://www.doi.org/mail-archive/ref-link/msg00060.html
Atkins, Helen (1999) The ISI Web of Science - Links and Electronic Journals.
D-Lib Magazine, Vol. 5 No. 9, September
http://www.dlib.org/dlib/september99/atkins/09atkins.html
Harnad, Stevan et al. (1999) Integrating and Navigating Eprint
Archives Through Citation-Linking. Proposal to NSF-JISC International Digital
Libraries Research Programme
http://www.cogsci.soton.ac.uk/~harnad/citation.html
Payette, Sandra and Carl Lagoze (1998) Flexible and Extensible Digital
Object and Repository
Architecture. Second European Conference on Research and Advanced Technology
for Digital
Libraries, Heraklion, Crete, Greece, September, in Lecture Notes in
Computer Science, Vol. 1513 (Springer-Verlag)
http://www.cs.cornell.edu/payette/papers/ECDL98/FEDORA.html
Carr, L. A., Hall, W. and Hitchcock, S. (1998) Link Services or Link
Agents? Ninth ACM Conference on Hypertext, Pittsburgh, June
http://www.staff.ecs.soton.ac.uk/~lac/LinksOrAgents.pdf
Van de Sompel, Herbert and Hochstenbach, Patrick (1999) Reference Linking
in a Hybrid Library Environment, Part 2: SFX, a Generic Linking Solution.
D-Lib Magazine, Vol. 5, No. 4, April
http://www.dlib.org/dlib/april99/van_de_sompel/04van_de_sompel-pt2.html
Lawrence, Steve, Giles, C. Lee and Bollacker, Kurt (1999) Digital Libraries
and Autonomous Citation Indexing. IEEE Computer, Vol. 32, No. 6,
67-71
http://www.neci.nj.nec.com/~lawrence/papers/aci-computer98/
Hellman, Eric S. (1998) Scholarly Link Specification Framework (SLinkS)
http://www.openly.com/SLinkS/SLinkS.html
Van de Sompel, Herbert and Hochstenbach, Patrick (1999b) Reference Linking
in a Hybrid Library Environment: Part 3: Generalizing the SFX solution
in the "SFX@Ghent & SFX@LANL" experiment.
D-Lib Magazine, Vol. 5 No. 10, October
http://www.dlib.org/dlib/october99/van_de_sompel/10van_de_sompel.html
Hitchcock, S., Carr, L., Harris, S., Hey, J. M. N. and Hall, W.
(1997) Citation Linking: Improving Access to Online Journals. Proceedings
of the 2nd ACM International Conference on Digital Libraries, edited by
Robert B. Allen and Edie Rasmussen, 1997 (New York, USA: Association for
Computing Machinery), pp. 115-122
http://journals.ecs.soton.ac.uk/acmdl97.htm
Valauskas, Edward J. (1997) Waiting for Thomas Kuhn: First Monday and
the evolution of electronic journals. Journal of Electronic Publishing,
Vol. 3, No. 1, September
http://www.press.umich.edu/jep/03-01/FirstMonday.html
Dyson, Esther (1994) Intellectual Property on the Net. Release 1.0,
December
http://www.edventure.com/release1/1294.html
Harnad, S. (1998) On-Line Journals and Financial Fire-Walls. Nature,
395, September 10, 127-128
http://www.cogsci.soton.ac.uk/~harnad/nature.html
Morrow, Terry (1999) BIDS services now linked to Elsevier's ScienceDirect.
Message posted on lis-scitech listserv <lis-scitech@mailbase.ac.uk>,
27 September
http://www.mailbase.ac.uk/lists/lis-scitech/1999-09/0025.html
Doyle, Mark (1999) Re: PubMedCentral. Message posted on September 1998
American Scientist Forum listserv <SEPTEMBER98-FORUM@LISTSERVER.SIGMAXI.ORG>,
22 September
http://listserver.sigmaxi.org/scripts/wa.exe?A2=ind99&L=september98-forum&D=1&O=D&F=l&P=26434