In the empirical chapters of this PhD thesis Following the Footnotes, Björn Hammarfelt tries out several methodological innovations. In a particularly interesting chapter, Hammarfelt traces the citations to one book, Illuminations by Walter Benjamin, and he tries to map the disciplines that cite the book. But he goes further and even teases out the specific parts of the book that are cited. He calls it Page Citation Analysis which basically is a form of Citation Context Analysis as proposed by Suzan Cozzens (1985). Alternatively, one could see this as going back to the very old philological tradition which was also engaged with the precise location of particular textual phenomena. Historically, bibliometrics is humanities research. In a preceding chapter, Hammarfelt analyzes the intellectual base of literary studies by analyzing the references from 34 literature journals. The way he collected these journals is interesting because he departed from the point of view of the literary researcher (and not the available database, a mistake often made in bibliometrics). He advocates the mixed use of citation analysis and library classifications, also an issue underdeveloped in the field of bibliometrics. Another interesting innovation is in the last empirical chapter where Hammarfelt analyzes research grants and compares them with journal publications. He argues that research grants are increasingly important in the life of a scholar and hence it would make sense to use them much more as a data source. He also notes the partly different role of references in grants compared to journal articles.
The various analyses in Hammarfelts thesis confirm what we generally know about the humanities as a set of disciplines. He tries to characterize the nature of the humanities by drawing upon theories from the sociology of science, in particular the theories that try to explain the social structure as well as the intellectual structure of working practices and communication patterns in these fields. His theoretical exposé focuses on the theories proposed by Richard Whitley and Becher and Trowler, but he also uses various theories that can be captured under the umbrella of “mode 2 knowledge production”.
Hammarfelt’s thesis confirms that the humanities can be characterized as divergent (rather than convergent), as very wide ranging and interdisciplinary (proven by the reference analysis performed by Hammarfelt), as rural in the sense of sparsely populated villages of researchers focusing on a particular topic (rather than busy laboratories that are more like bustling cities), and as fragmented (scholars are quite independent of each other which gives them a lot of freedom, but also makes it more difficult to speak with a common voice regarding resources). The interdisciplinary nature of literary studies seems to be rising, and Hammarfelt even detects a turn to the social, because he sees more connections between the humanities and specific fields in the social sciences such as gender studies, and post-colonial studies. So there might be a social turn after the linguistic turn some decades ago. Overall, the thesis concludes that three features are most important to understand referencing and citations in the humanities: the strong independence of humanities scholars; the rural organization; and the diverse audiences of the fields. The latter goes together with a rather low codification of the literature because it needs to be understood by a wide range of people.
What does this mean for the ways humanities scholars are being assessed in evaluation protocols? This topic is discussed in a variety of ways in the thesis. In the last part, Hammarfelt brings it together with a sketch of how bibliometrics could further develop to be of use in this more policical sense. He advocates a role here, because bibliometrics can help unsettle existing power structures, like the lack of diversity in the universities. He specifically mentions the gender bias, the need to support interdisciplinary research, and the problems with the current peer review systems. But bibliometrics needs to change in order to play this role.
Cozzens, S. E. (1985). Comparing the Sciences: Citation Context Analysis of Papers from Neuropharmacology and the Sociology of Science. Social Studies of Science, 15, 127-153.