Books are relevant outputs in research in Social Sciences and Humanities (SSH) and need to be considered properly in research evaluation. Books are different from journals and the scholarly book publishing sector remains quite unknown within evaluation agencies. This paper describes the state of the scholarly publishing sector, beyond the large publishing groups and imprints, focusing the attention to the role of small- and medium-sized scholarly publishers at the national level. Bibliodiversity and multilingualism are essential values for representing plural and diverse SSH research. They are also linked to societal impact. Academic Book Publishers project and Helsinki Initiative are described to this regard. Finally, some remarks and recommendations for addressing the assessment of books are provided.
Since monographs and edited books are essential communication media in Social Sciences and Humanities (SSH), they should be considered properly in research evaluation processes. Books are not outputs of second level in SSH research.
Books are different from journals, which means that specific knowledge on the book publishing ecosystem and editorial practices is needed for addressing their evaluation. In this sense, it is important:
Establishing stronger connections between the associations of scholarly publishers and research evaluation agencies. Boosting research on national academic book publishing landscapes.
SSH research may be locally oriented and therefore published in national languages through national journals and publishers. Academic books should be evaluated considering this relevant feature of SSH research. It entails:
Using complete publication data sources that reflect the diversity of scholarly publishers contributing to the dissemination of high quality research in SSH. Acknowledging the role of the small- and medium-sized, professional scholarly publishers which in each country take care of the publication of rigorous scholarly contents, closer related to local topics and written in national languages. Their role is complementary to that of the large imprints and publishing groups. Giving an adequate value to channels that allow for generating societal impact, especially to scholarly books (by local, regional and national publishers).
Indicators can be used properly only if they take into account the diversity of scholarly publishers and the characteristics of the publishing landscape.
Books are an integral part of the scientific communication in the Social Sciences and the Humanities (SSH hereafter). They are the natural space for much of the research carried out in those fields which, usually, do accumulate knowledge and hence, give rise to new advances (
Many indicators presented in various studies and developed in different periods underline the central role of books in the SSH. But before presenting data, an expressive analysis has to be done. A simple review of the catalogues of scholarly publishers shows that there are research topics which naturally adopt the form of books, which are ‘called to be’ books and which are not well adapted to other communication channels without losing their meaning or becoming superficial.
Consider the following subjects and publishers:
The titles from this list, including their treatment of topics, do not seem to be suited for publication as a journal article. Because of their approaches, chronological periods under study, depth and degree of analyses, and the amount of materials each will cover, they do not fit well with the structure of a scientific paper.
The book allows many SSH research topics to be covered through a state-of-the-art analysis, corresponding contextualization, the development of theories, detailed perspectives, with a reproduction and/or partial quotation of original information sources, including reproduced images or other graphic materials. According to Clemens et al. (1995), a book may be considered as a ‘genre’, restricted to few scholars, established and reputable researchers, with a long career, and representative, thus, of a certain ‘status’ in the discipline. Moreover, “The option of publishing books or using them as preferred sources in research is not a whimsical choice: it is a necessary choice which responds to the requirements of research in these areas” (
Some
SSH need a multiform communication system as a reflection of the diverse and plural nature of SSH and its object of research, in particular a system that acknowledges the multi-lingual nature of SSH.
Monographs and edited books are essential communication media in SSH, that are fit for purpose in the process of knowledge production in SSH.
Assessment of SSH research needs multi-dimensional research evaluation methods that do justice to the pluralist nature of SSH.
Several studies on the publication patterns have been showing for a long time ago that in the Social Sciences and the Humanities the publication of books, book chapters and articles in national scientific journals is fundamental, and numerically prominent (
More recently, an European study analyzing the publication patterns in eight different countries (
Since there is no CRIS at the national level, Spain did not participate in that study, but taking into account the data from the Spanish National Research Council -the largest research institution in the country- it can be observed that, for the SSH area in 2018 (
The data prove, once again, that a book holds weight in those fields. They also show that the publication patterns are intrinsically linked to the nature of the fields, and also that the evaluation policies can modify them only up to a certain degree, but are unable to change them in a fundamental way. Although publications in indexed scholarly journals have been prioritized in many countries, the few diachronic studies that exist on the weight of books in the scientific output of a country or region are conclusive. In a study concerning scientific production in Flanders (
Publication patterns show the relevance of the book in the SSH. Here, we reflect upon certain aspects of the publishing sector that support the publication of scholarly books, both at the national and international level, and which are the implications of that characterization for the research evaluation processes. The report
Roughly, without intending to present an exhaustive taxonomy of publishers, it can be said that the scholarly publishing sector is made up of: a) large publishing companies and scholarly imprints which are highly relevant in the international framework; b) university presses; c) big publishers at the national level or regional level; and d) small and medium-size independent publishers from each of the countries.
The report
University presses are a relatively heterogenous group, although in this taxonomy they are presented as a group since they are linked to a given university and, therefore, to its mission. They are present in all countries worldwide and publish in various languages about local, regional or international topics. There are very small publishers linked to small universities as well; middle-sized ones but with ambitious editorial projects and models; and large publishers, based on various publishing models, operation and funding schemes. To the latter group belong publishers such as Oxford University Press and Libros de la Universidad Nacional Autónoma de México (Books from the Autonomous National University of México).
Imprints such as Cátedra in Spain (Hachette Livre Group) or Fondo de Cultura Económica in Mexico are very relevant publishing projects in the Spanish-speaking area. Those are very consolidated and prestigious imprints in the region, they publish mainly in Spanish, are influential and have good distribution and marketing structures.
Finally, it is possible to distinguish a large group of scholarly publishers comprised of small and medium-sized private publishers, established in each country, which includes an heterogeneous set of publishing projects and business models but having some features in common: they publish in the language or languages of the country, usually focused on topics of local, regional and national interest, and they are nurtured by original works produced by researchers in the country. They make a significant contribution to the GDP.
In the case of Spain, scholarly books are 17% of all registered ISBN (Giménez-Toledo, 2017). In Colombia, the publications by University Presses represent 27.7% (
A review of this taxonomy is relevant for undertaking an evaluation of books, book series and/or publishers which constitute an important part of SSH outputs. Know the publishing sector of scholarly books is key in order to value the various types of scientific output, for establishing evaluation models, and for creating support tools (metrics, among others) in research evaluation processes. Lack of insight implies practically that there is going to be an adequate recognition for those books published by the large publishing companies with an international profile but not for the more national oriented and smallest ones.
The analysis of the publishers in which the humanists and social scientists publish their works offers a surprising vision, probably unknown to many science policy managers. It allows deepening into the scholarly publishing segment and its diversity, established not only as per the number of publishers, but also in terms of size, typology, catalogue features and publishing languages. It allows observing, in sum, the bibliodiversity and the diversity of topics and the plurality of approaches that it implies. Such bibliodiversity is an identity sign of the research carried out in the Humanities and the Social Sciences, since the objects of study can be addressed from multiple perspectives and approaches, with different methodologies, in different languages and on international, national and local topics. Scholarly books respond to all the aforementioned features.
Tanner (
Such bibliodiversity can be clearly observed in the data analysis carried out on some European Current Research Information Systems (CRIS). The publication channels used by researchers allow identifying a significantly varied publishing landscape: 203 publishers in Norway, 231 in Italy and 137 in Denmark.
A relevant example of the different publication profiles of the various publishers is provided by the study developed for the entire scholarly publishing activity in Spain (
Distribution Spanish of scholarly book production by segments (commercial publishers vs university presses) and field.
Source: Own elaboration for the Report on Spanish university publishing available at
Therefore, taking into account the differences between catalogues, the interest in preserving bibliodiversity becomes clear, as well as the need to recognize it in the processes of scholarly assessment. The leadership in the market of large commercial imprints should not diminish the function or recognition of the professional scholarly publishers which in each country take care of the publication of rigorous scholarly contents, closer to local topics and in national languages. Global and local research have different spaces when it comes to publishing. What is published in international publishers is not the same as what is published by national publishers, and does not reach the same readers. Furthermore, the publication of results in local, regional or national publishers can generate an impact in society which is impossible to reach for international publishers. Some of these ideas are pointed out by Sivertsen (
“Appendix B provides a full list of all the 1.180 uniquely named book publishers listed in the REF2014 Panel D submissions. The long list of publishers suggests that many of the works published may be relatively obscure in terms of scholarly retailing. This is borne out by closer inspection of works from publishers with only one book submitted in a subject. These books, whilst relating important research outputs, appear to have been published with smaller publishing houses for academic reasons spanning: regional, political, linguistic, research partner, economic, digital, OA and ideological considerations.” (
Being conscious of this issue, the project
All these publishers are nourished by the research results produced by humanists and social scientists in the various countries. Existing data show that there are contents for all of them, although not all with the same quality or relevance, of course. The analysis of catalogues also shows the differences in titles, foci and languages between each of them. The heterogeneity can be observed also in the publishing practices, the funding, dissemination and commercialization models, their professionalization and the adoption of digital technologies.
It is important to recognize their contribution to the preservation of the diverse and plural research in the humanities and social sciences, as well as to the transference of results to society. Both questions are linked to the existence of publishing structures in each country. All this is part of the claims of the Helsinki initiative on multilingualism in scientific communication (
The research topics and their potential audiences are conditioning factors when choosing a publication channel: books, journals and others, national or international. There are also factors related to the evaluation of the researcher, since not all publications have the same weight and, in many cases, priority is still given to indexed, international journals. Finally, the decision where to publish responds also to the researcher’s ethical principles and his or her engagement with society: the author must take care of making his or her research results available to those who need them. If necessary for the attainment of the aforementioned goal, the researcher would have to publish with a national publisher or even in a technical report. In such a case it should be guaranteed that such decision will not be penalized. After all, the researcher would be prioritizing the societal impact of the research over scholarly impact. Both forms of impact are compatible, although it is not always an easy task. For these reasons, science policies ought to be congruent: if they intend to make research reach society it is important to give an adequate value to the channels that allow that to happen, scholarly books and reports among them.
Documents such as the Leiden Manifesto (
Research evaluation based on expert judgements, complete publication data sources (covering the full set of the scholarly output) and using multidimensional methods are three fundamental and demandable keys in the evaluation of the scholarly activity nowadays. All three lead to a responsible evaluation with regards to those under evaluation (researchers and institutions) which live up to the dedicated, intensive and long term work which is the writing of a book, as well as to the publishing structures of each country, which support and enable the publication of research results. This implies, in the specific case of books, a greater connection between the associations of scholarly publishers in a given country and their scientific evaluation agencies, and a better knowledge of their respective action frameworks.
Carrying out research on the publishing sector at the national and international level is an essential step in the adequate assessment of the publishers. It allows the experts to include more precise information for decision making as well as to raise awareness on the work of the researchers and the publishing industry in keeping those publishing structures. Without knowing the national publishing sector, its working practices, specialization and catalogue features, it is not possible to carry out a fair evaluation nor to establish appropriate metrics.
Isolated metrics, without knowledge of the application context, can produce substantial errors in the evaluation. The amount of data provided by the digital environment for books -from reviews to sales, including also citations and downloads - are a temptation for data analysts and a huge risk if those data are not interpreted within the context of the characteristics of the publishing sector. For example, it is necessary to know that many small and medium-sized scholarly publishers have not begun a solid digital transition, which implies that their web visibility is limited, their books show little discoverability, are difficult to buy, download or read online. In this sense, little can be known about the circulation of their books or their impact. The metrics that can be obtained are insufficient. The reasons for not having developed that transition can be related to the lack of coordinated policies, lack of support for small publishers, and very limited capacities for investment in innovation. Without doubt, these are pending challenges. Their possibilities of competing, in every sense, with the large publishers are trivial. Nevertheless, they publish research books which are socially relevant (post-conflict in Colombia, femicide in Latin America or the resignification of places and historic memory, just to mention some examples). Therefore, there is a lack of actions which facilitate the visibility and accessibility of the bibliodiversity on internet. In order to counteract this weakness it would also be important to consider the world of scholarly publishing as a whole and not only the visible part of it (which is so for various types of reasons).
As pointed out by Engels et al. (
The evaluation of books based on the evaluation of the book publisher. The individualized evaluation of books does not seem to be feasible -at least in evaluation processes at the institutional level- because of the resources required and the amount of scientific output which has to be evaluated. Basing the evaluation on the publisher provides a specific value to the work of the publisher concerning the selection filters applied in what Calasso (
The evaluation of the publishers by expert panels or massive consultations to researchers, which implies the recognition of the publishers by their readers and authors.
The manuscript selection processes, not always based on traditional peer review used in scientific journals (
What has been learnt from the evaluation of scholarly journals is not completely applicable to the evaluation of books, series or scholarly publishers. The scholarly book sector and its publishing practices ought to be a specific object of study. By doing so not only would it be possible to understand the nature of what is published, but also the processes along which it is published. Both variables are essential in order to face the evaluation of this form of scholarly output with rigor and precision. By doing so, furthermore, a part of the cultural industry and, not less important, a plural research will be protected.
Data obtained from SPI Expanded
Publications and activities which generate societal value are contributions taken into account in the recently developed transference ‘sexenio’ (CNEAI 2019), an evaluation process for researchers which is focused on transference actions from research to society.
I would like to express my gratitude to Academic Book Publishers and Helsinki Initiative working groups within the ENRESSH COST Action 15137 and to Jorge Mañana Rodríguez for his help with the English version of this article. Thank you also to the reviewers for their valuable insights and suggestions.
EGT research during last past 5 years has have been funded by Spanish Ministry of Science and Innovation, Spanish Association of University Presses (UNE), Spanish Federation of Publishers (FGEE) and ENRESSH COST action. Beyond the research interest, competing interest does not exist.