Criteria for resource evaluation

Team Leaders : Franck Neveu, Christophe Parisse

Assembling resources s nowadays, one of the major projects undertaken by many researchers and laboratories – their production having a direct impact on the structuring of research and the division of scientific work. The development of such practices and the growing reliance on data in scientific argumentation – whether in the construction of observable facts or the testing of hypotheses – entails integrating their output into the results of research units. If the collection of usable resources is necessary for certain operating modes and for several disciplinary fields in linguistics, the building of corpora represents, above all, a full-fledged research activity. The question of resource evaluation criteria calls for thoughtful data storage, but also allows research to progress with a perspective of transparency and reusability of data.

In this light, the piloting committee of the CORLI group organized, on September 23, 2016, a workshop on corpora evaluation. This workshop was an opportunity to discuss and reflect on criteria for resource evaluation.


  • Franck Neveu – Corpus evaluation and research evaluation institutions
  • Christophe Parisse – Why deposit corpora?
  • Jean-Marie Pierrel – Why evaluate corpus quality?
  • Thierry Chanier – General quality criteria for research data. Application to corpora in linguistics
  • Michel Jacobson – How to describe a corpus for archiving purposes?
  • Olivier Baude – Evaluating corpora quality? Why? How?
  • Carole Etienne – Interoperability and metadata: what is needed in a research project?

On October 3, 2019, CORLI organized a workshop dedicated to corpora evaluation. This theme is particularly important today, first because it contributes to a better evaluation of the work done today in linguistics, and second because it opens linguistics to the dissemination and sharing of research data as do many other disciplines (FAIR movement).

The workshop included presentations from Helene Andreassen (Norway), Gabriel Bergounioux, Bernard Laks, François Rastier, Mathieu Valette, who represent a large portion of the organizations involved in the evaluation of research, in particular research in corpus linguistics.