Criteria for resource evaluation

Team Leaders : Franck Neveu, Christophe Parisse

Assembling resources is, today, one of the major projects undertaken by many researchers and laboratories – building them has a direct effect on the structure of research and the division of scientific work. The development of such practices and the growing reliance on data in scientific argumentation – whether in the construction of observable facts or the testing of hypotheses – entails integrating their output into the results of research units. If the collection of usable resources is necessary for certain modes of operating and for several disciplinary fields in linguistics, the building of corpora represents, above all, a mode of research that is in full-swing. The question of criteria for the evaluation of resources calls for thoughtful data storage, but also allows research to progress with transparency and reusability of data in mind. In this light, the piloting committee of the CORLI group organized, on September 23, 2016, a workshop on the evaluation of corpora. The workshop was a field of exchange and reflections regarding the criteria for the evaluation of resources.

  • Participants:
  • Franck Neveu – Evaluation des corpus et institutions d’évaluation de la recherche
  • Christophe Parisse – Pourquoi déposer ses corpus ? Jean-Marie Pierrel – Pourquoi évaluer la qualité d’un corpus ?
  • Thierry Chanier – Critères de qualité pour les données de la recherche en général. Transposition aux corpus en linguistique
  • Michel Jacobson – Comment décrire un corpus à des fins d’archivage ?
  • Olivier Baude – Évaluer la qualité des corpus ? Pourquoi ? Comment ?
  • Carole Etienne – Interopérabilité et métadonnés quels besoins dans un projet de recherche

On October 3, 2019, CORLI organized a workshop dedicated to corpora evaluation. This theme is particularly important today, in part because it contributes to improved evaluation of work done today in linguistics, and in part because it opens linguistics up to the sharing of research data as is done in numerous other disciplines (the FAIR movement).
The workshop took place at the Université Paris Diderot, Bâtiment Olympe de Gouges (8 place Paul Ricœur, 75013 Paris) in the salle Laplanche, on the fifth floor.
The workshop included presentations from Helene Andreassen (Norway), Gabriel Bergounioux, Bernard Laks, François Rastier, Mathieu Valette, who represent a large portion of the organizations involved in the evaluation of research, in particular research in corpus linguistics.