To check the quality of annotations, it is essential to evaluate the inter-annotator agreement. To do this, we compare the annotations of multiple annotators to whom we have submitted the same data. The most common measure used to evaluate inter-annotator agreement is Cohen’s Kappa.