Measuring Inter-Annotator Agreement: Building Trustworthy Datasets
If the data annotations do not match between different annotators, it can affect the accuracy of the model results. These datasets must be accurate because they directly affect AI systems' performance. Studying the agreement between annotators helps not only to improve learning models but also to make artificial intelligence