Active Learning with Multiple Annotators

Inter-annotator Confidence Matrix

Data structure measuring the relative consistency and reliability between annotations from different contributors on similar samples. It enables the detection of systematic disagreements and adjusts confidence weights for final label aggregation.

← Wstecz