Machine translation

Byte-Pair Encoding (BPE)

Data compression algorithm adapted for subword tokenization, creating an optimal vocabulary by iteratively merging the most frequent symbol pairs.

← Wstecz