BERT et ses Variantes

TinyBERT

Ultra-compact version of BERT reducing parameters up to 7.5 times while maintaining high performance. Applies bidirectional distillation and multi-level attention for compression.

← Back