advanced
Multilingual Text Processing Pipeline
Build a pipeline for processing text across multiple languages
📝 Prompt Content
Develop a comprehensive text processing system that handles 50+ languages with varying script complexities. Include language detection, tokenization, and language-specific normalization. All text in it should be processed regardless of script directionality or morphological complexity.