Skip to main navigation Skip to search Skip to main content

Evaluating Subword Tokenization: Alien Subword Composition and OOV Generalization Challenge

  • Khuyagbaatar Batsuren
  • , Ekaterina Vylomova
  • , Verna Dankers
  • , Tsetsuukhei Delgerbaatar
  • , Omri Uzan
  • , Yuval Pinter
  • , Gábor Bella

Research output: Working paper/PreprintPreprint

2 Downloads (Pure)

Fingerprint

Dive into the research topics of 'Evaluating Subword Tokenization: Alien Subword Composition and OOV Generalization Challenge'. Together they form a unique fingerprint.
Sort by

Computer Science

Keyphrases