About this paper

Uses statistically informative subword patterns as building blocks for word representations and neural language modeling.

A regularized pattern-based CRF selects subwords that capture character n-gram structure. Language models built from these patterns are compared with character-based approaches, including a simple sum-of-embeddings architecture.