Apache Solr Reference Guide Covering Apache Solr 6.0

In: "babaloo"
Out:"ba", "bab", "baba", "babal"
Example:
Edge n-gram range of 2 to 5, from the back side:
In: "babaloo"
Out: "oo", "loo", "aloo", "baloo"
ICU Tokenizer
This tokenizer processes multilingual text and tokenizes it appropriately based on its script attribute.
You can customize this tokenizer's behavior by specifying per-script rule files. To add per-script rules, add a rul
efiles argument, which should contain a comma-separated list of code:rulefile pairs in the following
format: four-letter ISO 15924 script code, followed by a colon, then a resource path. For example, to specify rules
for Latin (script code "Latn") and Cyrillic (script code "Cyrl"), you would enter Latn:my.Latin.rules.rbbi,C
yrl:my.Cyrillic.rules.rbbi.
The default solr.ICUTokenizerFactory provides UAX#29 word break rules tokenization (like solr.Stand
ardTokenizer), but also includes custom tailorings for Hebrew (specializing handling of double and single
quotation marks), and for syllable tokenization for Khmer, Lao, and Myanmar.
Factory class: solr.ICUTokenizerFactory
Arguments:
rulefile: a comma-separated list of code:rulefile pairs in the following format: four-letter ISO 15924 script
code, followed by a colon, then a resource path.
Example:
Apache Solr Reference Guide 6.0
113