Uses of Interface
com.attivio.sdk.server.tokenization.Tokenizer

Packages that use Tokenizer

Package	Description
com.attivio.sdk.server.tokenization	Interfaces class that handle breaking free text / Strings into TokenLists.

Uses of Tokenizer in com.attivio.sdk.server.tokenization

Methods in com.attivio.sdk.server.tokenization that return Tokenizer

Modifier and Type	Method	Description
default Tokenizer	Tokenizer.getIngestTokenizer(SchemaField field, java.util.Locale locale)	Get the underlying tokenizer to use for tokenizing fields in the ingest workflow.
default Tokenizer	Tokenizer.getQueryTokenizer(SchemaField field, java.util.Locale locale)	Get the underlaying tokenizer to use for tokenizing fields in the query workflow.