Uses of Class
com.attivio.sdk.token.TokenList

Packages that use TokenList

Package	Description
com.attivio.sdk.ingest
com.attivio.sdk.server.tokenization	Interfaces class that handle breaking free text / Strings into TokenLists.
com.attivio.sdk.token
com.attivio.util

Uses of TokenList in com.attivio.sdk.ingest

Methods in com.attivio.sdk.ingest that return TokenList

Modifier and Type	Method and Description
TokenList	IngestFieldValue.getTokenList() Get the TokenList for this value.

Methods in com.attivio.sdk.ingest with parameters of type TokenList

Modifier and Type	Method and Description
void	IngestFieldValue.setTokenList(TokenList value) Set the TokenList for this value.

Uses of TokenList in com.attivio.sdk.server.tokenization

Methods in com.attivio.sdk.server.tokenization that return TokenList

Modifier and Type	Method and Description
TokenList	Tokenizer.tokenize(SchemaField field, Locale locale, String value) Tokenizes value into a TokenList.

Methods in com.attivio.sdk.server.tokenization with parameters of type TokenList

Modifier and Type	Method and Description
void	Tokenizer.tokenize(SchemaField field, Locale locale, TokenList tokens) Tokenizes all tokens in tokens.

Uses of TokenList in com.attivio.sdk.token

Fields in com.attivio.sdk.token declared as TokenList

Modifier and Type	Field and Description
protected TokenList	Position.tokens The TokenList this Position points into.

Methods in com.attivio.sdk.token that return TokenList

Modifier and Type	Method and Description
TokenList	TokenList.append(String t) Appends a token to this TokenList using the default position increment.
TokenList	TokenList.append(String t, int increment) Appends a token.
TokenList	TokenList.append(Token t) Appends a token using the default position increment.
TokenList	TokenList.append(Token t, int increment) Appends a token.
TokenList	TokenList.clone()
TokenList	TokenList.readExternal(DataInput in)
static TokenList	TokenList.valueOf(String value) Parses the string representation of a TokenList back into a TokenList

Methods in com.attivio.sdk.token with parameters of type TokenList

Modifier and Type	Method and Description
void	TokenSink.add(TokenList tokens) Adds all Tokens for the passed in TokenList to this TokenList.
void	TokenSink.add(TokenList tokens, int increment) Adds all Tokens for the passed in TokenList

Constructors in com.attivio.sdk.token with parameters of type TokenList

Constructor and Description
TokenIterator(TokenList tokens) Constructor

Uses of TokenList in com.attivio.util

Methods in com.attivio.util that return TokenList

Modifier and Type	Method and Description
static TokenList	TokenUtils.filterTokens(IngestFieldValue value, Locale locale) Get all tokens for locale.

Methods in com.attivio.util with parameters of type TokenList

Modifier and Type	Method and Description
static List<String>	TokenUtils.extractScopes(String scopeName, TokenList tokens, String text) Extract substrings of text for scopeName from tokens.