Uses of Class
com.attivio.sdk.token.TokenList

Packages that use TokenList

Package	Description
com.attivio.sdk.ingest
com.attivio.sdk.server.tokenization	Interfaces class that handle breaking free text / Strings into TokenLists.
com.attivio.sdk.test
com.attivio.sdk.token	Copyright 2019 Attivio Inc., All rights reserved.
com.attivio.util	Contains utility classes and methods used across the Attivio code base.

Uses of TokenList in com.attivio.sdk.ingest

Methods in com.attivio.sdk.ingest that return TokenList

Modifier and Type	Method	Description
TokenList	IngestFieldValue.getTokenList()	Get the TokenList for this value.

Methods in com.attivio.sdk.ingest with parameters of type TokenList

Modifier and Type	Method	Description
void	IngestFieldValue.setTokenList(TokenList value)	Set the TokenList for this value.

Uses of TokenList in com.attivio.sdk.server.tokenization

Methods in com.attivio.sdk.server.tokenization that return TokenList

Modifier and Type	Method	Description
default TokenList	Tokenizer.tokenize(SchemaField field, java.util.Locale locale, java.lang.String value)	Tokenizes value into a TokenList.

Methods in com.attivio.sdk.server.tokenization with parameters of type TokenList

Modifier and Type	Method	Description
void	Tokenizer.tokenize(SchemaField field, java.util.Locale locale, TokenList tokens)	Tokenizes all tokens in tokens.

Uses of TokenList in com.attivio.sdk.test

Methods in com.attivio.sdk.test with parameters of type TokenList

Modifier and Type	Method	Description
static TokenListAssert	SdkAssert.assertThat(TokenList tokens)	Create a TokenListAssert for asserting attributes of actual.
static TokenListAssert	TokenListAssert.assertThat(TokenList actual)	Create a TokenListAssert for asserting attributes of actual.
TokenListAssert	TokenListAssert.equals(TokenList expected)	Assert that the token list equals expected.
TokenListAssert	TokenListAssert.isTokenized(TokenList expected)	Assert that all tokens are marked as TokenAnnotation.TOKENIZED and the token list equals expected.

Uses of TokenList in com.attivio.sdk.token

Fields in com.attivio.sdk.token declared as TokenList

Modifier and Type	Field	Description
protected TokenList	Position.tokens	The TokenList this Position points into.

Methods in com.attivio.sdk.token that return TokenList

Modifier and Type	Method	Description
TokenList	TokenList.append(Token t)	Appends a token using the default position increment.
TokenList	TokenList.append(Token t, int increment)	Appends a token.
TokenList	TokenList.append(java.lang.String t)	Appends a token to this TokenList using the default position increment.
TokenList	TokenList.append(java.lang.String t, int increment)	Appends a token.
TokenList	TokenList.clone()
TokenList	TokenList.readExternal(java.io.DataInput in)	GWT Incompatible - hence no @Override annotation.
static TokenList	TokenList.valueOf(java.lang.String value)	Parses the string representation of a TokenList back into a TokenList
static TokenList	TokenList.valueOf(java.lang.String... value)	Parses the string representation of a TokenList back into a TokenList

Methods in com.attivio.sdk.token with parameters of type TokenList

Modifier and Type	Method	Description
void	TokenSink.add(TokenList tokens)	Adds all Tokens for the passed in TokenList to this TokenList.
void	TokenSink.add(TokenList tokens, int increment)	Adds all Tokens for the passed in TokenList
Token	TokenEnum.reset(TokenList tokens)	Position this TokenEnum at the beginning of tokens.

Constructors in com.attivio.sdk.token with parameters of type TokenList

Constructor	Description
TokenIterator(TokenList tokens)	Constructor

Uses of TokenList in com.attivio.util

Methods in com.attivio.util that return TokenList

Modifier and Type	Method	Description
static TokenList	TokenUtils.filterTokens(IngestFieldValue value, java.util.Locale locale)	Get all tokens for locale.

Methods in com.attivio.util with parameters of type TokenList

Modifier and Type	Method	Description
static java.util.List<java.lang.String>	TokenUtils.extractScopes(java.lang.String scopeName, TokenList tokens, java.lang.String text)	Extract substrings of text for scopeName from tokens.