public final class NGramTokenFilter extends TokenFilter
AttributeSource.AttributeFactory, AttributeSource.State| Modifier and Type | Field and Description |
|---|---|
static int |
DEFAULT_MAX_NGRAM_SIZE |
static int |
DEFAULT_MIN_NGRAM_SIZE |
input| Constructor and Description |
|---|
NGramTokenFilter(TokenStream input)
Creates NGramTokenFilter with default min and max n-grams.
|
NGramTokenFilter(TokenStream input,
int minGram,
int maxGram)
Creates NGramTokenFilter with given min and max n-grams.
|
| Modifier and Type | Method and Description |
|---|---|
boolean |
incrementToken()
Returns the next token in the stream, or null at EOS.
|
void |
reset()
Reset the filter as well as the input TokenStream.
|
close, endaddAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState, toStringpublic static final int DEFAULT_MIN_NGRAM_SIZE
public static final int DEFAULT_MAX_NGRAM_SIZE
public NGramTokenFilter(TokenStream input, int minGram, int maxGram)
input - TokenStream holding the input to be tokenizedminGram - the smallest n-gram to generatemaxGram - the largest n-gram to generatepublic NGramTokenFilter(TokenStream input)
input - TokenStream holding the input to be tokenizedpublic final boolean incrementToken()
throws IOException
incrementToken in class TokenStreamIOExceptionpublic void reset()
throws IOException
TokenFilterreset in class TokenFilterIOExceptionCopyright © 2000-2015 Apache Software Foundation. All Rights Reserved.