public final class PersianAnalyzer
extends org.apache.lucene.analysis.StopwordAnalyzerBase
Analyzer for Persian.
This Analyzer uses ArabicLetterTokenizer which implies tokenizing around
zero-width non-joiner in addition to whitespace. Some persian-specific variant forms (such as farsi
yeh and keheh) are standardized. "Stemming" is accomplished via stopwords.
| Modifier and Type | Field and Description |
|---|---|
static String |
DEFAULT_STOPWORD_FILE
File containing default Persian stopwords.
|
static String |
STOPWORDS_COMMENT
The comment character in the stopwords file.
|
| Constructor and Description |
|---|
PersianAnalyzer(org.apache.lucene.util.Version matchVersion)
Builds an analyzer with the default stop words:
DEFAULT_STOPWORD_FILE. |
PersianAnalyzer(org.apache.lucene.util.Version matchVersion,
File stopwords)
Deprecated.
use
PersianAnalyzer(Version, Set) instead |
PersianAnalyzer(org.apache.lucene.util.Version matchVersion,
Hashtable<?,?> stopwords)
Deprecated.
use
PersianAnalyzer(Version, Set) instead |
PersianAnalyzer(org.apache.lucene.util.Version matchVersion,
Set<?> stopwords)
Builds an analyzer with the given stop words
|
PersianAnalyzer(org.apache.lucene.util.Version matchVersion,
String... stopwords)
Deprecated.
use
PersianAnalyzer(Version, Set) instead |
| Modifier and Type | Method and Description |
|---|---|
protected org.apache.lucene.analysis.ReusableAnalyzerBase.TokenStreamComponents |
createComponents(String fieldName,
Reader reader)
Creates
ReusableAnalyzerBase.TokenStreamComponents
used to tokenize all the text in the provided Reader. |
static Set<?> |
getDefaultStopSet()
Returns an unmodifiable instance of the default stop-words set.
|
protected Reader |
initReader(Reader reader)
Wraps the Reader with
PersianCharFilter |
getStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSetreusableTokenStream, tokenStreampublic static final String DEFAULT_STOPWORD_FILE
public static final String STOPWORDS_COMMENT
public PersianAnalyzer(org.apache.lucene.util.Version matchVersion)
DEFAULT_STOPWORD_FILE.public PersianAnalyzer(org.apache.lucene.util.Version matchVersion,
Set<?> stopwords)
matchVersion - lucene compatibility versionstopwords - a stopword set@Deprecated public PersianAnalyzer(org.apache.lucene.util.Version matchVersion, String... stopwords)
PersianAnalyzer(Version, Set) instead@Deprecated public PersianAnalyzer(org.apache.lucene.util.Version matchVersion, Hashtable<?,?> stopwords)
PersianAnalyzer(Version, Set) instead@Deprecated public PersianAnalyzer(org.apache.lucene.util.Version matchVersion, File stopwords) throws IOException
PersianAnalyzer(Version, Set) insteadSTOPWORDS_COMMENTIOExceptionpublic static Set<?> getDefaultStopSet()
protected org.apache.lucene.analysis.ReusableAnalyzerBase.TokenStreamComponents createComponents(String fieldName, Reader reader)
ReusableAnalyzerBase.TokenStreamComponents
used to tokenize all the text in the provided Reader.createComponents in class org.apache.lucene.analysis.ReusableAnalyzerBaseReusableAnalyzerBase.TokenStreamComponents
built from a StandardTokenizer filtered with
LowerCaseFilter, ArabicNormalizationFilter,
PersianNormalizationFilter and Persian Stop wordsprotected Reader initReader(Reader reader)
PersianCharFilterinitReader in class org.apache.lucene.analysis.ReusableAnalyzerBaseCopyright © 2000-2015 Apache Software Foundation. All Rights Reserved.