Package org.apache.lucene.analysis.cz
Class CzechAnalyzer
- java.lang.Object
-
- org.apache.lucene.analysis.Analyzer
-
- org.apache.lucene.analysis.ReusableAnalyzerBase
-
- org.apache.lucene.analysis.cz.CzechAnalyzer
-
- All Implemented Interfaces:
Closeable,AutoCloseable
public final class CzechAnalyzer extends org.apache.lucene.analysis.ReusableAnalyzerBaseAnalyzerfor Czech language.Supports an external list of stopwords (words that will not be indexed at all). A default set of stopwords is used unless an alternative list is specified.
You must specify the required
Versioncompatibility when creating CzechAnalyzer:- As of 3.1, words are stemmed with
CzechStemFilter - As of 2.9, StopFilter preserves position increments
- As of 2.4, Tokens incorrectly identified as acronyms are corrected (see LUCENE-1068)
-
-
Field Summary
Fields Modifier and Type Field Description static String[]CZECH_STOP_WORDSDeprecated.usegetDefaultStopSet()insteadstatic StringDEFAULT_STOPWORD_FILEFile containing default Czech stopwords.
-
Constructor Summary
Constructors Constructor Description CzechAnalyzer(org.apache.lucene.util.Version matchVersion)Builds an analyzer with the default stop words (getDefaultStopSet()).CzechAnalyzer(org.apache.lucene.util.Version matchVersion, File stopwords)Deprecated.useCzechAnalyzer(Version, Set)insteadCzechAnalyzer(org.apache.lucene.util.Version matchVersion, String... stopwords)Deprecated.useCzechAnalyzer(Version, Set)insteadCzechAnalyzer(org.apache.lucene.util.Version matchVersion, HashSet<?> stopwords)Deprecated.useCzechAnalyzer(Version, Set)insteadCzechAnalyzer(org.apache.lucene.util.Version matchVersion, Set<?> stopwords)Builds an analyzer with the given stop words.CzechAnalyzer(org.apache.lucene.util.Version matchVersion, Set<?> stopwords, Set<?> stemExclusionTable)Builds an analyzer with the given stop words and a set of work to be excluded from theCzechStemFilter.
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Deprecated Methods Modifier and Type Method Description protected org.apache.lucene.analysis.ReusableAnalyzerBase.TokenStreamComponentscreateComponents(String fieldName, Reader reader)CreatesReusableAnalyzerBase.TokenStreamComponentsused to tokenize all the text in the providedReader.static Set<?>getDefaultStopSet()Returns a set of default Czech-stopwordsvoidloadStopWords(InputStream wordfile, String encoding)Deprecated.useWordlistLoader.getWordSet(Reader, String, Version)andCzechAnalyzer(Version, Set)instead-
Methods inherited from class org.apache.lucene.analysis.ReusableAnalyzerBase
initReader, reusableTokenStream, tokenStream
-
-
-
-
Field Detail
-
CZECH_STOP_WORDS
@Deprecated public static final String[] CZECH_STOP_WORDS
Deprecated.usegetDefaultStopSet()insteadList of typical stopwords.
-
DEFAULT_STOPWORD_FILE
public static final String DEFAULT_STOPWORD_FILE
File containing default Czech stopwords.- See Also:
- Constant Field Values
-
-
Constructor Detail
-
CzechAnalyzer
public CzechAnalyzer(org.apache.lucene.util.Version matchVersion)
Builds an analyzer with the default stop words (getDefaultStopSet()).- Parameters:
matchVersion- Lucene version to match See {@link above}
-
CzechAnalyzer
public CzechAnalyzer(org.apache.lucene.util.Version matchVersion, Set<?> stopwords)Builds an analyzer with the given stop words.- Parameters:
matchVersion- Lucene version to match See {@link above}stopwords- a stopword set
-
CzechAnalyzer
public CzechAnalyzer(org.apache.lucene.util.Version matchVersion, Set<?> stopwords, Set<?> stemExclusionTable)Builds an analyzer with the given stop words and a set of work to be excluded from theCzechStemFilter.- Parameters:
matchVersion- Lucene version to match See {@link above}stopwords- a stopword setstemExclusionTable- a stemming exclusion set
-
CzechAnalyzer
@Deprecated public CzechAnalyzer(org.apache.lucene.util.Version matchVersion, String... stopwords)
Deprecated.useCzechAnalyzer(Version, Set)insteadBuilds an analyzer with the given stop words.- Parameters:
matchVersion- Lucene version to match See {@link above}stopwords- a stopword set
-
CzechAnalyzer
@Deprecated public CzechAnalyzer(org.apache.lucene.util.Version matchVersion, HashSet<?> stopwords)
Deprecated.useCzechAnalyzer(Version, Set)insteadBuilds an analyzer with the given stop words.- Parameters:
matchVersion- Lucene version to match See {@link above}stopwords- a stopword set
-
CzechAnalyzer
@Deprecated public CzechAnalyzer(org.apache.lucene.util.Version matchVersion, File stopwords) throws IOException
Deprecated.useCzechAnalyzer(Version, Set)insteadBuilds an analyzer with the given stop words.- Parameters:
matchVersion- Lucene version to match See {@link above}stopwords- a file containing stopwords- Throws:
IOException
-
-
Method Detail
-
getDefaultStopSet
public static final Set<?> getDefaultStopSet()
Returns a set of default Czech-stopwords- Returns:
- a set of default Czech-stopwords
-
loadStopWords
@Deprecated public void loadStopWords(InputStream wordfile, String encoding)
Deprecated.useWordlistLoader.getWordSet(Reader, String, Version)andCzechAnalyzer(Version, Set)insteadLoads stopwords hash from resource stream (file, database...).- Parameters:
wordfile- File containing the wordlistencoding- Encoding used (win-1250, iso-8859-2, ...), null for default system encoding
-
createComponents
protected org.apache.lucene.analysis.ReusableAnalyzerBase.TokenStreamComponents createComponents(String fieldName, Reader reader)
CreatesReusableAnalyzerBase.TokenStreamComponentsused to tokenize all the text in the providedReader.- Specified by:
createComponentsin classorg.apache.lucene.analysis.ReusableAnalyzerBase- Returns:
ReusableAnalyzerBase.TokenStreamComponentsbuilt from aStandardTokenizerfiltered withStandardFilter,LowerCaseFilter,StopFilter, andCzechStemFilter(only if version is >= LUCENE_31). If a version is >= LUCENE_31 and a stem exclusion set is provided viaCzechAnalyzer(Version, Set, Set)aKeywordMarkerFilteris added beforeCzechStemFilter.
-
-