Uses of Class
org.apache.lucene.analysis.TokenFilter
-
Packages that use TokenFilter Package Description org.apache.lucene.analysis API and code to convert text into indexable/searchable tokens.org.apache.lucene.analysis.standard Standards-based analyzers implemented with JFlex.org.apache.lucene.collation CollationKeyFilterconverts each token into its binaryCollationKeyusing the providedCollator, and then encode theCollationKeyas a String usingIndexableBinaryStringTools, to allow it to be stored as an index term. -
-
Uses of TokenFilter in org.apache.lucene.analysis
Subclasses of TokenFilter in org.apache.lucene.analysis Modifier and Type Class Description classASCIIFoldingFilterThis class converts alphabetic, numeric, and symbolic Unicode characters which are not in the first 127 ASCII characters (the "Basic Latin" Unicode block) into their ASCII equivalents, if one exists.classCachingTokenFilterThis class can be used if the token attributes of a TokenStream are intended to be consumed more than once.classFilteringTokenFilterAbstract base class for TokenFilters that may remove tokens.classISOLatin1AccentFilterDeprecated.If you build a new index, useASCIIFoldingFilterwhich covers a superset of Latin 1.classKeywordMarkerFilterMarks terms as keywords via theKeywordAttribute.classLengthFilterRemoves words that are too long or too short from the stream.classLimitTokenCountFilterThis TokenFilter limits the number of tokens while indexing.classLowerCaseFilterNormalizes token text to lower case.classPorterStemFilterTransforms the token stream as per the Porter stemming algorithm.classStopFilterRemoves stop words from a token stream.classTeeSinkTokenFilterThis TokenFilter provides the ability to set aside attribute states that have already been analyzed.classTypeTokenFilterRemoves tokens whose types appear in a set of blocked types from a token stream. -
Uses of TokenFilter in org.apache.lucene.analysis.standard
Subclasses of TokenFilter in org.apache.lucene.analysis.standard Modifier and Type Class Description classClassicFilterNormalizes tokens extracted withClassicTokenizer.classStandardFilterNormalizes tokens extracted withStandardTokenizer. -
Uses of TokenFilter in org.apache.lucene.collation
Subclasses of TokenFilter in org.apache.lucene.collation Modifier and Type Class Description classCollationKeyFilterConverts each token into itsCollationKey, and then encodes the CollationKey withIndexableBinaryStringTools, to allow it to be stored as an index term.
-