Closeable
, AutoCloseable
, Readable
CharFilter
, CharReader
, MockCharFilter
public abstract class CharStream extends Reader
correctOffset(int)
functionality over Reader
. All Tokenizers accept a
CharStream instead of Reader
as input, which enables
arbitrary character based filtering before tokenization.
The correctOffset(int)
method fixed offsets to account for
removal or insertion of characters, so that the offsets
reported in the tokens match the character offsets of the
original Reader.Constructor | Description |
---|---|
CharStream() |
Modifier and Type | Method | Description |
---|---|---|
abstract int |
correctOffset(int currentOff) |
Called by CharFilter(s) and Tokenizer to correct token offset.
|
Copyright © 2000-2018 Apache Software Foundation. All Rights Reserved.