## engine.TokenFilter


Create an iterable lucene TokenFilter from a TokenStream.


Usage

``` python
engine.TokenFilter(input)
```


Subclass and override \[incrementToken\]\[lupyne.engine.analyzers.TokenFilter.incrementToken\].


## Methods

| Name | Description |
|----|----|
| [incrementToken()](#incrementToken) | Advance to next token and return whether the stream is not empty. |

------------------------------------------------------------------------


#### incrementToken()


Advance to next token and return whether the stream is not empty.


Usage

``` python
incrementToken()
```
