flair.tokenization.TokenizerWrapper#
- class flair.tokenization.TokenizerWrapper(tokenizer_func)View on GitHub#
Bases:
Tokenizer
Helper class to wrap tokenizer functions to the class-based tokenizer interface.
- __init__(tokenizer_func)View on GitHub#
Methods
__init__
(tokenizer_func)tokenize
(text)Attributes
- tokenize(text)View on GitHub#
- Return type:
list
[str
]
- property name: str#