flair.tokenization.TokenizerWrapper

class flair.tokenization.TokenizerWrapper(tokenizer_func)View on GitHub

Bases: Tokenizer

Helper class to wrap tokenizer functions to the class-based tokenizer interface.

__init__(tokenizer_func)View on GitHub

Methods

__init__(tokenizer_func)
tokenize(text)

Attributes

name

tokenize(text)View on GitHub

Return type:

list[str]

property name: str