flair.tokenization.SpacyTokenizer#
- class flair.tokenization.SpacyTokenizer(model)View on GitHub#
Bases:
Tokenizer
Tokenizer using spacy under the hood.
- Parameters:
model – a Spacy V2 model or the name of the model to load.
- __init__(model)View on GitHub#
Methods
__init__
(model)tokenize
(text)Attributes
- tokenize(text)View on GitHub#
- Return type:
list
[str
]
- property name: str#