gnes.preprocessor.text.split module

class gnes.preprocessor.text.split.SentSplitPreprocessor(min_sent_len=1, max_sent_len=256, deliminator='.!?。！？', is_json=False, *args, **kwargs)[source]

Bases: gnes.preprocessor.base.BaseTextPreprocessor

apply(doc)[source]
Return type:None
train(*args, **kwargs)

Train the model, need to be overrided