Skip to content
Snippets Groups Projects
Commit 755164cd authored by Maja Jablonska's avatar Maja Jablonska
Browse files

Add SentenceSplitter

parent 26afe8e7
Branches
Tags
1 merge request!46Merge COMBO 3.0 into master
Hide whitespace changes
Inline Side-by-side
combo/data/tokenizers/sentence_splitter.py
+ 0
− 1
View file @ 755164cd
...@@ -29,7 +29,6 @@ class SentenceSplitter: ...@@ -29,7 +29,6 @@ class SentenceSplitter:
return [self.split_sentences(text) for text in texts] return [self.split_sentences(text) for text in texts]
@SentenceSplitter.register("spacy")
class SpacySentenceSplitter(SentenceSplitter): class SpacySentenceSplitter(SentenceSplitter):
""" """
A `SentenceSplitter` that uses spaCy's built-in sentence boundary detection. A `SentenceSplitter` that uses spaCy's built-in sentence boundary detection.
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment