Add an option to ignore turns in text segmentation (142eead6) · Commits · Syntactic Tools / combo · GitLab

Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

C

combo
- Activity
- Members
- Labels
- Issues
  20
- Issue boards
- Milestones
- Wiki
- Redmine
- Releases
- Container Registry
- Environments
- Incidents

Snippets Groups Projects

142eead6

Commit 142eead6 authored 1 year ago by

Maja Jablonska

Downloads
- Patches
- Plain Diff

Add an option to ignore turns in text segmentation

parent 1e1002f5

Branches

Changes 3

Hide whitespace changes

Inline Side-by-side

Showing

combo/data/tokenizers/lambo_tokenizer.py 10 additions, 3 deletions

combo/data/tokenizers/lambo_tokenizer.py
combo/main.py 5 additions, 3 deletions

combo/main.py
tests/data/tokenizers/test_lambo_tokenizer.py 8 additions, 0 deletions

tests/data/tokenizers/test_lambo_tokenizer.py

with 23 additions and 6 deletions

0% or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment