Add AllenNLP's Token (b5f16ddf) · Commits · Syntactic Tools / combo · GitLab

Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

C

combo
- Activity
- Members
- Labels
- Issues
  20
- Issue boards
- Milestones
- Wiki
- Redmine
- Releases
- Container Registry
- Environments
- Incidents

Snippets Groups Projects

b5f16ddf

Commit b5f16ddf authored 2 years ago by

Maja Jabłońska Committed by Martyna Wiącek 1 year ago

Downloads
- Patches
- Plain Diff

Add AllenNLP's Token

parent 07d074d7

Branches

Tags

1 merge request!46Merge COMBO 3.0 into master

Changes 4

Hide whitespace changes

Inline Side-by-side

Showing

combo/data/tokenizers/__init__.py 1 addition, 1 deletion

combo/data/tokenizers/__init__.py
combo/data/tokenizers/character_tokenizer.py 82 additions, 7 deletions

combo/data/tokenizers/character_tokenizer.py
combo/data/tokenizers/pretrained_transformer_tokenizer.py 13 additions, 14 deletions

combo/data/tokenizers/pretrained_transformer_tokenizer.py
combo/data/tokenizers/tokenizer.py 187 additions, 6 deletions

combo/data/tokenizers/tokenizer.py

with 283 additions and 28 deletions

0% or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment