Add multiwords
Showing
- combo/data/api.py 5 additions, 1 deletioncombo/data/api.py
- combo/data/dataset_readers/universal_dependencies_dataset_reader.py 1 addition, 1 deletion.../dataset_readers/universal_dependencies_dataset_reader.py
- combo/data/tokenizers/character_tokenizer.py 3 additions, 1 deletioncombo/data/tokenizers/character_tokenizer.py
- combo/data/tokenizers/lambo_tokenizer.py 72 additions, 13 deletionscombo/data/tokenizers/lambo_tokenizer.py
- combo/data/tokenizers/token.py 5 additions, 1 deletioncombo/data/tokenizers/token.py
- combo/predict.py 10 additions, 6 deletionscombo/predict.py
- setup.py 1 addition, 1 deletionsetup.py
- tests/data/data_readers/en_test.conllu 116 additions, 0 deletionstests/data/data_readers/en_test.conllu
- tests/data/data_readers/test_universal_dependencies_dataset_reader.py 9 additions, 9 deletions...ata_readers/test_universal_dependencies_dataset_reader.py
- tests/data/data_readers/tl_trg-ud-test.conllu 0 additions, 1343 deletionstests/data/data_readers/tl_trg-ud-test.conllu
Please register or sign in to comment