Create one class of Token
Showing
- combo/common/util.py 2 additions, 2 deletionscombo/common/util.py
- combo/data/__init__.py 1 addition, 1 deletioncombo/data/__init__.py
- combo/data/api.py 6 additions, 5 deletionscombo/data/api.py
- combo/data/dataset.py 3 additions, 3 deletionscombo/data/dataset.py
- combo/data/dataset_readers/conll.py 3 additions, 3 deletionscombo/data/dataset_readers/conll.py
- combo/data/dataset_readers/dataset_utils/span_utils.py 2 additions, 2 deletionscombo/data/dataset_readers/dataset_utils/span_utils.py
- combo/data/dataset_readers/universal_dependencies_dataset_reader.py 2 additions, 2 deletions.../dataset_readers/universal_dependencies_dataset_reader.py
- combo/data/fields/text_field.py 5 additions, 5 deletionscombo/data/fields/text_field.py
- combo/data/token_indexers/pretrained_transformer_fixed_mismatched_indexer.py 4 additions, 4 deletions...dexers/pretrained_transformer_fixed_mismatched_indexer.py
- combo/data/token_indexers/pretrained_transformer_indexer.py 6 additions, 6 deletionscombo/data/token_indexers/pretrained_transformer_indexer.py
- combo/data/token_indexers/pretrained_transformer_mismatched_indexer.py 3 additions, 3 deletions...ken_indexers/pretrained_transformer_mismatched_indexer.py
- combo/data/token_indexers/single_id_token_indexer.py 6 additions, 6 deletionscombo/data/token_indexers/single_id_token_indexer.py
- combo/data/token_indexers/token_characters_indexer.py 5 additions, 5 deletionscombo/data/token_indexers/token_characters_indexer.py
- combo/data/token_indexers/token_features_indexer.py 3 additions, 3 deletionscombo/data/token_indexers/token_features_indexer.py
- combo/data/token_indexers/token_indexer.py 4 additions, 4 deletionscombo/data/token_indexers/token_indexer.py
- combo/data/tokenizers/__init__.py 1 addition, 1 deletioncombo/data/tokenizers/__init__.py
- combo/data/tokenizers/character_tokenizer.py 8 additions, 8 deletionscombo/data/tokenizers/character_tokenizer.py
- combo/data/tokenizers/pretrained_transformer_tokenizer.py 13 additions, 13 deletionscombo/data/tokenizers/pretrained_transformer_tokenizer.py
- combo/data/tokenizers/spacy_tokenizer.py 36 additions, 25 deletionscombo/data/tokenizers/spacy_tokenizer.py
- combo/data/tokenizers/tokenizer.py 96 additions, 109 deletionscombo/data/tokenizers/tokenizer.py
Please register or sign in to comment