Add PretrainedTransformerTokenizer and PretrainedTransformerIndexer
Showing
- combo/common/__init__.py 2 additions, 0 deletionscombo/common/__init__.py
- combo/common/cached_transformers.py 28 additions, 0 deletionscombo/common/cached_transformers.py
- combo/common/logging.py 55 additions, 0 deletionscombo/common/logging.py
- combo/common/tqdm.py 99 additions, 0 deletionscombo/common/tqdm.py
- combo/common/util.py 14 additions, 0 deletionscombo/common/util.py
- combo/data/dataset_readers/conll.py 2 additions, 2 deletionscombo/data/dataset_readers/conll.py
- combo/data/dataset_readers/universal_dependencies_dataset_reader.py 1 addition, 1 deletion.../dataset_readers/universal_dependencies_dataset_reader.py
- combo/data/fields/adjacency_field.py 5 additions, 5 deletionscombo/data/fields/adjacency_field.py
- combo/data/fields/field.py 1 addition, 1 deletioncombo/data/fields/field.py
- combo/data/fields/label_field.py 6 additions, 6 deletionscombo/data/fields/label_field.py
- combo/data/fields/sequence_label_field.py 5 additions, 5 deletionscombo/data/fields/sequence_label_field.py
- combo/data/fields/sequence_multilabel_field.py 4 additions, 4 deletionscombo/data/fields/sequence_multilabel_field.py
- combo/data/token_embedders/__init__.py 0 additions, 0 deletionscombo/data/token_embedders/__init__.py
- combo/data/token_embedders/embedding.py 216 additions, 0 deletionscombo/data/token_embedders/embedding.py
- combo/data/token_indexers/__init__.py 3 additions, 0 deletionscombo/data/token_indexers/__init__.py
- combo/data/token_indexers/pretrained_transformer_fixed_mismatched_indexer.py 0 additions, 63 deletions...dexers/pretrained_transformer_fixed_mismatched_indexer.py
- combo/data/token_indexers/pretrained_transformer_indexer.py 47 additions, 5 deletionscombo/data/token_indexers/pretrained_transformer_indexer.py
- combo/data/token_indexers/pretrained_transformer_mismatched_indexer.py 3 additions, 3 deletions...ken_indexers/pretrained_transformer_mismatched_indexer.py
- combo/data/token_indexers/single_id_token_indexer.py 24 additions, 23 deletionscombo/data/token_indexers/single_id_token_indexer.py
- combo/data/token_indexers/token_characters_indexer.py 2 additions, 2 deletionscombo/data/token_indexers/token_characters_indexer.py
Please register or sign in to comment