Add token list splitting for longer sentences in pretrained_transformer_fixed_mismatched_indexer.py
Showing
- combo/data/token_indexers/pretrained_transformer_fixed_mismatched_indexer.py 20 additions, 4 deletions...dexers/pretrained_transformer_fixed_mismatched_indexer.py
- combo/main.py 5 additions, 3 deletionscombo/main.py
- tests/data/token_indexers/test_pretrained_transformer_fixed_mismatched_indexer.py 29 additions, 0 deletions...s/test_pretrained_transformer_fixed_mismatched_indexer.py
Please register or sign in to comment