Skip to content
Snippets Groups Projects

Add try/catch clause for sentences with large number of wordpieces.

Merged Martyna Wiącek requested to merge fix/try_catch_clause_for_long_wordpiece_list into develop
Compare and
2 files
+ 7
3
Compare changes
  • Side-by-side
  • Inline
Files
2
@@ -4,8 +4,6 @@ from allennlp import data
from allennlp.data import token_indexers, tokenizers, IndexedTokenList, vocabulary
from overrides import overrides
from typing import List
@data.TokenIndexer.register("pretrained_transformer_mismatched_fixed")
class PretrainedTransformerMismatchedIndexer(token_indexers.PretrainedTransformerMismatchedIndexer):