There was an error fetching the commit references. Please try again later.
Add optional subwords splitting
Showing
- combo/combo_model.py 0 additions, 1 deletioncombo/combo_model.py
- combo/data/tokenizers/lambo_tokenizer.py 11 additions, 4 deletionscombo/data/tokenizers/lambo_tokenizer.py
- combo/default_model.py 7 additions, 2 deletionscombo/default_model.py
- combo/main.py 11 additions, 4 deletionscombo/main.py
- combo/models/encoder.py 1 addition, 1 deletioncombo/models/encoder.py
- combo/nn/utils.py 6 additions, 1 deletioncombo/nn/utils.py
- docs/Training.md 4 additions, 2 deletionsdocs/Training.md
- tests/data/tokenizers/test_lambo_tokenizer.py 14 additions, 2 deletionstests/data/tokenizers/test_lambo_tokenizer.py
Please register or sign in to comment