Working scratch of joint CoNNL-U and IOB based training.
Script for preprocessing .iob NKJP file. Multitask dataset readers/data loaders/model using AllenNLP toolkit.
Showing
- combo/config.multitask.template.jsonnet 404 additions, 0 deletionscombo/config.multitask.template.jsonnet
- combo/config.shared.libsonnet 23 additions, 1 deletioncombo/config.shared.libsonnet
- combo/data/dataset.py 34 additions, 2 deletionscombo/data/dataset.py
- combo/data/samplers/samplers.py 1 addition, 1 deletioncombo/data/samplers/samplers.py
- combo/models/__init__.py 1 addition, 0 deletionscombo/models/__init__.py
- combo/models/base.py 2 additions, 1 deletioncombo/models/base.py
- combo/models/model.py 68 additions, 21 deletionscombo/models/model.py
- combo/models/multitask.py 66 additions, 0 deletionscombo/models/multitask.py
- scripts/fix_iob.py 35 additions, 0 deletionsscripts/fix_iob.py
- tests/data/fields/test_samplers.py 1 addition, 1 deletiontests/data/fields/test_samplers.py
Please register or sign in to comment