Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
C
combo
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Wiki
Redmine
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Container registry
Model registry
Operate
Environments
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
GitLab community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
Syntactic Tools
combo
Commits
5493eec7
Commit
5493eec7
authored
Nov 21, 2023
by
Maja Jablonska
Browse files
Options
Downloads
Patches
Plain Diff
More documentation
parent
c5031d73
Branches
Branches containing commit
No related tags found
1 merge request
!46
Merge COMBO 3.0 into master
Changes
3
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
docs/Default Model.md
+4
-0
4 additions, 0 deletions
docs/Default Model.md
docs/Prediction.md
+3
-3
3 additions, 3 deletions
docs/Prediction.md
docs/Training.md
+47
-4
47 additions, 4 deletions
docs/Training.md
with
54 additions
and
7 deletions
docs/Default Model.md
0 → 100644
+
4
−
0
View file @
5493eec7
# Default model configurations
For convenience, the file
```default_model.py```
contains a few default configurations for ComboModel,
Universal Dependencies DatasetReader and few other most commonly used.
\ No newline at end of file
This diff is collapsed.
Click to expand it.
docs/Prediction.md
+
3
−
3
View file @
5493eec7
...
...
@@ -40,7 +40,7 @@ By default, COMBO uses the LAMBO tokenizer.
Input and output are both in
```*.conllu```
format.
```
bash
combo
--mode
predict
--model_path
your_model_tar_gz
--input_file
your_conllu_file
--output_file
your_output_file
python combo/main.py
--mode
predict
--model_path
your_model_tar_gz
--input_file
your_conllu_file
--output_file
your_output_file
```
### Raw text prediction
...
...
@@ -52,7 +52,7 @@ Input: one sentence per line.
Output: CONLL-u file.
```
bash
combo
--mode
predict
--model_path
your_model_tar_gz
--input_file
your_text_file
--output_file
your_output_file
--noconllu_format
python combo/main.py
--mode
predict
--model_path
your_model_tar_gz
--input_file
your_text_file
--output_file
your_output_file
--noconllu_format
```
### Console prediction
...
...
@@ -62,5 +62,5 @@ Works for models where input was text-based only.
Interactive testing in console (load model and just type sentence in console).
```
bash
combo
--mode
predict
--model_path
your_model_tar_gz
--input_file
"-"
python combo/main.py
--mode
predict
--model_path
your_model_tar_gz
--input_file
"-"
```
\ No newline at end of file
This diff is collapsed.
Click to expand it.
docs/Training.md
+
47
−
4
View file @
5493eec7
...
...
@@ -3,7 +3,7 @@
Basic command:
```
bash
combo
--mode
train
\
python combo/main.py
--mode
train
\
--training_data_path
your_training_path
\
--validation_data_path
your_validation_path
```
...
...
@@ -11,7 +11,7 @@ combo --mode train \
Options:
```
bash
combo
--helpfull
python combo/main.py
--helpfull
```
## Examples
...
...
@@ -20,7 +20,50 @@ For clarity, the training and validation data paths are omitted.
Train on multiple accelerators (default: train on all available ones)
```
bash
combo
--mode
train
--n_cuda_devices
8
python combo/main.py
--mode
train
--n_cuda_devices
8
```
Use pretrained transformer embeddings:
```
bash
python combo/main.py
--mode
train
--pretrained_transformer_name
your_chosen_pretrained_transformer
```
Train only a dependency parser:
```
bash
python combo/main.py
--mode
train
--targets
head
,deprel
```
Use additional features (e.g. part-of-speech tags) for training a dependency parser
(
```token```
and
```char```
are default features)
```
bash
python combo/main.py
--mode
train
--targets
head
,deprel
--features
token,char,upostag
```
# Custom configuration
Use a custom configuration:
```
bash
python combo/main.py
--config_path
configuration.json
```
Discard any flags (including default flag values - without this flag, the default values
will override configuration!)
```
bash
python combo/main.py
--config_path
configuration.json
--use_pure_config
```
## Finetuning
Finetune a pre-trained model:
```
bash
python combo/main.py
--mode
train
--finetune
\
--finetuning_training_data_path
your_training_path
\
--finetuning_validation_data_path
your_validation_path
\
--model_path
pretrained_model_path
```
\ No newline at end of file
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment