Skip to content
Snippets Groups Projects
Commit c899b9ca authored by Wiktor Walentynowicz's avatar Wiktor Walentynowicz :construction_worker_tone1:
Browse files

Merge branch 'colons-in-lemmas' into 'master'

Colons in lemmas

See merge request !12
parents 4769efeb 3ea56557
Branches
Tags
1 merge request!12Colons in lemmas
Pipeline #4216 passed
......@@ -238,8 +238,20 @@ Corpus2::Token* Morfeusz2Analyser::make_token(const Toki::Token& t,
void Morfeusz2Analyser::morfeusz_into_token(Corpus2::Token* tt, const details::Morfeusz2Edge& m) const
{
tt->set_orth(m.orth);
UnicodeString lemma = m.lemma;
if(m.tag_string != "interp")
{
UnicodeString colon(":");
int index_of_colon = lemma.indexOf(colon);
if(index_of_colon > -1)
{
lemma.remove(index_of_colon,lemma.length()-1);
}
}
if (!m.tag_string.empty()) {
conv_->tagset_from().lexemes_into_token(*tt, m.lemma,
conv_->tagset_from().lexemes_into_token(*tt, lemma,
m.tag_string);
} else {
Corpus2::Lexeme ign_lex(m.orth, ign_tag_);
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment