Skip to content
Snippets Groups Projects

Repository graph

You can move around the graph by using the arrow keys.
Select Git revision
  • master default protected
  • develop
2 results
Created with Raphaël 2.2.028Jul21Sep14935Aug28Jul211715141082Update .gitlab-ci.ymlmastermasterMerge branch 'develop' of gitlab.clarin-pl.eu:nlpworkers/tokenizer into developdevelopdevelopNew code based on PPKZ data.wMerge branch 'master' into developMerge branch 'develop' into 'master'DevelopMerge branch 'master' into 'develop'Changed defualt calues for options.Additional letter emoticons, additional letters in rm_add_char=special.Added another letter emote.Forgot to run tox locally.Added an option to delete ascii emoticons and delete multiple end of sentence characters.Merge branch 'develop' into 'master'New functionalitiesChanged one regex to have list of whitespaces instead o f space.Changed config.ini, added a space in a regex.pep8 new line before orFixed a problem with returning an empty list when there was a line in memory.Deleted unnecessery function calls.Changed and added more comments. Fixed pep8, docstring problems.Remove mistyped listings now serches both in lines and in sentences.Fixed not detecting multiple wrong lisitngs in a row.Basic handling of mistyped listings.Basic handling of mistyped listings.Added to 'special' to remove arabic.Changed behaviour of deleting special characters to delete more cases.Added handling of unicode characters, changed link handling.Pep8 deleted whitespace from blankline.Added an empty line for docstyle.Added missing assigment in puntuation = leave link = token.Fixed deleting periods at the end of sentence.Fixed removing both punctuation and listings.Fixed typo in _change_indices.Added handling more types of listings, added indecies handling, program now removes empty lines.Merge branch 'develop' into 'master'Changed the way to remove punctuation. Now by defualt links and e-mails words such as e-mail do not have punctuation removed.Add README.md