Commits · 633f57a59a39bdfb9c7674e27be6c1913b8293b8 · Analysers / corpus2

Mar 03, 2011
- Fast and drity (regex-based) XCES parser based on the one in Pantera,... · 633f57a5
  ilor authored 14 years ago
```
Fast and drity (regex-based) XCES parser based on the one in Pantera, noticeably faster but prone to breakage on even slightly freeform xml files
```
  633f57a5
- rm debug output in tests · f69b560e
  ilor authored 14 years ago
  
  f69b560e
Feb 26, 2011
- expand out-of-chunk token test and fix another issue · bcfed015
  ilor authored 14 years ago
  
  bcfed015
- add a test for out-of-chunk tokens · 11480d41
  ilor authored 14 years ago
  
  11480d41
Feb 25, 2011
- Mode enum for tag parsing instead of the allow_extra bool switch in parsing functions · 6183ea50
  ilor authored 14 years ago
  
  6183ea50
Feb 24, 2011
- part 1 of the xml readers refactoring -- extract xmlreader from xces and ccl readers · c03647e8
  ilor authored 14 years ago
  
  c03647e8
- token metadata member (increases Token struct size only slightly) · 3061dc24
  ilor authored 14 years ago
  
  3061dc24
Feb 23, 2011
- annotation upgrades: structures, crude reader, some tests. · c7ca37b6
  ilor authored 14 years ago
  
  c7ca37b6
Feb 18, 2011
- simple io test to make sure slight xces writer refactoring does not break things · 37fa00cb
  ilor authored 14 years ago
  
  37fa00cb
- some more reasonable annotation tests · 3722ddc3
  ilor authored 14 years ago
  
  3722ddc3
Feb 16, 2011
- Annotation updates and two very basic tests · 2415ad64
  ilor authored 14 years ago
  
  2415ad64
Nov 30, 2010
- add Tagset attribute mask to index/name mappingand related functions. Bump version to 1.0.2 · a2a05ba0
  ilor authored 14 years ago
  
  a2a05ba0
Nov 25, 2010
- make Tagset::parse_symbol throw on invalid strings, update tests and code, bump version to 1.0.1 · 6a3a4afa
  ilor authored 14 years ago
  
  6a3a4afa
Nov 22, 2010
- Licensify code · 9dfe1051
  ilor authored 14 years ago
  
  9dfe1051
Nov 18, 2010
- add an ICU sanity check · 404a54e5
  ilor authored 14 years ago
  
  404a54e5
Nov 15, 2010
- fix logic-reversal bug in Tagset::parse_symbol, add relevant tests and bump version to 0.1.2 · 49df8b35
  ilor authored 14 years ago
  
  49df8b35
Nov 04, 2010
- Add Tagset::parse_symbol and tag_to_symbol_string and related functions. Bumps verison of corpus2. · c9a46af0
  ilor authored 14 years ago
  
  c9a46af0
- Pwrutiuls: add set_bits_iterator with a test, bump version to 0.0.3 · 7ea7f186
  ilor authored 14 years ago
  
  7ea7f186
Oct 27, 2010
- fix tests · d8840260
  ilor authored 14 years ago
  
  d8840260
Oct 21, 2010
- use std::bitset in place of boost::uint64_t as Corpus2::mask_t, move bit functions to bitset.h · bade0ec2
  ilor authored 14 years ago
  
  bade0ec2
Oct 20, 2010
- add Tagset::split_tag · 2e82e653
  ilor authored 14 years ago
  
  2e82e653
- move count_bits_set to pwrutisl, put lowest_bit alias there, implement... · a519febc
  ilor authored 14 years ago
```
move count_bits_set to pwrutisl, put lowest_bit alias there, implement Tagset::tag_size and Tagset::tag_is_singular
```
  a519febc
Oct 19, 2010
- WIP of bit-tag implementation, compiles, does not work yet · bb195ea5
  ilor authored 14 years ago
  
  bb195ea5
Sep 22, 2010
- rename Error classes to avoid ambiguity · d7eb742d
  ilor authored 14 years ago
  
  d7eb742d
- move some tests from maca tha belong in libcorpus2 · 51e69c41
  ilor authored 14 years ago
  
  51e69c41
Sep 21, 2010

add tests stub · 66596291
ilor authored 14 years ago

66596291

Initial version of the basic functionality split from libmaca. · e862fc89

ilor authored 14 years ago

Libcorpus2 now contains the base strructures (tokens etc), their I/O and related classes.
Libpwrutils (name TBD) contains basic building blocks common to all tagger-related libraries
Tagset-tool only needs libcorpus, so was brough here as well.

e862fc89