Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
C
corpus2
Manage
Activity
Members
Labels
Plan
Issues
4
Issue boards
Milestones
Wiki
Redmine
Code
Merge requests
0
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Container Registry
Operate
Environments
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
Analysers
corpus2
Commits
31efb090
Commit
31efb090
authored
12 years ago
by
Adam Radziszewski
Browse files
Options
Downloads
Patches
Plain Diff
fix get_next_token having sentences delete their tokens before giving tokens out
parent
d91e0cce
Branches
Branches containing commit
No related merge requests found
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
libcorpus2/io/reader.cpp
+1
-0
1 addition, 0 deletions
libcorpus2/io/reader.cpp
with
1 addition
and
0 deletions
libcorpus2/io/reader.cpp
+
1
−
0
View file @
31efb090
...
...
@@ -290,6 +290,7 @@ Token* BufferedSentenceReader::get_next_token()
if
(
s
)
{
std
::
copy
(
s
->
tokens
().
begin
(),
s
->
tokens
().
end
(),
std
::
back_inserter
(
token_buf_
));
s
->
release_tokens
();
}
else
{
more
=
false
;
}
...
...
This diff is collapsed.
Click to expand it.
Preview
0%
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment