Skip to content
Snippets Groups Projects

Resolve "Read not only .txt files"

Closes #2 (closed)

Merge request reports

Pipeline #11451 passed

Pipeline passed for 4294beed on 2-read-not-only-txt-files

Merged by Konrad WojtasikKonrad Wojtasik Jul 4, 2023 (Jul 4, 2023 11:14am UTC)

Loading

Pipeline #11453 passed

Pipeline passed for f6e486f4 on master

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
23 23
24 24 @staticmethod
25 25 def prepare_and_append_document(
26 file_path: str | Path, document_path: str | Path
26 file_path: str | Path, document_path: str | Path
27 27 ) -> None:
28 28 """Formats and appends plain texts into jsonl file."""
29 29 document = {}
30 with open(document_path, "r", encoding="utf-8") as _df:
31 document["text"] = _df.read()
30 if str(document_path).endswith(".jsonl"):
  • Jakub Gołuch added 1 commit

    added 1 commit

    • a0865827 - Add tests to read jsonl files

    Compare with previous version

  • Jakub Gołuch added 1 commit

    added 1 commit

    • 73c0b676 - Add feature to check whether document has a valid json/jsonl format, add tests

    Compare with previous version

  • Jakub Gołuch added 1 commit

    added 1 commit

    • 8864e268 - Add feature to check whether document has a valid json/jsonl format, add tests

    Compare with previous version

  • Jakub Gołuch added 1 commit

    added 1 commit

    • e9bab9a0 - Add feature to check whether document has a valid json/jsonl format, add tests

    Compare with previous version

  • Jakub Gołuch added 4 commits

    added 4 commits

    Compare with previous version

  • Jakub Gołuch added 1 commit

    added 1 commit

    • 3130c89d - Add feature to check whether document has a valid json/jsonl format, add tests

    Compare with previous version

  • added 1 commit

    • 6a94b42e - Update easymatcher_worker.py

    Compare with previous version

  • added 1 commit

    Compare with previous version

  • added 1 commit

    • 05afe1e1 - Update easymatcher_worker.py

    Compare with previous version

  • Konrad Wojtasik approved this merge request

    approved this merge request

  • Konrad Wojtasik enabled an automatic merge when the pipeline for 05afe1e1 succeeds

    enabled an automatic merge when the pipeline for 05afe1e1 succeeds

  • Konrad Wojtasik aborted the automatic merge because source branch was updated

    aborted the automatic merge because source branch was updated

  • added 1 commit

    Compare with previous version

  • Konrad Wojtasik mentioned in commit f6e486f4

    mentioned in commit f6e486f4

  • Please register or sign in to reply
    Loading