Resolve "Read not only .txt files"
1 open thread
1 open thread
Closes #2 (closed)
Merge request reports
Activity
23 23 24 24 @staticmethod 25 25 def prepare_and_append_document( 26 file_path: str | Path, document_path: str | Path 26 file_path: str | Path, document_path: str | Path 27 27 ) -> None: 28 28 """Formats and appends plain texts into jsonl file.""" 29 29 document = {} 30 with open(document_path, "r", encoding="utf-8") as _df: 31 document["text"] = _df.read() 30 if str(document_path).endswith(".jsonl"): changed this line in version 3 of the diff
added 1 commit
- 73c0b676 - Add feature to check whether document has a valid json/jsonl format, add tests
added 1 commit
- 8864e268 - Add feature to check whether document has a valid json/jsonl format, add tests
added 1 commit
- e9bab9a0 - Add feature to check whether document has a valid json/jsonl format, add tests
added 4 commits
-
e9bab9a0...61bbc3bb - 3 commits from branch
master
- b5554f3e - Merge branch 'master' into '2-read-not-only-txt-files'
-
e9bab9a0...61bbc3bb - 3 commits from branch
added 1 commit
- 3130c89d - Add feature to check whether document has a valid json/jsonl format, add tests
enabled an automatic merge when the pipeline for 05afe1e1 succeeds
mentioned in commit f6e486f4
Please register or sign in to reply