Skip to content
Snippets Groups Projects
Commit f1012a9c authored by Marcin Wątroba's avatar Marcin Wątroba
Browse files

download_dataset command

parent fdd2e926
No related merge requests found
......@@ -5,7 +5,8 @@ import datasets
def iterate_dataset(dataset_path: str, dataset_name: Optional[str], cache_dir: str, split_name: str, items: int):
dataset_dict = datasets.load_dataset(dataset_path, dataset_name if len(dataset_name) > 0 else None, cache_dir)
dataset_dict = datasets.load_dataset(dataset_path, dataset_name if len(dataset_name) > 0 else None,
cache_dir=cache_dir)
dataset = dataset_dict[split_name]
for it in dataset[:items]:
print(it)
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment