Use of batches during prediction
eval_dataloader = DataLoader(eval_dataset, batch_size=1)
The batch size should not be written permanently in the code, but set by the user. A permanently typed batch size of 1, causes long delays relative to hardware capabilities and makes the processing time dependent on the number of sentences in the corpus being processed, rather than the size of the files.