Skip to content

B
Basedformer
Commit 7f9ceee2 authored by Eren Doğan's avatar Eren Doğan Committed by GitHub
Browse files
Options

make sure to wait for the executor map futures to finish

parent 0520ae59
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
basedformer/dataset.py
View file @ 7f9ceee2
......@@ -74,6 +74,7 @@ class ShardedImageDataset(data.Dataset):
key = self.skip + key
keys = [*range(key, key+self.bsz)]
tensors = self.executor.map(self.read_from_metadata_key, keys)
tensors = list(tensors)
return tensors
def read_from_metadata_key(self, key):
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment