Commits · 704947b4857f53a419983c95b675a3ebe8000947 · novelai-storage / Basedformer

14 Jul, 2022 2 commits
- Clean up, better reporting. · 704947b4
  Wes Brown authored Jul 13, 2022
  
  704947b4
- Some cleanup, device agnosticism. · cc02ad48
  Wes Brown authored Jul 13, 2022
  
  cc02ad48
08 Jul, 2022 5 commits
- Merge pull request #8 from NovelAI/datasetfixes · 91470a5a
  Eren Doğan authored Jul 08, 2022
  
  91470a5a
- Don't check if identity is dict · b1e335ec
  novelailab authored Jul 08, 2022
  
  b1e335ec
- Danbooru id as identity · dad308db
  novelailab authored Jul 08, 2022
  
  dad308db
- Revert open() changes, fix and switch to build() · 7b770017
  novelailab authored Jul 08, 2022
  
  7b770017
- ImageDataset fixes, scrape and benchmark scripts · 8a038aec
  novelailab authored Jul 08, 2022
  
  8a038aec
07 Jul, 2022 4 commits
- fucked up · 0c96e233
  Eren Doğan authored Jul 06, 2022
  
  0c96e233
- more checks · 7e9cc877
  Eren Doğan authored Jul 06, 2022
  
  7e9cc877
- more dataset stuff · 690dd2cf
  Eren Doğan authored Jul 06, 2022
  
  690dd2cf
- zero2 works · fb134d28
  novelailab authored Jul 06, 2022
  
  fb134d28
06 Jul, 2022 4 commits
- experimental fused softmax support · 9d27a5cc
  novelailab authored Jul 06, 2022
  
  9d27a5cc
- add fusedad, fix bug in hypertrain, add setup pkgs · 7e2ee30f
  novelailab authored Jul 05, 2022
  
  7e2ee30f
- update hypetrain with API changes · 94ad5ad7
  novelailab authored Jul 05, 2022
  
  94ad5ad7
- push image fixes and builder example(not done) · 5a4b10c7
  novelailab authored Jul 05, 2022
  
  5a4b10c7
05 Jul, 2022 17 commits
- Merge pull request #7 from NovelAI/fiareader · cf0224e4
  Eren Doğan authored Jul 05, 2022
```
mmap based FIAReader
```
  cf0224e4
- delete redundant init.py · da4bc5ad
  novelailab authored Jul 05, 2022
  
  da4bc5ad
- metadata=False by default · 7cf62ce3
  novelailab authored Jul 05, 2022
  
  7cf62ce3
- get_metadata, from id · ae114e18
  novelailab authored Jul 05, 2022
  
  ae114e18
- read_from_id to read from danbooru id · dff538a0
  novelailab authored Jul 05, 2022
  
  dff538a0
- change metadata -> index in ShardedImageDataset · 0f8be39c
  novelailab authored Jul 04, 2022
  
  0f8be39c
- make so can transfer to cuda after reduced · cb67abcb
  novelailab authored Jul 04, 2022
  
  cb67abcb
- add metadata and better error handling · 5c846daf
  novelailab authored Jul 04, 2022
  
  5c846daf
- more properties · 1a66f013
  novelailab authored Jul 04, 2022
  
  1a66f013
- return ids for real · 4577aa6f
  novelailab authored Jul 04, 2022
  
  4577aa6f
- make the permute faster by doing it on batch · 8056efa1
  novelailab authored Jul 04, 2022
  
  8056efa1
- return identity · df7a70ab
  novelailab authored Jul 04, 2022
  
  df7a70ab
- add more stuff · a0b66a4b
  novelailab authored Jul 04, 2022
  
  a0b66a4b
- ImageDatasetBuilder · 2b10353c
  novelailab authored Jul 04, 2022
  
  2b10353c
- add transform support and stacking · 176b21d8
  Eren Doğan authored Jul 04, 2022
  
  176b21d8
- make sure to wait for the executor map futures to finish · 7f9ceee2
  Eren Doğan authored Jul 04, 2022
  
  7f9ceee2
- fix __len__ · 0520ae59
  Eren Doğan authored Jul 04, 2022
  
  0520ae59
03 Jul, 2022 2 commits
- future pretrained_model class · 39518025
  novelailab authored Jul 03, 2022
  
  39518025
- init retro · 5ca754a6
  novelailab authored Jul 03, 2022
  
  5ca754a6
25 Jun, 2022 2 commits
- move dataset code to dataset.py · 62baf4ad
  novelailab authored Jun 24, 2022
  
  62baf4ad
- clean · a1d18aaa
  novelailab authored Jun 24, 2022
  
  a1d18aaa
23 Jun, 2022 1 commit
- 10x faster · e00841d8
  Eren Doğan authored Jun 23, 2022
  
  e00841d8
22 Jun, 2022 3 commits
- fix resnet · 63f92eba
  novelailab authored Jun 22, 2022
  
  63f92eba
- Rewrite, around %70 faster than FIAReader thx to mmap · ec79f2ea
  Eren Doğan authored Jun 22, 2022
  
  ec79f2ea
- remove mmaptest.py · a5d9beec
  novelailab authored Jun 21, 2022
  
  a5d9beec