Commits · fe34cc2342ba335efb1654999b1d804f8373fe71 · novelai-storage / Basedformer

19 Jul, 2022 6 commits
- Add docker image builder script. · fe34cc23
  Wes Brown authored Jul 18, 2022
  
  fe34cc23
- Fix wandb reporting, do first zero-eval *before* evaluating the first step. · 9240d7ea
  Wes Brown authored Jul 18, 2022
  
  9240d7ea
- Small fixes and updates. · 60893ad7
  Wes Brown authored Jul 18, 2022
  
  60893ad7
- First pass at argo workflow. · 3b759040
  Wes Brown authored Jul 18, 2022
  
  3b759040
- Add defaults, project id, logs. · 0bde514b
  Wes Brown authored Jul 18, 2022
  
  0bde514b
- Prompt updates, sampling configuration, and report in `tokens` space. · 2db358ff
  Wes Brown authored Jul 18, 2022
  
  2db358ff
18 Jul, 2022 3 commits
- Save a checkpoint at the end of every epoch. · bd34e4d4
  Wes Brown authored Jul 18, 2022
  
  bd34e4d4
- Epoch support, and mask `<|endoftext|>` · 55a00bbf
  Wes Brown authored Jul 17, 2022
  
  55a00bbf
- Add `--shuffle` argument, default to `False`. · eebb1fa8
  Wes Brown authored Jul 17, 2022
  
  eebb1fa8
16 Jul, 2022 1 commit
- hypertrain reporting fixes and improvements · ea32d948
  Wes Brown authored Jul 15, 2022
  
  ea32d948
15 Jul, 2022 6 commits
- Set default to `2049` and correctly calculate the tokens per second. · 94c0ad6f
  Wes Brown authored Jul 14, 2022
  
  94c0ad6f
- Fix shuffling and use provided context size on CLI. · 53bcc538
  Wes Brown authored Jul 14, 2022
  
  53bcc538
- Merge pull request #9 from NovelAI/os.changes · 6c1a2d67
  Eren Doğan authored Jul 14, 2022
  
  6c1a2d67
- Fix passing step to wandb. · 9fc1cc21
  Wes Brown authored Jul 14, 2022
  
  9fc1cc21
- Actually use the `lm_path` config option. · b4bf88c8
  Wes Brown authored Jul 14, 2022
  
  b4bf88c8
- Small fixes. · aa35ad92
  Wes Brown authored Jul 14, 2022
  
  aa35ad92
14 Jul, 2022 4 commits
- Revert mostly to `x=` assignment form. · 8b26deda
  Wes Brown authored Jul 13, 2022
  
  8b26deda
- Add argument handling, a closured `hypernetwork_saver`, and save the final result. · 8073ccfc
  Wes Brown authored Jul 13, 2022
  
  8073ccfc
- Clean up, better reporting. · 704947b4
  Wes Brown authored Jul 13, 2022
  
  704947b4
- Some cleanup, device agnosticism. · cc02ad48
  Wes Brown authored Jul 13, 2022
  
  cc02ad48
08 Jul, 2022 5 commits
- Merge pull request #8 from NovelAI/datasetfixes · 91470a5a
  Eren Doğan authored Jul 08, 2022
  
  91470a5a
- Don't check if identity is dict · b1e335ec
  novelailab authored Jul 08, 2022
  
  b1e335ec
- Danbooru id as identity · dad308db
  novelailab authored Jul 08, 2022
  
  dad308db
- Revert open() changes, fix and switch to build() · 7b770017
  novelailab authored Jul 08, 2022
  
  7b770017
- ImageDataset fixes, scrape and benchmark scripts · 8a038aec
  novelailab authored Jul 08, 2022
  
  8a038aec
07 Jul, 2022 4 commits
- fucked up · 0c96e233
  Eren Doğan authored Jul 06, 2022
  
  0c96e233
- more checks · 7e9cc877
  Eren Doğan authored Jul 06, 2022
  
  7e9cc877
- more dataset stuff · 690dd2cf
  Eren Doğan authored Jul 06, 2022
  
  690dd2cf
- zero2 works · fb134d28
  novelailab authored Jul 06, 2022
  
  fb134d28
06 Jul, 2022 4 commits
- experimental fused softmax support · 9d27a5cc
  novelailab authored Jul 06, 2022
  
  9d27a5cc
- add fusedad, fix bug in hypertrain, add setup pkgs · 7e2ee30f
  novelailab authored Jul 05, 2022
  
  7e2ee30f
- update hypetrain with API changes · 94ad5ad7
  novelailab authored Jul 05, 2022
  
  94ad5ad7
- push image fixes and builder example(not done) · 5a4b10c7
  novelailab authored Jul 05, 2022
  
  5a4b10c7
05 Jul, 2022 7 commits
- Merge pull request #7 from NovelAI/fiareader · cf0224e4
  Eren Doğan authored Jul 05, 2022
```
mmap based FIAReader
```
  cf0224e4
- delete redundant init.py · da4bc5ad
  novelailab authored Jul 05, 2022
  
  da4bc5ad
- metadata=False by default · 7cf62ce3
  novelailab authored Jul 05, 2022
  
  7cf62ce3
- get_metadata, from id · ae114e18
  novelailab authored Jul 05, 2022
  
  ae114e18
- read_from_id to read from danbooru id · dff538a0
  novelailab authored Jul 05, 2022
  
  dff538a0
- change metadata -> index in ShardedImageDataset · 0f8be39c
  novelailab authored Jul 04, 2022
  
  0f8be39c
- make so can transfer to cuda after reduced · cb67abcb
  novelailab authored Jul 04, 2022
  
  cb67abcb