Commits · aa6444e91886be48db6b7db92ef42abf176fb363 · novelai-storage / Basedformer

13 May, 2022 3 commits
- gpt neo working · aa6444e9
  novelailab authored May 13, 2022
  
  aa6444e9
- fairseq works · 88f0a90e
  novelailab authored May 13, 2022
  
  88f0a90e
- fairseq works, start neo impl · 24459438
  novelailab authored May 13, 2022
  
  24459438
12 May, 2022 3 commits
- fix names · 92b7b187
  novelailab authored May 12, 2022
  
  92b7b187
- update gpt2 to base_lm · fa2a771c
  novelailab authored May 12, 2022
  
  fa2a771c
- happy with BaseModel abstraction · 835709ca
  novelailab authored May 12, 2022
  
  835709ca
11 May, 2022 1 commit
- eval harness works · c8d491e1
  novelailab authored May 11, 2022
  
  c8d491e1
09 May, 2022 5 commits
- config almost done · 44751bc6
  novelailab authored May 09, 2022
  
  44751bc6
- oops, fix · 42870e7b
  novelailab authored May 09, 2022
  
  42870e7b
- make lm_base functions functional · 41f39980
  novelailab authored May 09, 2022
  
  41f39980
- config dataclass, not sure about this structure · 8d44445e
  novelailab authored May 09, 2022
```
i am sad
```
  8d44445e
- eval stuff · a1b9e387
  novelailab authored May 09, 2022
  
  a1b9e387
29 Apr, 2022 4 commits
- fix greedy sampling · 05bbefb8
  novelailab authored Apr 29, 2022
  
  05bbefb8
- sampler on its own file and greedy sampling · a5470cba
  novelailab authored Apr 29, 2022
  
  a5470cba
- copy eval adapter from neox, fill this in later · a1ab899d
  novelailab authored Apr 29, 2022
  
  a1ab899d
- sampling working, gpt-neo(x) init · 074d25c5
  novelailab authored Apr 29, 2022
  
  074d25c5
27 Apr, 2022 2 commits
- push · 9223ef70
  novelailab authored Apr 26, 2022
  
  9223ef70
- push · a1556cf7
  novelailab authored Apr 26, 2022
  
  a1556cf7
20 Apr, 2022 1 commit
- implement cached generation · 1f8d04b2
  novelailab authored Apr 20, 2022
  
  1f8d04b2
14 Apr, 2022 6 commits
- noemblm attention cleanup · 3a52a64a
  novelailab authored Apr 14, 2022
  
  3a52a64a
- fix · eaba913c
  novelailab authored Apr 14, 2022
  
  eaba913c
- clean gptj attention · 3c7bd057
  novelailab authored Apr 14, 2022
  
  3c7bd057
- if cache · 24e93cbf
  novelailab authored Apr 14, 2022
  
  24e93cbf
- fix attn more · fa2cfe52
  novelailab authored Apr 14, 2022
  
  fa2cfe52
- simplify attention on gpt2 · 39568281
  novelailab authored Apr 14, 2022
  
  39568281
12 Apr, 2022 1 commit
- upstream · 86e815ab
  novelailab authored Apr 12, 2022
  
  86e815ab
11 Apr, 2022 1 commit
- opt/model save/load works! · 1ab8bac6
  novelailab authored Apr 10, 2022
  
  1ab8bac6
10 Apr, 2022 2 commits
- optimizer save works · 2d0b32de
  novelailab authored Apr 09, 2022
  
  2d0b32de
- optimizer save load completed · 971ed5dc
  novelailab authored Apr 09, 2022
  
  971ed5dc
08 Apr, 2022 1 commit
- not too bad · 41b51369
  novelailab authored Apr 07, 2022
  
  41b51369
07 Apr, 2022 10 commits
- more fixing · 6cbab785
  novelailab authored Apr 06, 2022
  
  6cbab785
- fix formatting · 0879cf91
  novelailab authored Apr 06, 2022
  
  0879cf91
- a · 4141d527
  novelailab authored Apr 06, 2022
  
  4141d527
- create nn.py · 34739983
  novelailab authored Apr 06, 2022
  
  34739983
- change name · 67259a5b
  novelailab authored Apr 06, 2022
  
  67259a5b
- remove lm_train, merge utils, move optimizer · 02d93202
  novelailab authored Apr 06, 2022
  
  02d93202
- some more cleanup · 773e886f
  novelailab authored Apr 06, 2022
  
  773e886f
- refactor kinda done, yeet main · 09e4a19b
  novelailab authored Apr 06, 2022
  
  09e4a19b
- cleanup · 840dd7f4
  novelailab authored Apr 06, 2022
  
  840dd7f4
- ugh · 1c9d3a31
  novelailab authored Apr 06, 2022
  
  1c9d3a31