Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Sign in / Register
Toggle navigation
B
Basedformer
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Locked Files
Issues
0
Issues
0
List
Boards
Labels
Service Desk
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Security & Compliance
Security & Compliance
Dependency List
License Compliance
Packages
Packages
List
Container Registry
Analytics
Analytics
CI / CD
Code Review
Insights
Issues
Repository
Value Stream
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
novelai-storage
Basedformer
Commits
eebb1fa8
Commit
eebb1fa8
authored
Jul 17, 2022
by
Wes Brown
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Add `--shuffle` argument, default to `False`.
parent
ea32d948
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
2 deletions
+4
-2
hypertrain.py
hypertrain.py
+4
-2
No files found.
hypertrain.py
View file @
eebb1fa8
...
...
@@ -284,8 +284,9 @@ parser.add_argument("--logs", type=str, help="log directory location",
default
=
"./logs"
)
parser
.
add_argument
(
"--masked"
,
type
=
bool
,
help
=
"masked softmax fusion"
)
parser
.
add_argument
(
"--sample_vanilla"
,
type
=
bool
,
help
=
"sample vanilla model"
)
parser
.
add_argument
(
"--shuffle"
,
type
=
bool
,
help
=
"shuffle dataset contexts"
)
parser
.
set_defaults
(
loss_scale
=
False
,
amp
=
False
,
no_resume
=
False
,
masked
=
False
,
sample_vanilla
=
False
)
sample_vanilla
=
False
,
shuffle
=
False
)
args
=
parser
.
parse_args
()
if
args
.
output
==
''
:
args
.
output
=
f
'./{args.run_name}'
...
...
@@ -310,6 +311,7 @@ train_config = {
"eval_every"
:
args
.
eval_every
,
"context_size"
:
args
.
context_size
,
"sample_vanilla"
:
args
.
sample_vanilla
,
"shuffle"
:
args
.
shuffle
,
}
torch
.
manual_seed
(
train_config
[
"seed"
])
bs
=
train_config
[
"bs"
]
...
...
@@ -355,7 +357,7 @@ if last_cp:
train_loader
=
torch_data
.
DataLoader
(
train_dataset
,
batch_size
=
bs
*
gas
,
shuffle
=
True
,
shuffle
=
train_config
[
"shuffle"
]
,
num_workers
=
0
)
wandb
.
init
(
project
=
"hypernetwork-tests"
,
name
=
train_config
[
"run_name"
],
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment