Skip to content

Separate dataset seeding from training seeding - #110

Merged
michaelmckinsey1 merged 1 commit into
LBANN:mainfrom
michaelmckinsey1:dataset-seed
Oct 8, 2026
Merged

michaelmckinsey1 merged 1 commit into
LBANN:mainfrom
michaelmckinsey1:dataset-seed

Conversation

@michaelmckinsey1

@michaelmckinsey1 michaelmckinsey1 commented Sep 29, 2026 •

Copy link
Copy Markdown
Collaborator

PR92 Enabled forced creating seeded datasets, but no way to separate the dataset seed and training seed. Using different dataset seeds creates datasets that vary in difficulty. For scaling data stability, I am enabling setting the dataset seed separately from the training seed, which reduces variability between seeds by ~5x.

Users can still vary the dataset seed and training seed together if they wish.

before (3 different dataset seeds and training seeds)
image
after (1 dataset seed, 3 training seeds)
image

@michaelmckinsey1 michaelmckinsey1 self-assigned this Sep 29, 2026
@michaelmckinsey1
michaelmckinsey1 marked this pull request as ready for review October 1, 2026 18:32
@michaelmckinsey1
michaelmckinsey1 merged commit 42d5577 into LBANN:main Oct 8, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants