Skip to content

Add vocabulary-parallel KL support to OPSD - #1019

Open
0z5a wants to merge 4 commits into
deepspeedai:masterfrom
0z5a:feat/opsd-vocab-parallel-20261014
Open

Add vocabulary-parallel KL support to OPSD#1019
0z5a wants to merge 4 commits into
deepspeedai:masterfrom
0z5a:feat/opsd-vocab-parallel-20261014

Copy OPSD teacher cache chunks to the device from pinned memory

cea3bf7
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 17, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO