← Về thư mục
- FSDPUlyssesShardingManager · class · L33-L88 — class FSDPUlyssesShardingManager(BaseShardingManager)
- init · method · L38-L41 — def init(self, device_mesh: DeviceMesh)
- enter · method · L43-L49 — def enter(self)
- exit · method · L51-L56 — def exit(self, exc_type, exc_value, traceback): # restore random states
- preprocess_data · method · L58-L78 — def preprocess_data(self, data: DataProto) -> DataProto
- postprocess_data · method · L80-L88 — def postprocess_data(self, data: DataProto) -> DataProto