← Về thư mục
verl/single_controller/ray/megatron.py
- NVMegatronRayWorkerGroup · class · L25-L35 — class NVMegatronRayWorkerGroup(RayWorkerGroup, MegatronWorkerGroup)
- init · method · L31-L35 — def init(self, resource_pool: RayResourcePool, ray_cls_with_init: RayClassWithInitArgs, **kwargs)
- MegatronRayWorkerGroup · class · L38-L62 — class MegatronRayWorkerGroup(RayWorkerGroup, MegatronWorkerGroup)
- init · method · L44-L56 — def init(self, resource_pool: RayResourcePool, ray_cls_with_init: RayClassWithInitArgs, default_megatron_kwargs: Dict = None, **kwargs)
- init_megatron · method · L58-L62 — def init_megatron(self, default_megatron_kwargs: Optional[Dict] = None): # after super, we will call init of each worker