verl/utils/megatron/sequence_parallel.py

• mark_parameter_as_sequence_parallel · function · L21-L22 — def mark_parameter_as_sequence_parallel(parameter)
• is_sequence_parallel_param · function · L25-L26 — def is_sequence_parallel_param(param)
• pad_to_sequence_parallel · function · L29-L54 — def pad_to_sequence_parallel(unpad_tokens: torch.Tensor)