verl/utils/tokenizer.py

• set_pad_token_id · function · L20-L32 — def set_pad_token_id(tokenizer)
• hf_tokenizer · function · L35-L58 — def hf_tokenizer(name_or_path, correct_pad_token=True, correct_gemma2=True, **kwargs)