skills/geniml/scripts/tokenizer_compatibility.py

• build_parser · function · L33-L73 — def build_parser() -> argparse.ArgumentParser
• _safe_child · function · L76-L79 — def _safe_child(directory: Path, name: str) -> Path
• _count_universe · function · L82-L125 — def _count_universe( path: Path, *, max_bytes: int, max_records: int, ) -> tuple[int, int, Counter[str]]
• _parquet_magic · function · L128-L143 — def _parquet_magic(path: Path) -> bool
• inspect · function · L146-L307 — def inspect(args: argparse.Namespace) -> tuple[dict, int]
• main · function · L310-L317 — def main() -> int