Skip to content

Handle tokenizer configs without tokenizer_class#2278

Open
CodingFeng101 wants to merge 1 commit into
Lightning-AI:mainfrom
CodingFeng101:codex/fix-tokenizer-dir-check
Open

Handle tokenizer configs without tokenizer_class#2278
CodingFeng101 wants to merge 1 commit into
Lightning-AI:mainfrom
CodingFeng101:codex/fix-tokenizer-dir-check

Handle missing tokenizer_class in tokenizer config

e59ec42
Select commit
Loading
Failed to load commit list.
GitGuardian / GitGuardian Security Checks succeeded Jun 25, 2026 in 34s

No secrets detected ✅

1 commit was scanned without uncovering any secrets.

Details

Commit scanned: 1

  • Pull request #2278: codex/fix-tokenizer-dir-check 👉 main

🦉 GitGuardian detects secrets in your source code to help developers and security teams secure the modern development process. You are seeing this because you or someone else with access to this repository has authorized GitGuardian to scan your pull request.