The fastest tokenizer for GPT-3.5 and GPT-4 inspired by Tiktoken.
License
MIT
Deps
6
Install Size
—
Vulns
✓ 0
Published
Nov 15, 2024
$ dotnet add package Tiktoken.Core
No README available.