/

a fast, modern browser for the NuGet registry

built Mar 4, 2026 · v0.1.0

about keyboard shortcuts

NuGet is a registered trademark of Microsoft. This site is not affiliated with Microsoft.

lof/Lofcz.Forks.Tiktokenv1.1.6

.NET 8.0

The fastest tokenizer for GPT-3.5 and GPT-4 inspired by Tiktoken. This fork contains a printable version of Explore()

License

MIT

Deps

0

Install Size

—

Vulns

✓ 0

Published

Feb 18, 2024

Get Started

$ dotnet add package Lofcz.Forks.Tiktoken

Readme

Tiktoken

This is a hard-forked version of https://github.com/tryAGI/Tiktoken sans pre .NET 8 support and with a printable version of Explore().

Total Downloads

760

Compatibility

.NET 8.0

Versions

1.1.6Latest

Feb 18, 2024

Other versions (2)

1.1.5Feb 18, 2024

1.1.4Feb 18, 2024

Links

Keywords

chatgpt openai tiktoken tokens

Maintainers