Skip To Content
Toggle navigation
Packages
Upload
Statistics
Documentation
Downloads
Blog
Sign in
Advanced search filters
Frameworks
Include compatible frameworks
Framework Filter Mode
ALL
ANY
.NET
net8.0
net7.0
net6.0
net5.0
.NET Core
netcoreapp3.1
netcoreapp3.0
netcoreapp2.2
netcoreapp2.1
netcoreapp2.0
netcoreapp1.1
netcoreapp1.0
.NET Standard
netstandard2.1
netstandard2.0
netstandard1.6
netstandard1.5
netstandard1.4
netstandard1.3
netstandard1.2
netstandard1.1
netstandard1.0
.NET Framework
net481
net48
net472
net471
net47
net462
net461
net46
net452
net451
net45
net40
net35
net30
net20
Package type
All types
Dependency
.NET tool
Template
Options
Include prerelease
6 packages returned for Tags:"tiktoken"
Sort by
Relevance
Downloads
Recently updated
Tiktoken
by:
havendv
tryAGI
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
209,008 total downloads
last updated
2/18/2024
Latest version:
1.2.0
chatgpt
openai
tiktoken
tokens
gpt-4
gpt-3.5-turbo
cl100k_base
p50k_base
The fastest tokenizer for GPT-3.5 and GPT-4 inspired by Tiktoken.
LLMSharp.
Anthropic.
Tokenizer
by:
veerash-ayyagari
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
14,121 total downloads
last updated
10/4/2023
Latest version:
2.0.3
anthropic
tokenizer
claude
dotnet
tiktoken
Anthropic Claude BPE Tokenizer unofficial implementation
LLMSharp.
OpenAi.
Tokenizer
by:
veerash-ayyagari
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
4,210 total downloads
last updated
10/4/2023
Latest version:
2.0.3
openai
gpt
3.5
gpt
4
tokenizer
dotnet
tiktoken
Open AI Chat Completion Models (GPT 3.5/GPT 4) BPE Tokenizer unofficial implementation
BpeTokenizer
by:
AllenCopeland
.NET 7.0
970 total downloads
last updated
7/21/2023
Latest version:
1.0.5
BytePairEncoding
BPE
OpenAI
tiktoken
.NET
Package Description
Lofcz.
Forks.
Tiktoken
by:
lof
.NET 8.0
282 total downloads
last updated
2/18/2024
Latest version:
1.1.6
chatgpt
openai
tiktoken
tokens
gpt-4
gpt-3.5-turbo
cl100k_base
p50k_base
The fastest tokenizer for GPT-3.5 and GPT-4 inspired by Tiktoken. This fork contains a printable version of Explore()
Microsoft.
KernelMemory.
AI.
TikToken
by:
Microsoft
MicrosoftOCTO
.NET 8.0
26 total downloads
last updated
4/28/2024
Latest version:
0.39.240427.1
TikToken
Tokenization
BPE
GPT4
GPT
Memory
RAG
Kernel
Semantic
Episodic
More tags
Provide TikToken tokenizers in Kernel Memory