Microsoft.DeepDev Microsoft.DeepDev.TokenizerLib by: Microsoft Microsoft.DeepDev .NET Standard 2.0 This package targets .NET Standard 2.0. The package is compatible with this framework or higher. 482,104 total downloads last updated 1/11/2024 Latest version: 1.3.3 Tokenizer for OpenAI large language models.