Alumis.Text.Tokenization 1.0.6

Text tokenization based on Unicode grapheme clustering, and the XID_Start and XID_Continue binary properties.

There is a newer version of this package available.
See the version list below for details.

Install-Package Alumis.Text.Tokenization -Version 1.0.6

dotnet add package Alumis.Text.Tokenization --version 1.0.6

<PackageReference Include="Alumis.Text.Tokenization" Version="1.0.6" />

For projects that support PackageReference, copy this XML node into the project file to reference the package.

paket add Alumis.Text.Tokenization --version 1.0.6

The NuGet Team does not provide support for this client. Please contact its maintainers for support.

#r "nuget: Alumis.Text.Tokenization, 1.0.6"

For F# scripts that support #r syntax, copy this into the source code to reference the package.

Dependencies

This package is not used by any NuGet packages.

This package is not used by any popular GitHub repositories.