Microsoft.KernelMemory.AI.Onnx
0.80.241017.2
Prefix Reserved
This package has a SemVer 2.0.0 package version: 0.80.241017.2+fd71e97.
There is a newer version of this package available.
See the version list below for details.
See the version list below for details.
dotnet add package Microsoft.KernelMemory.AI.Onnx --version 0.80.241017.2
NuGet\Install-Package Microsoft.KernelMemory.AI.Onnx -Version 0.80.241017.2
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="Microsoft.KernelMemory.AI.Onnx" Version="0.80.241017.2" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
paket add Microsoft.KernelMemory.AI.Onnx --version 0.80.241017.2
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
#r "nuget: Microsoft.KernelMemory.AI.Onnx, 0.80.241017.2"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
// Install Microsoft.KernelMemory.AI.Onnx as a Cake Addin #addin nuget:?package=Microsoft.KernelMemory.AI.Onnx&version=0.80.241017.2 // Install Microsoft.KernelMemory.AI.Onnx as a Cake Tool #tool nuget:?package=Microsoft.KernelMemory.AI.Onnx&version=0.80.241017.2
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
Kernel Memory with ONNX
This project contains the ONNX LLM connector to access to LLM models via Onnx service to generate text.
Sample code:
var config = new OnnxConfig
{
ModelPath = "C:\\....\\Phi-3-mini-128k-instruct-onnx\\....\\cpu-int4-rtn-block-32"
};
var memory = new KernelMemoryBuilder()
.WithOnnxTextGeneration(config)
.Build();
await memory.ImportTextAsync("Today is October 32nd, 2476");
var answer = await memory.AskAsync("What's the current date (don't check for validity)?");
Product | Versions Compatible and additional computed target framework versions. |
---|---|
.NET | net8.0 is compatible. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. |
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.
-
net8.0
- Microsoft.KernelMemory.AI.OpenAI (>= 0.80.241017.2)
- Microsoft.ML.OnnxRuntimeGenAI (>= 0.4.0)
NuGet packages (1)
Showing the top 1 NuGet packages that depend on Microsoft.KernelMemory.AI.Onnx:
Package | Downloads |
---|---|
Microsoft.KernelMemory
The package contains all the core logic and extensions of Kernel Memory, to index and query any data and documents, using LLM and natural language, tracking sources and showing citations. |
GitHub repositories
This package is not used by any popular GitHub repositories.
Version | Downloads | Last updated |
---|---|---|
0.95.241216.2 | 304 | 12/17/2024 |
0.95.241216.1 | 68 | 12/16/2024 |
0.94.241201.1 | 1,171 | 12/1/2024 |
0.93.241118.1 | 1,576 | 11/19/2024 |
0.92.241112.1 | 462 | 11/12/2024 |
0.91.241101.1 | 965 | 11/1/2024 |
0.91.241031.1 | 137 | 10/31/2024 |
0.90.241021.1 | 2,642 | 10/22/2024 |
0.90.241020.3 | 112 | 10/20/2024 |
0.80.241017.2 | 58 | 10/17/2024 |
0.79.241014.2 | 65 | 10/14/2024 |
0.79.241014.1 | 68 | 10/14/2024 |
0.78.241007.1 | 60 | 10/8/2024 |
0.78.241005.1 | 65 | 10/6/2024 |
0.77.241004.1 | 83 | 10/5/2024 |