NRobotsCore 1.1.0

.NET Core 1.0 .NET Framework 4.5.1
There is a newer version of this package available.
See the version list below for details.
NuGet\Install-Package NRobotsCore -Version 1.1.0
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
dotnet add package NRobotsCore --version 1.1.0
<PackageReference Include="NRobotsCore" Version="1.1.0" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
paket add NRobotsCore --version 1.1.0
#r "nuget: NRobotsCore, 1.1.0"
#r directive can be used in F# Interactive, C# scripting and .NET Interactive. Copy this into the interactive tool or source code of the script to reference the package.
// Install NRobotsCore as a Cake Addin
#addin nuget:?package=NRobotsCore&version=1.1.0

// Install NRobotsCore as a Cake Tool
#tool nuget:?package=NRobotsCore&version=1.1.0

.NET Core port of sjdirect/nrobots. A robots.txt parser written in c#. This is an unofficial fork of NRobots.txt on codeplex with extended functionality. For full documentation see https://nrobots.codeplex.com/.

Product Versions
.NET net5.0 net5.0-windows net6.0 net6.0-android net6.0-ios net6.0-maccatalyst net6.0-macos net6.0-tvos net6.0-windows
.NET Core netcoreapp1.0 netcoreapp1.1 netcoreapp2.0 netcoreapp2.1 netcoreapp2.2 netcoreapp3.0 netcoreapp3.1
.NET Framework net451 net452 net46 net461 net462 net463 net47 net471 net472 net48
Compatible target framework(s)
Additional computed target framework(s)
Learn more about Target Frameworks and .NET Standard.

NuGet packages (2)

Showing the top 2 NuGet packages that depend on NRobotsCore:

Package Downloads
Abot

Abot is an open source C# web crawler built for speed and flexibility. It takes care of the low level plumbing (multithreading, http requests, scheduling, link parsing, etc..). You just register for events to process the page data. You can also plugin your own implementations of core interfaces to take complete control over the crawl process.

AbotCore

.NET Core port of sjdirect/abot. Abot is an open source C# web crawler built for speed and flexibility. It takes care of the low level plumbing (multithreading, http requests, scheduling, link parsing, etc..). You just register for events to process the page data. You can also plugin your own implementations of core interfaces to take complete control over the crawl process.

GitHub repositories (1)

Showing the top 1 popular GitHub repositories that depend on NRobotsCore:

Repository Stars
sjdirect/abot
Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.
Version Downloads Last updated
1.1.3 121,785 11/2/2020
1.1.2 56,907 10/26/2016
1.1.1-alpha1 1,714 9/26/2016
1.1.0 1,852 9/19/2016