IronSoftware/IronWebScraperv2023.7.3

✓ Verified.NET Std2.0.NET Std2.1

Iron WebScraper is a C# web scraping library, allowing developers to simulate & automate human browsing behavior to extract content, files & images from web applications as native .NET objects. Iron Web Scraper manages politeness & multithreading in the background, leaving a developer’s own application easy to understand & maintain. Iron Web Scraper can be used to migrate content from existing websites as well as build search indexes and monitor website structure & content changes. It's functionality includes: » Read & extract structured content from web pages using html DOM, Javascript, Xpath, jQuery Style CSS Selectors. » Fast multi threading allows hundreds of simultaneous requests. » Politely avoid over stalling remote servers using IP/domain level throttling & optionally respecting robots.txt » Manage multiple identities, DNS, proxies, user agents, request methods, custom headers, cookies & logins. » Data exported from websites becomes native C# objects which can be stored or used immediately. » Exceptions managed in all but the developers own code. Errors and captchas auto retried on failure » Save, pause, resume, autosave scrape jobs. » Built in web cache allows for action replay, crash recovery, and querying existing web scrape data. Change scrape logic on the fly, then replay job without internet traffic. Supports: Framework .NET 4.6.2+, .NET Core 3.1+, .NET Standard 2.0+, .NET 5, .NET 6, .NET 7, .NET 8 and .NET 9 on Windows, Linux, macOS, Mobile, AWS and Azure Licensing & Support available for commercial deployments. For code examples, documentation & more visit http://ironsoftware.com/cshapr/webscraper. For support please email us at support@ironsoftware.com.

ironsoftware.com ↗

License

View license

Deps

Install Size

—

Vulns

✓ 0

Published

Feb 26, 2026

Get Started

$ dotnet add package IronWebScraper

Readme

Nuget

Iron WebScraper - The C# WebScraping Library

PM> Install-Package IronWebScraper

using IronWebScraper;

namespace YourApp
{
    public class Program
    {
        private static void Main(string[] args)
        {
            var ScrapeJob = new BlogScraper();
            ScrapeJob.Start();
        }
    }

    public class BlogScraper : WebScraper
    {
        public override void Init()
        {
            LoggingLevel = LogLevel.All;
            Request("https://www.zyte.com/blog/", Parse);
        }

        public override void Parse(Response response)
        {
            foreach (HtmlNode title_link in response.Css(".oxy-post-title"))
            {
                string strTitle = title_link.TextContentClean;
                Scrape(new ScrapedData() { { "Title", strTitle } });
            }

            if (response.CssExists("div.oxy-easy-posts-pages > a[href]"))
            {
                string next_page = response.Css("div.oxy-easy-posts-pages > a[href]")[0].Attributes["href"];
                Request(next_page, Parse);
            }
        }
    }
}

IronSoftware/IronWebScraperv2023.7.3

Get Started

Readme

Iron WebScraper - The C# WebScraping Library

Iron WebScraper allows developers to:

Iron WebScraper has cross platform support compatibility with:

Using Iron WebScraper

Licensing & Support available

Documentation Links