Lightweight ScraperAPI client for .NET. Web scraping with automatic proxy rotation, CAPTCHA solving, and JavaScript rendering. Scrape any website without getting blocked. Features: async scraping, screenshots, country targeting, session management, auto-parsing, structured data extraction.
Lightweight ScraperAPI client for .NET. Scrape any website without getting blocked - automatic proxy rotation, CAPTCHA solving, and JavaScript rendering.
Features
Simple Scraping - One line to scrape any URL
JavaScript Rendering - Scrape SPAs and dynamic content
Screenshots - Capture full page screenshots
Geo-Targeting - Scrape from specific countries
Premium Proxies - Residential and mobile IPs
Async Jobs - Background scraping for large batches
Auto-Parse - Get structured JSON from popular sites
ASP.NET Core Ready - Built-in dependency injection
Multi-Target - .NET 8, .NET 6, .NET Standard 2.0
Quick Start
Install
dotnet add package ForeverTools.ScraperAPI
Get Your API Key
Sign up at ScraperAPI to get your API key with 5,000 free credits.
Basic Usage
using ForeverTools.ScraperAPI;
var client = new ScraperApiClient("your-api-key");
// Simple scrape
var html = await client.ScrapeAsync("https://example.com");
// With JavaScript rendering (for SPAs)
var rendered = await client.ScrapeWithJavaScriptAsync("https://spa-example.com");
// From a specific country
var usContent = await client.ScrapeFromCountryAsync("https://example.com", "us");
Advanced Usage
Full Request Configuration
var request = new ScrapeRequest
{
Url = "https://example.com",
RenderJavaScript = true,
CountryCode = "us",
Premium = true,
DeviceType = DeviceTypes.Mobile,
AutoParse = true
};
var response = await client.ScrapeWithResponseAsync(request);
if (response.Success)
{
Console.WriteLine($"Status: {response.StatusCode}");
Console.WriteLine(response.Content);
}
Screenshots
// Get screenshot as base64
var base64 = await client.TakeScreenshotAsync("https://example.com");
// Get screenshot as bytes (for saving to file)
var bytes = await client.TakeScreenshotBytesAsync("https://example.com");
File.WriteAllBytes("screenshot.png", bytes);
Async Jobs (Background Scraping)
// Submit job and wait for completion
var response = await client.ScrapeAsyncAndWaitAsync(new ScrapeRequest
{
Url = "https://example.com",
RenderJavaScript = true
});
// Or manage jobs manually
var job = await client.SubmitAsyncJobAsync(request);
Console.WriteLine($"Job ID: {job.Id}");
// Check status later
var status = await client.GetAsyncJobStatusAsync(job.Id);
if (status.IsFinished)
{
Console.WriteLine(status.Response.Body);
}
// Inject and use
public class PriceScraperService
{
private readonly ScraperApiClient _scraper;
public PriceScraperService(ScraperApiClient scraper)
{
_scraper = scraper;
}
public async Task<string> GetProductPageAsync(string url)
{
return await _scraper.ScrapeWithJavaScriptAsync(url);
}
}
Environment Variables
// Uses SCRAPERAPI_KEY by default
var client = ScraperApiClient.FromEnvironment();
// Or specify custom variable name
var client = ScraperApiClient.FromEnvironment("MY_SCRAPER_KEY");
Request Options
Option
Description
Credits
Basic scrape
Default HTML scraping
1
RenderJavaScript
Execute JavaScript
+10
Screenshot
Capture page screenshot
+10
Premium
Residential/mobile proxies
+10
UltraPremium
Advanced bypass
+30
CountryCode
Geo-targeting
+0
SessionNumber
Sticky sessions
+0
AutoParse
Structured JSON output
+0
Country Codes
Common codes: us, uk, de, fr, es, it, br, ca, au, jp, in
