ParallelAsync

Name: CSRakowski.ParallelAsync
Author: Christiaan Rakowski

A .NET utility library for running async methods in parallel batches.

Available on NuGet: and GitHub:

Example usage:

using CSRakowski.Parallel;

List<string> fileUrls = GetFileUrls();

var files = await ParallelAsync.ForEachAsync(fileUrls, (url) => {
    return DownloadFileAsync(url);
}, maxBatchSize: 8, allowOutOfOrderProcessing: true);

As of version 1.1 a fluent syntax is also available:

using CSRakowski.Parallel.Extensions;

List<string> fileUrls = GetFileUrls();

var files = await fileUrls
                    .AsParallelAsync()
                    .WithMaxDegreeOfParallelism(8)
                    .WithOutOfOrderProcessing(false)
                    .ForEachAsync((url) => {
                        return DownloadFileAsync(url);
                    });

In version 1.6, support for Async Streams has been added. This allows you to chain together multiple invocations by passing along an IAsyncEnumerable<T>, sort of like a pipeline:

using CSRakowski.Parallel;

List<string> fileUrls = GetFileUrls();

var fileDataStream = ParallelAsync.ForEachAsyncStream(fileUrls, (url) => {
    return DownloadFileAsync(url);
}, maxBatchSize: 4, allowOutOfOrderProcessing: true);

var resultStream = ParallelAsync.ForEachAsyncStream(fileDataStream, (fileData) => {
    return ParseFileAsync(fileData);
}, maxBatchSize: 4, allowOutOfOrderProcessing: true);

await foreach (var result in resultStream)
{
    HandleResult(result);
}

csrakowski/CSRakowski.ParallelAsyncv1.7.1

Get Started

Readme

ParallelAsync

Release notes

1.7.1

1.7.0

1.6.0

1.5.4

1.5.2

1.5.1

1.5.0

1.4.1

1.4

1.3.2

1.3.1

1.3

1.2.1

1.2

1.1.1

1.1

1.0.1

1.0