32 packages tagged with “npipeline”
Extensible storage abstraction layer for NPipeline - supports pluggable storage providers (file system, cloud storage, etc.)
Testing utilities for NPipeline including in-memory nodes, test harness, and assertion helpers
Storage provider abstractions and implementations for NPipeline - interfaces, models, and base classes for storage operations
FluentAssertions extensions for NPipeline testing - adds fluent assertion methods for pipeline execution results
AwesomeAssertions extensions for NPipeline testing - adds assertion methods for pipeline execution results
CSV source and sink nodes for NPipeline using CsvHelper - read and write CSV files with configurable options
NPipeline analyzers and code fixes for detecting and resolving common pipeline configuration issues
Microsoft.Extensions.DependencyInjection integration for NPipeline - enables automatic node registration and lifetime management
Lineage extension for NPipeline - provides comprehensive data lineage tracking and provenance capabilities
High-performance pipeline composition extension for NPipeline - enables treating entire pipelines as nodes within larger pipelines
High-performance parallel execution strategies for NPipeline with configurable backpressure and queue policies
Observability extension for NPipeline - provides comprehensive metrics collection and monitoring capabilities
SQL Server source and sink nodes for NPipeline using Microsoft.Data.SqlClient - read from and write to SQL Server databases with configurable options
Excel source and sink nodes for NPipeline using ExcelDataReader - read and write Excel files (XLS, XLSX) with configurable options
JSON source and sink nodes for NPipeline using System.Text.Json - read and write JSON files with configurable options
SQL Server connector-specific analyzers for NPipeline, including checkpointing validation
PostgreSQL connector-specific analyzers for NPipeline, including checkpointing validation
PostgreSQL source and sink nodes for NPipeline using Npgsql - read from and write to PostgreSQL databases with configurable options
OpenTelemetry integration for NPipeline observability - provides seamless integration with OpenTelemetry SDKs for distributed tracing
AWS SQS source and sink nodes for NPipeline - integrate with Amazon Simple Queue Service for reliable message queuing
High-performance, dependency-free extension library providing ready-made data processing nodes for NPipeline. Includes cleansing, validation, filtering, type conversion, and enrichment nodes for strings, numbers, dates, and collections.
Parquet source and sink nodes for NPipeline using Parquet.Net - read and write Parquet files with configurable options
Azure Cosmos DB source and sink nodes for NPipeline - read from and write to Cosmos DB containers with SQL queries and Change Feed support
Data Lake table abstractions for NPipeline - partitioned writes, manifests, snapshots, and time travel with Parquet as the default format
RabbitMQ source and sink nodes for NPipeline - high-performance streaming connector built on RabbitMQ.Client 7.x async API
Apache Kafka source and sink nodes for NPipeline - integrate with Kafka for high-throughput streaming with Avro/Protobuf support
DuckDB source and sink nodes for NPipeline — embedded analytical database with native Parquet/CSV/JSON support, SQL queries, and high-performance Appender API
Snowflake source and sink nodes for NPipeline using Snowflake.Data - read from and write to Snowflake with streaming, batching, and staged COPY bulk loading