17 packages tagged with “ingestion”
A library for ingesting data to Azure Monitor.
Use this for EventHub distributed partition processing. For more information please visit http://go.microsoft.com/fwlink/?LinkID=403957 Please note that a newer package Azure.Messaging.EventHubs.Processor is available as of February 2020. While this package will continue to receive critical bug fixes, we strongly encourage you to upgrade. Read the migration guide at https://aka.ms/azsdk/net/migrate/eh for more details. This package requires at least .Net Framework 4.6.2.
Serilog event sink that writes to Azure Analytics
High-performance .NET SDK for streaming data ingestion into Databricks Delta tables using the Zerobus service.
Core data file processing pipeline for CSV, JSON, Excel, Parquet, and SQLite database ingestion with relationship detection
Data ingestion abstractions for AIKit.
A .NET library for document ingestion and processing pipelines.
Unified, read-only document extraction facade for OfficeIMO (Word/Excel/PowerPoint/Markdown/PDF) intended for AI ingestion.
High-performance batch data ingestion library for relational databases with controlled parallelism and resource limits
Railtown Ingestion Client
REST SDK client for the Jebi service. Provides IJebiSdkService to manage catalog metadata, ingestion plans and local execution against a remote Jebi server.
SemanticDocIngestor.Core is a powerful .NET 9 SDK for document ingestion, semantic search, and retrieval-augmented generation (RAG) with hybrid search capabilities. Build intelligent document processing pipelines with vector and keyword search powered by Qdrant and Elasticsearch. Supports multi-source ingestion from local files, OneDrive, and Google Drive with real-time progress tracking and AI-powered answers using Ollama LLM models.
High-performance message ingestion and relay server. Receives data via HTTP, batch-persists to SQLite, and relays to downstream endpoints with retry and ordering guarantees. Capable of 50K+ messages/second.
Microsoft.Extensions.AI.DataIngestion integration for DocumentAtom document parsing library. Provides adapters for using DocumentAtom's document processing capabilities in standard .NET AI/RAG pipelines.