This is the core extension package. Always use it in conjunction with the corresponding database package (e.g., ETLBox.Postgres for PostgreSQL or ETLBox.SqlServer for SQL Server). ETLBox.EntityFramework extends Entity Framework (Core) with additional bulk operations, including insert, update, upsert, delete, and merge. While SaveChanges() is already optimized for performance, these bulk extensions may offer improvements in certain scenarios. These extensions are particularly useful when integrating ETL processes into your DbContext, especially when working with large datasets that cannot be fully loaded into memory. For tutorials, examples, and documentation, visit: https://ef.etlbox.net
Get Started
$ dotnet add package ETLBox.EntityFrameworkReadme
What is ETLBox
ETLBox is a lightweight ETL (extract, transform, load) library and data integration toolbox for .NET. You can use it to read any data from different sources and connect them with customizable transformations. Finally, you can export the data into different databases, web endpoints, file types or any other destinations. While data is processed in memory, you can choose between different transformation components to harmonize, filter, aggregate, validate and clean your data.
ETLBox is a fully functional alternative to other ETL tools like SQLServer Integrations Services (SSIS) or Azure Data Factory. The main difference to other toolsets is that it doesn’t come with a User Interface. But no worries! Working with ETLBox, you will discover that creating data flows programmatically is the best approach for solving most of your ETL and data integration related problems.
Why should I choose ETLBox?
Here are a few things you can do with ETLBox:
- Convert incoming data to a common format.
- Prepare data for analysis and visualization.
- Migrate between databases.
- Share data processing logic across web apps, batch jobs, and APIs.
- Power your data ingestion and integration tools.
- Consume large CSV, Excel or Json files.
- Process big data with a limited amount of memory.
- Bulk insert, update or delete into your database.
Core concepts
ETLBox is a data processing engine based on .NET Core, giving you the power to create your own ETL processes. This engine runs inside your applications, APIs, and jobs to extract, filter, transform, migrate data on-the-fly. ETLBox speeds up your development by providing an easy-to-use toolbox for integrating your data from different sources within your app and load them into any target you like.
Learn more: www.etlbox.net
Ready to learn more? Visit www.etlbox.net and get started with coding your own ETL jobs with C#!