A set of libraries that allow the development of Reactive Dataset-servers, using protobuf files a backing storage. Inspired by Netflix Hollow.
Get Started
$ dotnet add package RxDatasets.TestImplementations.InMemoryProviderReadme
Sonar Statistics:
License
This project is licensed under the Common Public Attribution License Version 1.0 (CPAL-1.0).
You may obtain a copy of the License in the LICENSE file.
For more details, you can also refer to the full license text at the SPDX website.
Introduction
Reactive Datasets is a project which provides an efficient way to managing status updates of entities in protobuf format. It persistently stores entities in a disk format (On Azure Blob, S3, or in memory). And it allows for the retrieval of entities in a reactive way, allowing clients to get a list of all changed entities since the last time they checked.
A README for the diskformat used to store entities
Features
- Entity Management: Persistent storage and retrieval of protobuf-formatted entities
- Reactive Updates: Delta-based change tracking and notification system
- Storage Flexibility: Support for multiple backends (Local Disk, Azure Blob, S3, Google Cloud Storage, Minio)
- Change Tracking: Efficient tracking of additions, modifications, and deletions
- CountChildren: Query hierarchical entity counts by parent path (useful for testing and validation)
- gRPC Integration: Full gRPC service support for remote access to dataset operations