This library provides advanced logging and telemetry enrichment capabilities for .NET applications. It allows for detailed and configurable enrichment of log entries, along with enhanced latency monitoring and logging features. It is built for applications needing sophisticated telemetry and logging insights.
The library provides two types of log sampling mechanisms: Random Probabilistic Sampling and Trace-based Sampling.
Random Probabilistic Sampling
Provides configurable probability-based sampling with flexible rules:
// Simple configuration with probability
builder.Logging.AddRandomProbabilisticSampler(0.1); // Sample 10% of all logs, meaning - 90% of logs will be dropped
builder.Logging.AddRandomProbabilisticSampler(0.1, LogLevel.Warning); // Sample 10% of Warning and lower level logs
// Configuration using options
builder.Logging.AddRandomProbabilisticSampler(options =>
{
options.Rules.Add(new RandomProbabilisticSamplerFilterRule(0.1, logLevel: LogLevel.Information)); // Sample 10% of Information and lower level logs
options.Rules.Add(new RandomProbabilisticSamplerFilterRule(1.0, logLevel: LogLevel.Error)); // Sample all Error logs
});
// Configuration using IConfiguration
builder.Logging.AddRandomProbabilisticSampler(configuration.GetSection("Logging:Sampling"));
The Random Probabilistic Sampler supports the IOptionsMonitor<T> pattern, allowing for dynamic configuration updates. This means you can change the sampling rules at runtime without needing to restart your application.
This comes in handy when you already use OpenTelemetry .NET Tracing and would like to see sampling decisions being consistent across both logs and their underlying Activity.
Log Buffering
Provides a buffering mechanism for logs, allowing you to store logs in temporary circular buffers in memory. If the buffer is full, the oldest logs will be dropped. If you want to emit the buffered logs, you can call Flush() on the buffer. That way, if you don't flush buffers, all buffered logs will eventually be dropped and that makes sense - if you don't flush buffers, chances are
those logs are not important. At the same time, you can trigger a flush on the buffer when certain conditions are met, such as when an exception occurs.
This library works with all logger providers, even if they do not implement the Microsoft.Extensions.Logging.Abstractions.IBufferedLogger interface. In that case, the library will
be calling ILogger.Log() method directly on every single buffered log record when flushing the buffer.
Global Buffering
Provides application-wide log buffering with configurable rules:
// Simple configuration with log level
builder.Logging.AddGlobalBuffer(LogLevel.Warning); // Buffer Warning and lower level logs
// Configuration using options
builder.Logging.AddGlobalBuffer(options =>
{
options.Rules.Add(new LogBufferingFilterRule(logLevel: LogLevel.Information)); // Buffer Information and lower level logs
options.Rules.Add(new LogBufferingFilterRule(categoryName: "Microsoft.*")); // Buffer logs from Microsoft namespaces
});
// Configuration using IConfiguration
builder.Logging.AddGlobalBuffer(configuration.GetSection("Logging:Buffering"));
Then, to flush the global buffer when a bad thing happens, call the Flush() method on the injected GlobalLogBuffer instance:
public class MyService
{
private readonly GlobalLogBuffer _globalLogBuffer;
public MyService(GlobalLogBuffer globalLogBuffer)
{
_globalLogBuffer = globalLogBuffer;
}
public void DoSomething()
{
try
{
// ...
}
catch (Exception ex)
{
// Flush the global buffer when an exception occurs
_globalLogBuffer.Flush();
}
}
}
The Global Log Buffer supports the IOptionsMonitor<T> pattern, allowing for dynamic configuration updates. This means you can change the buffering rules at runtime without needing to restart your application.
Limitations
This library does not preserve the order of log records. However, original timestamps are preserved.
The library does not support custom configuration per each logger provider. Same configuration is applied to all logger providers.
Log scopes are not supported. This means that if you use ILogger.BeginScope() method, the buffered log records will not be associated with the scope.
When buffering and then flushing buffers, not all information of the original log record is preserved. This is due to serializing/deserializing limitation, but can be
revisited in future. Namely, this library uses Microsoft.Extensions.Logging.Abstractions.BufferedLogRecord class when converting buffered log records to actual log records, but omits following properties:
Enriches logs with application-specific information based on ApplicationMetadata information. The bellow calls will add the application log enricher to the service collection.
// Add service log enricher with default settings
builder.Services.AddApplicationLogEnricher();
// Or configure with options
builder.Services.AddApplicationLogEnricher(options =>
{
options.ApplicationName = true;
options.BuildVersion = true;
options.DeploymentRing = true;
options.EnvironmentName = true;
});
Latency Monitoring
Provides tools for latency data collection and export. The bellow example uses the built-in Console exporter, but custom exporters can be created by implementing the ILatencyDataExporter interface.
In order for the latency data to be exported, a call to ILatencyDataExporter.ExportAsync() is required. This can either be called manually, or by using the Request Latency Middleware inside the Microsoft.AspNetCore.Diagnostics.Middleware package by adding:
Offers additional logging capabilities like stack trace capturing, exception message inclusion, and log redaction.
// Enable log enrichment.
builder.Logging.EnableEnrichment(options =>
{
options.CaptureStackTraces = true;
options.IncludeExceptionMessage = true;
options.MaxStackTraceLength = 500;
options.UseFileInfoForStackTraces = true;
});
builder.Services.AddApplicationLogEnricher(); // <- This call is required in order for the enricher to be added into the service collection.
// Enable log redaction
builder.Logging.EnableRedaction(options =>
{
options.ApplyDiscriminator = true;
});
builder.Services.AddRedaction(); // <- This call is required in order for the redactor provider to be added into the service collection.