TUnit.Playwright v0.55.23 — nugetz
thomhurst/ TUnit.Playwright v0.55.23 ✓ Verified .NET 8.0 .NET 9.0 .NET 10.0 .NET Std2.0
A .NET Testing Framework
Get Started dotnet CLI PackageReference Package Manager
$ dotnet add package TUnit.PlaywrightReadme
🚀 The Modern Testing Framework for .NET
TUnit is a next-generation testing framework for C# that outpaces traditional frameworks with source-generated tests , parallel execution by default , and Native AOT support . Built on the modern Microsoft.Testing.Platform, TUnit delivers faster test runs, better developer experience, and unmatched flexibility.
⚡ Why Choose TUnit? Feature Traditional Frameworks TUnit Test Discovery ❌ Runtime reflection ✅ Compile-time generation Execution Speed ❌ Sequential by default ✅ Parallel by default Modern .NET ⚠️ Limited AOT support ✅ Full Native AOT & trimming Test Dependencies ❌ Not supported ✅ [DependsOn] chains Resource Management ❌ Manual lifecycle ✅ Intelligent cleanup
⚡ Parallel by Default - Tests run concurrently with intelligent dependency management
🎯 Compile-Time Discovery - Know your test structure before runtime
🔧 Modern .NET Ready - Native AOT, trimming, and latest .NET features
🎭 Extensible - Customize data sources, attributes, and test behavior
🏁 Quick Start
Using the Project Template (Recommended) dotnet new install TUnit.Templates
dotnet new TUnit -n "MyTestProject"
Manual Installation dotnet add package TUnit --prerelease
✨ Key Features
🚀 Performance & Modern Platform
🔥 Source-generated tests (no reflection)
⚡ Parallel execution by default
🚀 Native AOT & trimming support
📈 Optimized for performance
🎯 Advanced Test Control
🔗 Test dependencies with [DependsOn]
🎛️ Parallel limits & custom scheduling
🛡️ Built-in analyzers & compile-time checks
🎭 Custom attributes & extensible conditions
📊 Rich Data & Assertions
📋 Multiple data sources ([Arguments], [Matrix], [ClassData])
✅ Fluent async assertions
🔄 Smart retry logic & conditional execution
📝 Rich test metadata & context
🔧 Developer Experience
💉 Full dependency injection support
🪝 Comprehensive lifecycle hooks
🎯 IDE integration (VS, Rider, VS Code)
📚 Extensive documentation & examples
📝 Simple Test Example [Test]
public async Task User_Creation_Should_Set_Timestamp()
{
// Arrange
var userService = new UserService();
// Act
var user = await userService.CreateUserAsync("john.doe@example.com");
// Assert - TUnit's fluent assertions
await Assert.That(user.CreatedAt)
.IsEqualTo(DateTime.Now)
.Within(TimeSpan.FromMinutes(1));
await Assert.That(user.Email)
.IsEqualTo("john.doe@example.com");
}
🎯 Data-Driven Testing [Test]
[Arguments("user1@test.com", "ValidPassword123")]
[Arguments("user2@test.com", "AnotherPassword456")]
[Arguments("admin@test.com", "AdminPass789")]
public async Task User_Login_Should_Succeed(string email, string password)
{
var result = await authService.LoginAsync(email, password);
await Assert.That(result.IsSuccess).IsTrue();
}
// Matrix testing - tests all combinations
[Test]
[MatrixDataSource]
public async Task Database_Operations_Work(
[Matrix("Create", "Update", "Delete")] string operation,
[Matrix("User", "Product", "Order")] string entity)
{
await Assert.That(await ExecuteOperation(operation, entity))
.IsTrue();
}
🔗 Advanced Test Orchestration [Before(Class)]
public static async Task SetupDatabase(ClassHookContext context)
{
await DatabaseHelper.InitializeAsync();
}
[Test, DisplayName("Register a new account")]
[MethodDataSource(nameof(GetTestUsers))]
public async Task Register_User(string username, string password)
{
// Test implementation
}
[Test, DependsOn(nameof(Register_User))]
[Retry(3)] // Retry on failure
public async Task Login_With_Registered_User(string username, string password)
{
// This test runs after Register_User completes
}
[Test]
[ParallelLimit<LoadTestParallelLimit>] // Custom parallel control
[Repeat(100)] // Run 100 times
public async Task Load_Test_Homepage()
{
// Performance testing
}
// Custom attributes
[Test, WindowsOnly, RetryOnHttpError(5)]
public async Task Windows_Specific_Feature()
{
// Platform-specific test with custom retry logic
}
public class LoadTestParallelLimit : IParallelLimit
{
public int Limit => 10; // Limit to 10 concurrent executions
}
🔧 Smart Test Control // Custom conditional execution
public class WindowsOnlyAttribute : SkipAttribute
{
public WindowsOnlyAttribute() : base("Windows only test") { }
public override Task<bool> ShouldSkip(TestContext testContext)
=> Task.FromResult(!OperatingSystem.IsWindows());
}
// Custom retry logic
public class RetryOnHttpErrorAttribute : RetryAttribute
{
public RetryOnHttpErrorAttribute(int times) : base(times) { }
public override Task<bool> ShouldRetry(TestInformation testInformation,
Exception exception, int currentRetryCount)
=> Task.FromResult(exception is HttpRequestException { StatusCode: HttpStatusCode.ServiceUnavailable });
}
🎯 Perfect For Every Testing Scenario
🧪 Unit Testing
[Test]
[Arguments(1, 2, 3)]
[Arguments(5, 10, 15)]
public async Task Calculate_Sum(int a, int b, int expected)
{
await Assert.That(Calculator.Add(a, b))
.IsEqualTo(expected);
}
Fast, isolated, and reliable
🔗 Integration Testing
[Test, DependsOn(nameof(CreateUser))]
public async Task Login_After_Registration()
{
// Runs after CreateUser completes
var result = await authService.Login(user);
await Assert.That(result.IsSuccess).IsTrue();
}
Stateful workflows made simple
⚡ Load Testing
[Test]
[ParallelLimit<LoadTestLimit>]
[Repeat(1000)]
public async Task API_Handles_Concurrent_Requests()
{
await Assert.That(await httpClient.GetAsync("/api/health"))
.HasStatusCode(HttpStatusCode.OK);
}
Built-in performance testing
🚀 What Makes TUnit Different?
Compile-Time Intelligence Tests are discovered at build time, not runtime - enabling faster discovery, better IDE integration, and precise resource lifecycle management.
Parallel-First Architecture Built for concurrency from day one with [DependsOn] for test chains, [ParallelLimit] for resource control, and intelligent scheduling.
Extensible by Design The DataSourceGenerator<T> pattern and custom attribute system let you extend TUnit's capabilities without modifying core framework code.
🏆 Community & Ecosystem
🌟 Join thousands of developers modernizing their testing
🤝 Active Community
🛠️ IDE Support TUnit works seamlessly across all major .NET development environments:
Visual Studio (2022 17.13+) ✅ Fully supported - No additional configuration needed for latest versions
⚙️ Earlier versions : Enable "Use testing platform server mode" in Tools > Manage Preview Features
JetBrains Rider ⚙️ Setup : Enable "Testing Platform support" in Settings > Build, Execution, Deployment > Unit Testing > VSTest
Visual Studio Code ⚙️ Setup : Install C# Dev Kit and enable "Use Testing Platform Protocol"
Command Line ✅ Full CLI support - Works with dotnet test, dotnet run, and direct executable execution
📦 Package Options Package Use Case TUnit⭐ Start here - Complete testing framework (includes Core + Engine + Assertions) TUnit.Core📚 Test libraries and shared components (no execution engine) TUnit.Engine🚀 Test execution engine and adapter (for test projects) TUnit.Assertions✅ Standalone assertions (works with any test framework) TUnit.Playwright🎭 Playwright integration with automatic lifecycle management
🎯 Migration from Other Frameworks Coming from NUnit or xUnit? TUnit maintains familiar syntax while adding modern capabilities:
// Enhanced with TUnit's advanced features
[Test]
[Arguments("value1")]
[Arguments("value2")]
[Retry(3)]
[ParallelLimit<CustomLimit>]
public async Task Modern_TUnit_Test(string value) { }
📖 Need help migrating? Check our detailed Migration Guides
💡 Current Status The API is mostly stable, but may have some changes based on feedback or issues before v1.0 release.
🚀 Ready to Experience the Future of .NET Testing?
⚡ Start in 30 Seconds
# Create a new test project with examples
dotnet new install TUnit.Templates && dotnet new TUnit -n "MyAwesomeTests"
# Or add to existing project
dotnet add package TUnit --prerelease
🎯 Why Wait? Join the Movement
📈 Performance
Optimized execution
Parallel by default
Zero reflection overhead
🔮 Future-Ready
Native AOT support
Latest .NET features
Source generation
🛠️ Developer Experience
Compile-time checks
Rich IDE integration
Intelligent debugging
🎭 Flexibility
Test dependencies
Custom attributes
Extensible architecture
📖 Learn More : tunit.dev | 💬 Get Help : GitHub Discussions | ⭐ Show Support : Star on GitHub
TUnit is actively developed and production-ready. Join our growing community of developers who've made the switch!
Performance Benchmark
Scenario: Building the test project
macos-latest
BenchmarkDotNet v0.15.2, macOS Sonoma 14.7.6 (23H626) [Darwin 23.6.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median Build_TUnit 0.55.6 1.172 s 0.0662 s 0.1952 s 1.1239 s Build_NUnit 4.4.0 1.298 s 0.0514 s 0.1517 s 1.2463 s Build_xUnit 2.9.3 1.223 s 0.0436 s 0.1278 s 1.1568 s Build_MSTest 3.10.2 1.067 s 0.0715 s 0.2096 s 0.9933 s
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.2 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median Build_TUnit 0.55.6 1.930 s 0.0382 s 0.0584 s 1.917 s Build_NUnit 4.4.0 1.598 s 0.0183 s 0.0162 s 1.600 s Build_xUnit 2.9.3 1.611 s 0.0275 s 0.0244 s 1.613 s Build_MSTest 3.10.2 1.571 s 0.0283 s 0.0265 s 1.565 s
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.3932) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median Build_TUnit 0.55.6 1.886 s 0.0338 s 0.0636 s 1.872 s Build_NUnit 4.4.0 1.578 s 0.0264 s 0.0234 s 1.585 s Build_xUnit 2.9.3 1.593 s 0.0183 s 0.0143 s 1.592 s Build_MSTest 3.10.2 1.579 s 0.0152 s 0.0135 s 1.574 s
Scenario: Tests focused on assertion performance and validation
macos-latest
BenchmarkDotNet v0.15.2, macOS Sonoma 14.7.6 (23H626) [Darwin 23.6.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 NA NA NA NA TUnit 0.55.6 NA NA NA NA NUnit 4.4.0 NA NA NA NA xUnit 2.9.3 NA NA NA NA MSTest 3.10.2 NA NA NA NA
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.NUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.xUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.MSTest: Job-YNJDZW(Runtime=.NET 9.0)
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.2 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 NA NA NA NA TUnit 0.55.6 NA NA NA NA NUnit 4.4.0 NA NA NA NA xUnit 2.9.3 NA NA NA NA MSTest 3.10.2 NA NA NA NA
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.NUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.xUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.MSTest: Job-YNJDZW(Runtime=.NET 9.0)
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.3932) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 NA NA NA NA TUnit 0.55.6 NA NA NA NA NUnit 4.4.0 NA NA NA NA xUnit 2.9.3 NA NA NA NA MSTest 3.10.2 NA NA NA NA
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.NUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.xUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.MSTest: Job-YNJDZW(Runtime=.NET 9.0)
Scenario: Tests running asynchronous operations and async/await patterns
macos-latest
BenchmarkDotNet v0.15.2, macOS Sonoma 14.7.6 (23H626) [Darwin 23.6.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 96.46 ms 1.922 ms 1.797 ms 96.70 ms TUnit 0.55.6 543.53 ms 10.518 ms 13.676 ms 540.16 ms NUnit 4.4.0 778.83 ms 15.787 ms 46.052 ms 758.20 ms xUnit 2.9.3 817.54 ms 16.211 ms 45.989 ms 799.83 ms MSTest 3.10.2 698.82 ms 9.031 ms 7.051 ms 696.98 ms
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.2 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 27.65 ms 0.394 ms 0.368 ms 27.70 ms TUnit 0.55.6 959.09 ms 18.807 ms 19.313 ms 959.31 ms NUnit 4.4.0 1,370.98 ms 17.265 ms 16.149 ms 1,373.31 ms xUnit 2.9.3 1,452.45 ms 11.190 ms 10.467 ms 1,453.72 ms MSTest 3.10.2 1,309.58 ms 16.460 ms 15.396 ms 1,312.08 ms
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.3932) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 62.41 ms 0.087 ms 0.073 ms 62.40 ms TUnit 0.55.6 977.21 ms 19.469 ms 25.315 ms 968.74 ms NUnit 4.4.0 1,357.70 ms 11.091 ms 10.375 ms 1,357.58 ms xUnit 2.9.3 1,446.82 ms 10.272 ms 9.608 ms 1,451.01 ms MSTest 3.10.2 1,305.68 ms 19.365 ms 18.114 ms 1,295.28 ms
Scenario: Simple tests with basic operations and assertions
macos-latest
BenchmarkDotNet v0.15.2, macOS Sonoma 14.7.6 (23H626) [Darwin 23.6.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 87.13 ms 0.968 ms 0.756 ms 86.91 ms TUnit 0.55.6 525.44 ms 8.995 ms 7.511 ms 525.46 ms NUnit 4.4.0 727.30 ms 13.658 ms 18.695 ms 723.91 ms xUnit 2.9.3 750.71 ms 14.854 ms 21.773 ms 745.44 ms MSTest 3.10.2 727.52 ms 20.466 ms 59.377 ms 694.30 ms
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.2 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 26.99 ms 0.523 ms 0.581 ms 27.01 ms TUnit 0.55.6 995.09 ms 18.928 ms 17.705 ms 994.97 ms NUnit 4.4.0 1,406.08 ms 26.195 ms 28.028 ms 1,407.43 ms xUnit 2.9.3 1,492.43 ms 25.741 ms 24.078 ms 1,483.74 ms MSTest 3.10.2 1,349.77 ms 23.860 ms 22.319 ms 1,350.54 ms
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.3932) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 59.00 ms 1.162 ms 2.211 ms 59.14 ms TUnit 0.55.6 991.54 ms 19.419 ms 27.849 ms 981.34 ms NUnit 4.4.0 1,344.26 ms 13.353 ms 12.490 ms 1,339.59 ms xUnit 2.9.3 1,409.28 ms 16.714 ms 15.634 ms 1,410.08 ms MSTest 3.10.2 1,310.13 ms 18.701 ms 17.493 ms 1,320.02 ms
Scenario: Parameterized tests with multiple test cases using data attributes
macos-latest
BenchmarkDotNet v0.15.2, macOS Sonoma 14.7.6 (23H626) [Darwin 23.6.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 NA NA NA NA TUnit 0.55.6 NA NA NA NA NUnit 4.4.0 917.2 ms 39.32 ms 114.70 ms 910.6 ms xUnit 2.9.3 960.2 ms 56.44 ms 158.26 ms 927.1 ms MSTest 3.10.2 740.3 ms 22.13 ms 64.21 ms 717.2 ms
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.2 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 NA NA NA NA TUnit 0.55.6 NA NA NA NA NUnit 4.4.0 1.336 s 0.0195 s 0.0182 s 1.341 s xUnit 2.9.3 1.412 s 0.0182 s 0.0170 s 1.415 s MSTest 3.10.2 1.274 s 0.0132 s 0.0123 s 1.273 s
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.3932) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 NA NA NA NA TUnit 0.55.6 NA NA NA NA NUnit 4.4.0 1.415 s 0.0166 s 0.0155 s 1.414 s xUnit 2.9.3 1.491 s 0.0119 s 0.0105 s 1.487 s MSTest 3.10.2 1.371 s 0.0188 s 0.0176 s 1.376 s
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
Scenario: Tests utilizing class fixtures and shared test context
macos-latest
BenchmarkDotNet v0.15.2, macOS Sonoma 14.7.6 (23H626) [Darwin 23.6.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 85.64 ms 1.161 ms 1.086 ms 85.20 ms TUnit 0.55.6 535.11 ms 10.604 ms 15.208 ms 534.40 ms NUnit 4.4.0 715.83 ms 13.007 ms 10.155 ms 713.98 ms xUnit 2.9.3 739.61 ms 5.761 ms 4.811 ms 739.31 ms MSTest 3.10.2 692.33 ms 12.145 ms 21.270 ms 684.47 ms
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.2 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 25.93 ms 0.210 ms 0.196 ms 25.95 ms TUnit 0.55.6 947.30 ms 18.621 ms 19.122 ms 940.05 ms NUnit 4.4.0 1,323.66 ms 7.561 ms 7.073 ms 1,320.43 ms xUnit 2.9.3 1,401.68 ms 6.496 ms 5.759 ms 1,400.16 ms MSTest 3.10.2 NA NA NA NA
Benchmarks with issues:
RuntimeBenchmarks.MSTest: Job-YNJDZW(Runtime=.NET 9.0)
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.3932) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 53.21 ms 1.055 ms 2.083 ms 53.05 ms TUnit 0.55.6 994.32 ms 19.868 ms 25.127 ms 986.19 ms NUnit 4.4.0 1,336.00 ms 9.199 ms 8.605 ms 1,334.21 ms xUnit 2.9.3 1,411.43 ms 16.491 ms 15.425 ms 1,406.87 ms MSTest 3.10.2 NA NA NA NA
Benchmarks with issues:
RuntimeBenchmarks.MSTest: Job-YNJDZW(Runtime=.NET 9.0)
Scenario: Tests executing in parallel to test framework parallelization
macos-latest
BenchmarkDotNet v0.15.2, macOS Sonoma 14.7.6 (23H626) [Darwin 23.6.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 100.3 ms 3.48 ms 10.05 ms 100.1 ms TUnit 0.55.6 693.3 ms 40.66 ms 114.69 ms 692.5 ms NUnit 4.4.0 1,067.8 ms 38.33 ms 111.81 ms 1,028.3 ms xUnit 2.9.3 897.3 ms 23.34 ms 68.83 ms 890.3 ms MSTest 3.10.2 831.6 ms 39.64 ms 114.36 ms 806.5 ms
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.2 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 26.73 ms 0.526 ms 0.492 ms 26.54 ms TUnit 0.55.6 945.53 ms 18.678 ms 19.985 ms 937.37 ms NUnit 4.4.0 1,338.41 ms 10.116 ms 9.463 ms 1,336.80 ms xUnit 2.9.3 1,405.54 ms 14.881 ms 13.919 ms 1,404.48 ms MSTest 3.10.2 1,261.55 ms 13.815 ms 12.923 ms 1,261.71 ms
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.3932) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 60.48 ms 1.199 ms 1.283 ms 60.60 ms TUnit 0.55.6 1,020.99 ms 20.165 ms 19.804 ms 1,016.69 ms NUnit 4.4.0 1,400.93 ms 17.059 ms 15.957 ms 1,396.48 ms xUnit 2.9.3 1,455.47 ms 8.779 ms 7.782 ms 1,452.53 ms MSTest 3.10.2 1,336.24 ms 17.498 ms 16.368 ms 1,342.25 ms
Scenario: A test that takes 50ms to execute, repeated 100 times
macos-latest
BenchmarkDotNet v0.15.2, macOS Sonoma 14.7.6 (23H626) [Darwin 23.6.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 NA NA NA NA TUnit 0.55.6 NA NA NA NA NUnit 4.4.0 NA NA NA NA xUnit 2.9.3 NA NA NA NA MSTest 3.10.2 NA NA NA NA
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.NUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.xUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.MSTest: Job-YNJDZW(Runtime=.NET 9.0)
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.2 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 NA NA NA NA TUnit 0.55.6 NA NA NA NA NUnit 4.4.0 NA NA NA NA xUnit 2.9.3 NA NA NA NA MSTest 3.10.2 NA NA NA NA
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.NUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.xUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.MSTest: Job-YNJDZW(Runtime=.NET 9.0)
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.3932) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 NA NA NA NA TUnit 0.55.6 NA NA NA NA NUnit 4.4.0 NA NA NA NA xUnit 2.9.3 NA NA NA NA MSTest 3.10.2 NA NA NA NA
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.NUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.xUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.MSTest: Job-YNJDZW(Runtime=.NET 9.0)
Scenario: Tests with setup and teardown lifecycle methods
macos-latest
BenchmarkDotNet v0.15.2, macOS Sonoma 14.7.6 (23H626) [Darwin 23.6.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 98.94 ms 4.827 ms 14.08 ms 93.22 ms TUnit 0.55.6 563.03 ms 12.746 ms 36.16 ms 549.00 ms NUnit 4.4.0 791.27 ms 22.717 ms 65.54 ms 786.73 ms xUnit 2.9.3 820.39 ms 31.874 ms 93.48 ms 788.89 ms MSTest 3.10.2 709.02 ms 13.853 ms 36.01 ms 693.41 ms
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.2 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 27.43 ms 0.222 ms 0.197 ms 27.41 ms TUnit 0.55.6 985.93 ms 19.683 ms 23.431 ms 984.09 ms NUnit 4.4.0 1,401.37 ms 15.325 ms 13.585 ms 1,404.26 ms xUnit 2.9.3 1,454.93 ms 12.965 ms 12.128 ms 1,455.50 ms MSTest 3.10.2 1,300.07 ms 10.769 ms 9.546 ms 1,299.57 ms
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.3932) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.55.6 55.22 ms 1.082 ms 1.368 ms 55.39 ms TUnit 0.55.6 1,000.32 ms 19.795 ms 27.749 ms 987.52 ms NUnit 4.4.0 1,346.92 ms 18.346 ms 17.161 ms 1,345.43 ms xUnit 2.9.3 1,397.98 ms 11.369 ms 10.079 ms 1,399.67 ms MSTest 3.10.2 1,300.30 ms 13.826 ms 11.545 ms 1,300.33 ms
Compatibility .NET 8.0
.NET 9.0
.NET 10.0
.NET Std2.0
